ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
552b7e4013
litellm/enterprise
History
Krish Dholakia 552b7e4013
Add customer + model per key level multi-instance tpm/rpm limiting (#10518) 
* fix(redis_cache.py): handle multiple event loops

* fix(parallel_request_limiter_v2.py): add customer tpm limiting

* fix(parallel_request_limiter.py): add customer rpm limiting

* fix(parallel_request_limiter_v2.py): add model per key + customer tpm/rpm limiting

* fix(parallel_request_limiter_v2.py): make error more informative

* fix: fix ruff error

* fix: generate new poetry lock
2025-05-03 10:28:55 -07:00
..
cloudformation_stack (fix) litellm cloud formation stack 2024-03-07 18:06:59 -08:00
enterprise_callbacks Add key-level multi-instance tpm/rpm/max parallel request limiting (#10458) 2025-04-30 21:32:31 -07:00
enterprise_hooks Add customer + model per key level multi-instance tpm/rpm limiting (#10518) 2025-05-03 10:28:55 -07:00
enterprise_ui Update README.md 2024-02-21 22:11:39 -08:00
proxy [QA] Bedrock Vector Stores Integration - Allow using with registry + in OpenAI API spec with tools (#10516) 2025-05-03 08:30:38 -07:00
__init__.py (fix) error cli users see when importing enterprise folder 2024-03-15 08:10:45 -07:00
LICENSE.md refactor: fix commercial license terms 2024-02-15 13:04:47 -08:00
README.md Update README.md 2024-02-17 16:46:11 -08:00

README.md

LiteLLM Enterprise

Code in this folder is licensed under a commercial license. Please review the LICENSE file within the /enterprise folder

These features are covered under the LiteLLM Enterprise contract

👉 Using in an Enterprise / Need specific features ? Meet with us here

See all Enterprise Features here 👉 Docs