6bb1d77f45
* fix(support-model-specific-tpm/rpm-limits): Allows setting rate limits by tpm/rpm for models by team * fix(key_management_endpoints.py): enforce guaranteed throughput with key-level model tpm/rpm limits, when team-level tpm/rpm limits are set * test: add unit testing * feat(schema.prisma): add metadata to litellm budget table * feat(proxy/utils.py): add org limits to user api key auth allows org level tpm/rpm limiting to work * feat: add org level tpm/rpm limits + inherit org id in key from team enables org level tpm/rpm limits * feat: validated working org tpm/rpm limits * feat: support updating org level, model specific tpm/rpm limits * fix: working key validation for org level tpm/rpm limits * fix: working validation for orgs when giving tpm/rpm to teams * fix(key_management_endpoints.py): fix tpm/rpm limits on orgs * fix(key_management_endpoints.py): support limits * refactor: remove duplicate var * fix: refactor to avoid ruff errors * fix: fix typign * fix: fix linting error * fix: fix testing * fix(key_management_endpoints.py): document params |
||
|---|---|---|
| .. | ||
| _experimental/mcp_server | ||
| anthropic_endpoints | ||
| auth | ||
| client | ||
| common_utils | ||
| db | ||
| experimental/mcp_server | ||
| google_endpoints | ||
| guardrails | ||
| health_endpoints | ||
| hooks | ||
| image_endpoints | ||
| management_endpoints | ||
| management_helpers | ||
| middleware | ||
| openai_files_endpoint | ||
| pass_through_endpoints | ||
| spend_tracking | ||
| test_configs | ||
| ui_crud_endpoints | ||
| vector_store_endpoints | ||
| __init__.py | ||
| test_batch_metadata_none_fix.py | ||
| test_caching_routes.py | ||
| test_common_request_processing.py | ||
| test_custom_proxy.py | ||
| test_fastapi_offline_routes.py | ||
| test_health_check_functions.py | ||
| test_litellm_pre_call_utils.py | ||
| test_proxy_cli.py | ||
| test_proxy_server.py | ||
| test_proxy_types.py | ||
| test_proxy_utils.py | ||
| test_route_llm_request.py | ||
| test_shared_health_check.py | ||
| test_spend_log_cleanup.py | ||
| test_swagger_chat_completions.py | ||
| test_team_member_update.py | ||