litellm/tests/test_litellm
Krish Dholakia 4e141df03a
(feat) Team level model-specific tpm/rpm limits + working key-level validation of tpm/rpm limit when assigned to team (#15513)
* fix(support-model-specific-tpm/rpm-limits): Allows setting rate limits by tpm/rpm for models by team

* fix(key_management_endpoints.py): enforce guaranteed throughput with key-level model tpm/rpm limits, when team-level tpm/rpm limits are set

* test: add unit testing

* fix: fix minor linting errors

* fix: refactor
2025-10-18 13:14:04 -07:00
..
caching [Performance] Reduce complexity of InMemoryCache.evict_cache from O(n*log(n)) to O(log(n)) (#15000) 2025-09-30 16:49:35 -07:00
completion_extras/litellm_responses_transformation feat(openai/): convert chat completion tool calls to responses api 2025-10-10 19:41:11 -07:00
enterprise/enterprise_callbacks
experimental_mcp_client fix(mcp/): add ssl certificate settings for mcp clients 2025-10-06 18:36:05 -07:00
google_genai [Oct Staging Branch] (#15460) 2025-10-17 17:52:25 -07:00
integrations UI - add arize on ui, LLMs - clarifai refactor to openai compatible route, added azure ai/grok-4 model family 2025-10-16 20:39:15 -07:00
litellm_core_utils Bedrock + MCP - working MCP calls to bedrock via Responses API + Log hidden params for OTEL calls (#15677) 2025-10-18 10:39:28 -07:00
llms [Oct Staging Branch] (#15460) 2025-10-17 17:52:25 -07:00
passthrough test: add unit tests 2025-10-06 13:53:36 -07:00
proxy (feat) Team level model-specific tpm/rpm limits + working key-level validation of tpm/rpm limit when assigned to team (#15513) 2025-10-18 13:14:04 -07:00
responses test: update test 2025-10-12 21:58:06 -07:00
router_strategy
router_utils
secret_managers
types
vector_stores
__init__.py
conftest.py
log.txt
readme.md
test_acompletion_session_reuse_e2e.py [Fix] - Sessions not being shared (#15388) 2025-10-09 16:57:40 -07:00
test_aembedding_session_reuse_e2e.py [Fix] - shared session parsing and usage issue (#15440) 2025-10-10 19:26:53 -07:00
test_constants.py
test_cost_calculation_log_level.py
test_cost_calculator.py [Feat] Cost Tracking - specify a global vendor discount for costs. (#15546) 2025-10-14 20:07:04 -07:00
test_exception_mapping_request_attribute.py
test_groq_streaming_encoding.py
test_logging.py
test_lowest_latency_zero_tokens.py
test_main.py
test_redis.py fix mapped tests 1 (#15445) 2025-10-11 08:33:08 -07:00
test_router_google_genai.py
test_router.py fix _add_deployment_model_to_endpoint_for_llm_passthrough_route 2025-10-16 15:10:54 -07:00
test_shared_session_integration.py
test_system_message_format_bug.py
test_utils.py test fix 2025-10-17 18:55:05 -07:00
test_uuid_helper.py

Testing for litellm/

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

  1. Increase test coverage of litellm/
  2. Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

  • litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
  • test_<filename>.py maps to litellm/<filename>.py