litellm/tests/test_litellm
Ishaan Jaff 5b8e300150
[Feat] gemini-cli integration - Add Logging + Cost tracking for stream + non-stream Vertex / Google AI Studio routes (#12058)
* add google generate content to call types

* Revert "add google generate content to call types"

This reverts commit 6f57dde293e50674c8fca0feac6e01c27d9e1c96.

* add CallTypesLiteral for gemini

* allow passing model to vertexpass through logging handler

* update logging handler

* fix checking if stream

* add async streaming logging for vtx

* refactor _transform_google_generate_content_to_openai_model_response

* fix logging_obj

* fixes _handle_non_streaming_google_genai_generate_content_response_logging

* logging callback tests

* ruff check fixes

* test _is_streaming_request

* test_ensure_initialize_azure_sdk_client_always_used

* fix BaseGoogleGenAIGenerateContentStreamingIterator

* fix - linting errors

* req - add google-genai
2025-06-25 22:26:20 -07:00
..
caching fix(redis_cache.py): support pipeline redis lpop for older redis vers… (#11425) 2025-06-05 00:05:54 -07:00
completion_extras/litellm_responses_transformation Completion-To-Responses Bridge: Support passing image url's (#11833) 2025-06-18 12:48:17 -07:00
enterprise/enterprise_callbacks [Feat] Enterprise - Allow dynamically disabling callbacks in request headers (#11985) 2025-06-23 14:32:05 -07:00
experimental_mcp_client
integrations LiteLLM SDK <-> Proxy improvement (don't transform message client-side) + Bedrock - handle qs:.. in base64 file data + Tag Management - support adding public model names (#11908) 2025-06-19 22:34:18 -07:00
litellm_core_utils Fix unpack_defs handling of nested $ref inside anyOf items (#11964) 2025-06-24 09:08:15 -07:00
llms [Feat] gemini-cli integration - Add Logging + Cost tracking for stream + non-stream Vertex / Google AI Studio routes (#12058) 2025-06-25 22:26:20 -07:00
passthrough build(VLLM-Passthrough-with-loadbalancing-support-(enables-using-model-list-for-VLLM-/classify-endpoint)): Closes #11205 2025-05-31 09:00:04 -07:00
proxy Managed Files + Batches - filter deployments to only those where file was written + save all model file id mappings in DB (prev just 1st one) (#12048) 2025-06-25 21:27:06 -07:00
responses [Feat] Day-0 Support for OpenAI Re-usable prompts Responses API (#11782) 2025-06-16 21:28:50 -07:00
router_strategy Simplify experimental multi-instance rate limiter - more accurate (#11424) 2025-06-07 11:10:55 -07:00
router_utils Litellm dev 06 25 2025 p2 (#12049) 2025-06-25 21:54:13 -07:00
secret_managers fix(secret-managers): Break AzureCredentialType restriction on AZURE_CREDENTIAL (#11272) 2025-05-31 01:03:08 -07:00
types Convert scientific notation str to int + Bubble up azure content filter results (#11655) 2025-06-11 23:07:22 -07:00
vector_stores [Fix] QA Fixes - Vector Store Object Permissions (#11291) 2025-05-31 09:41:05 -07:00
__init__.py
conftest.py
log.txt
readme.md
test_constants.py
test_cost_calculator.py VertexAI Anthropic passthrough cost calc fixes + Filter litellm params from request sent to passthrough endpoint (#11992) 2025-06-23 22:24:47 -07:00
test_logging.py
test_main.py fix: tests 2025-05-31 13:14:37 -07:00
test_router.py Litellm dev 06 25 2025 p2 (#12049) 2025-06-25 21:54:13 -07:00
test_utils.py Fix unpack_defs handling of nested $ref inside anyOf items (#11964) 2025-06-24 09:08:15 -07:00

Testing for litellm/

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

  1. Increase test coverage of litellm/
  2. Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

  • litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
  • test_<filename>.py maps to litellm/<filename>.py