litellm/tests/test_litellm
Ishaan Jaff 04dc1a5351
[Feat] Add support for returning images with gemini/gemini-2.5-flash-image-preview with /chat/completions (#13983)
* add gemini-2.5-flash-image-preview

* add gemini-2.5-flash-image-preview

* add image in ChatCompletionResponseMessage

* test_gemini_image_generation_async

* Revert "Merge pull request #13394 from Deviad/feature/enhance_logging_for_containers"

This reverts commit 539b94ad4e, reversing
changes made to 71af7bcf9c.

* include `image` in Delta

* fix _process_candidates should show the image response

* fix: _handle_special_delta_attributes

* test_gemini_image_generation_async_stream

* image_generation_chat

* UI - allow looking at generated images from /chat/completions

* _create_streaming_choice

* fix import StreamingChoices

* fix ChatCompletionResponseMessage

* test_gemini_image_generation

* add gemini img migration

* fix _extract_candidate_metadata

* ui fix

* fix batch endpoint test
2025-08-27 16:16:19 -07:00
..
caching verify expires field prior to serving cache entry 2025-08-25 10:42:12 +02:00
completion_extras/litellm_responses_transformation fix: handle reasoning parameters and response in responses bridge (#12433) 2025-07-10 18:06:45 -07:00
enterprise/enterprise_callbacks [Feat] Backend - Add support for disabling callbacks in request body (#12762) 2025-07-19 10:10:30 -07:00
experimental_mcp_client [MCP Gateway] Allow using stdio MCPs with LiteLLM (#12530) 2025-07-11 20:21:02 -07:00
google_genai [Bug Fix] Gemini-CLI - The Gemini Custom API request has an incorrect authorization format (#13098) 2025-07-29 13:46:43 -07:00
integrations [Feat] langfuse_otel logger - allow using LANGFUSE_OTEL_HOST for configuring host (#14013) 2025-08-27 14:43:47 -07:00
litellm_core_utils [Feat] Add support for returning images with gemini/gemini-2.5-flash-image-preview with /chat/completions (#13983) 2025-08-27 16:16:19 -07:00
llms [Feature]: Support Gemini requests with only system prompt (#14010) 2025-08-27 12:12:47 -07:00
passthrough [Bug Fix] Azure Passthrough request with streaming (#13831) 2025-08-25 14:11:17 -07:00
proxy Fix issue #13995: Handle None metadata in batch requests (#13996) 2025-08-27 14:51:09 -07:00
responses [Bug]: /responses endpoint proxy ignores extra_headers in GitHub Copilot (#13775) 2025-08-27 12:35:09 -07:00
router_strategy fix mapped test 2025-07-25 07:24:42 -07:00
router_utils Merge pull request #13529 from BerriAI/litellm_dev_08_11_2025_p1 2025-08-18 18:54:19 -07:00
secret_managers Added handling for pwd protected cert files in AOAI CertificateCredential auth (#12995) 2025-07-28 21:34:54 -07:00
types [LLM Translation] Fix Model Usage not having text tokens (#13234) 2025-08-04 21:06:49 +05:30
vector_stores [Bug Fix] Bedrock KB - Using LiteLLM Managed Credentials for Query (#13787) 2025-08-19 15:39:36 -07:00
__init__.py [Feat] Add github co-pilot as a new LLM API provider (#12325) 2025-07-04 13:12:16 -07:00
conftest.py [Feat] Add support for returning images with gemini/gemini-2.5-flash-image-preview with /chat/completions (#13983) 2025-08-27 16:16:19 -07:00
log.txt Litellm fix GitHub action testing (#11163) 2025-05-26 14:41:42 -07:00
readme.md Litellm fix GitHub action testing (#11163) 2025-05-26 14:41:42 -07:00
test_constants.py Litellm fix GitHub action testing (#11163) 2025-05-26 14:41:42 -07:00
test_cost_calculation_log_level.py Enhance logging in cost calculation tests to ensure DEBUG level captures are accurate. Updated tests to set logger level before assertions and restored original logger level after execution. This improves reliability of log level checks in both cost and batch cost calculation tests. 2025-08-14 14:21:22 -07:00
test_cost_calculator.py Update test_cost_calculator.py 2025-08-19 23:14:22 +05:30
test_groq_streaming_encoding.py [Bug] Fix: Vertex Mistral not working for streaming (#13952) 2025-08-25 17:39:40 -07:00
test_logging.py [Bug Fix] StandardLoggingPayload on cache_hits should track custom llm provider + DD LLM Obs span type (#12652) 2025-07-16 15:43:15 -07:00
test_lowest_latency_zero_tokens.py fix(lowest_latency.py): Handle ZeroDivisionError with zero completion tokens (#12734) 2025-07-18 15:19:47 -07:00
test_main.py Fix async retryer on .acompletion() + forward clientside headers - filter out content-type from clientside request (causes llm api call to hang) (#12886) 2025-07-22 19:50:05 -07:00
test_router.py test: cleanup old tests 2025-08-18 22:58:29 -07:00
test_utils.py fix: LITELLM_LOG_FILE test 2025-08-27 08:25:24 -07:00

Testing for litellm/

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

  1. Increase test coverage of litellm/
  2. Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

  • litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
  • test_<filename>.py maps to litellm/<filename>.py