litellm/tests/test_litellm
Krish Dholakia c96da44265
(feat) Audio transcription - cost tracking + (feat) image generation - accurate cost tracking based on output_format/quality/size
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation

Fixes https://github.com/BerriAI/litellm/issues/11846

Closes https://github.com/BerriAI/litellm/issues/14605

* fix(cost_calculator.py): correctly use base model, when set

Fixes issue where azure base model was being ignored

* feat(cost_calculator.py): fix default cost tracking quality param for image generation

* feat(image_generations/): return output_format, quality, size

aligns response to openai spec and improves cost tracking accuracy

* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params

* build: update build

* fix: fix cost calculation

* build: update poetry lock

* fix: fix ruff checks

* fix: fix aembedding

* fix: fix ruff errors

* fix: modify to catch errors

* fix: test

* fix: loosen test to handle openai lib out of sync
2025-11-08 15:30:46 -08:00
..
caching fix(redis): handle float redis_version from AWS ElastiCache Valkey (#16207) 2025-11-04 19:20:00 -08:00
completion_extras/litellm_responses_transformation feat(openai/): convert chat completion tool calls to responses api 2025-10-10 19:41:11 -07:00
containers Add E2E Container API Support (#16136) 2025-11-01 14:03:51 -07:00
enterprise/enterprise_callbacks [Feat] Email Notifications - Ensure Users get Key Rotated Email (#16292) 2025-11-05 15:56:49 -08:00
experimental_mcp_client fix(mcp/): add ssl certificate settings for mcp clients 2025-10-06 18:36:05 -07:00
google_genai [Oct Staging Branch] (#15460) 2025-10-17 17:52:25 -07:00
integrations test_dd_llms_obs_redaction 2025-11-08 14:23:42 -08:00
litellm_core_utils (feat) Audio transcription - cost tracking + (feat) image generation - accurate cost tracking based on output_format/quality/size 2025-11-08 15:30:46 -08:00
llms Added xai responses support (#16391) 2025-11-08 12:30:09 -08:00
passthrough fix test claude-sonnet-4-5-20250929 2025-10-31 18:13:29 -07:00
proxy test_delete_callbacks_in_db 2025-11-08 14:05:44 -08:00
responses Add LLM provider response headers to Responses API (#16091) 2025-11-01 13:25:56 -07:00
router_strategy
router_utils Add LLM provider response headers to Responses API (#16091) 2025-11-01 13:25:56 -07:00
secret_managers [Feat] Add Custom Secret Manager - Allow users to define and write a custom secret manager (#16297) 2025-11-05 17:20:26 -08:00
types
vector_stores
__init__.py
conftest.py Perf speed up pytest (#15951) 2025-10-27 19:43:40 -07:00
log.txt
readme.md
test_acompletion_session_reuse_e2e.py [Fix] - Sessions not being shared (#15388) 2025-10-09 16:57:40 -07:00
test_aembedding_session_reuse_e2e.py [Fix] - shared session parsing and usage issue (#15440) 2025-10-10 19:26:53 -07:00
test_azure_video_router.py Litellm sameer oct staging (#15806) 2025-10-24 12:17:22 -07:00
test_constants.py tes numeric constants 2025-10-29 18:23:38 -07:00
test_container_router.py Add E2E Container API Support (#16136) 2025-11-01 14:03:51 -07:00
test_cost_calculation_log_level.py
test_cost_calculator.py (feat) Audio transcription - cost tracking + (feat) image generation - accurate cost tracking based on output_format/quality/size 2025-11-08 15:30:46 -08:00
test_exception_mapping_request_attribute.py
test_filter_out_litellm_params.py [Bug Fix] Exa Search API - ensure request params are sent to Exa AI (#15855) 2025-10-23 11:56:30 -07:00
test_groq_streaming_encoding.py
test_logging.py
test_lowest_latency_zero_tokens.py
test_main.py build: squash merge litellm_dev_10_10_2025_p1 2025-10-25 12:21:12 -07:00
test_redis.py fix: Apply max_connections configuration to Redis async client (#15797) 2025-10-22 09:19:08 -07:00
test_responses_id_security.py (security) Responses API - prevent User A from retrieving User B's response, if response.id is leaked (#15757) 2025-10-25 13:41:59 -07:00
test_router_google_genai.py
test_router.py test fix claude-sonnet-4-5-20250929 2025-10-28 19:05:13 -07:00
test_shared_session_integration.py
test_system_message_format_bug.py
test_utils.py Fix HostedVLLMRerankConfig will not be used (#16352) 2025-11-07 19:11:59 -08:00
test_uuid_helper.py
test_video_generation.py Add custom_llm_provider support for video endpoints (non-generation) (#16121) 2025-11-01 12:09:11 -07:00

Testing for litellm/

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

  1. Increase test coverage of litellm/
  2. Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

  • litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
  • test_<filename>.py maps to litellm/<filename>.py