litellm/tests/test_litellm
Ishaan Jaff 106a298f0a
[Feat] UI - Allow Adding LiteLLM Auto Router on UI (#12960)
* add router.json

* test_router_auto_router

* async_pre_routing_hook

* fixes for auto router

* add async_pre_routing_hook

* add LiteLLMRouterEncoder

* update test auto_router_embedding_model

* add auto_router_embedding_model

* add AutoRouter

* fix async_pre_routing_hook

* update async_pre_routing_hook

* fix auto router

* fix router.json

* working router init

* working embedding encoder

* working auto router

* test_router_auto_router

* test auto router

* add semantic-router as optional for litellm

* add extras

* semantic_router==0.1.10

* ruff fix

* use aiohttp==3.10.11

* python-dotenv==1.0.1

* test auto router

* test_router_auto_router

* semantic_router

* test_is_auto_router_deployment

* fix check

* fix docker build step

* add semantic_router

* UI  - Add auto router on litellm

* working utterances config

* fix route config builder

* kind of working add automodel router

* move loc of add deployment

* fixes for AutoRouter

* add auto_router_config in types.py

* fixes for init_auto_router_deployment

* fix adding auto router models

* working auto-router with dB

* Revert "add semantic_router"

This reverts commit 537b67288798731a119d811f643b682086377ee9.

* TestAutoRouter

* fix linting

* add semantic router to docker

* test fix

* fix router config builder

* remove export button
2025-07-24 19:58:49 -07:00
..
caching test_qdrant_semantic_cache_async_set_cache 2025-07-19 15:59:56 -07:00
completion_extras/litellm_responses_transformation fix: handle reasoning parameters and response in responses bridge (#12433) 2025-07-10 18:06:45 -07:00
enterprise/enterprise_callbacks [Feat] Backend - Add support for disabling callbacks in request body (#12762) 2025-07-19 10:10:30 -07:00
experimental_mcp_client [MCP Gateway] Allow using stdio MCPs with LiteLLM (#12530) 2025-07-11 20:21:02 -07:00
google_genai [Bug Fix] /generateContent API - Only pass supported params when using OpenAI models (#12297) 2025-07-04 12:08:10 -07:00
integrations [Feat] LiteLLM CloudZero Integration updates - using LiteLLM_SpendLogs Table (#12922) 2025-07-23 18:46:50 -07:00
litellm_core_utils [Feat] - Track cost + add tags for health checks done by LiteLLM Proxy (#12880) 2025-07-22 18:45:57 -07:00
llms Revert "Litellm dev 07 21 2025 p1 (#12848)" 2025-07-22 18:28:36 -07:00
passthrough Refactor: bedrock passthrough fixes - migrate to Passthrough SDK (#12089) 2025-06-26 22:51:35 -07:00
proxy Proxy - specify key_type - allows specifying if key can call LLM API routes vs. Management routes only (#12909) 2025-07-24 16:40:40 -07:00
responses feat: add image support for Responses API to Chat Completion transformation (#12204) 2025-07-07 21:17:54 -07:00
router_strategy [Feat] UI - Allow Adding LiteLLM Auto Router on UI (#12960) 2025-07-24 19:58:49 -07:00
router_utils fix mapped tests (#12320) 2025-07-04 10:04:43 -07:00
secret_managers fix(secret-managers): Break AzureCredentialType restriction on AZURE_CREDENTIAL (#11272) 2025-05-31 01:03:08 -07:00
types feat(stream_chunk_builder_utils.py): correctly return web_search_requests on stream chunk builder 2025-07-03 10:56:26 -07:00
vector_stores [Fix] QA Fixes - Vector Store Object Permissions (#11291) 2025-05-31 09:41:05 -07:00
__init__.py [Feat] Add github co-pilot as a new LLM API provider (#12325) 2025-07-04 13:12:16 -07:00
conftest.py fix mapped tests (#12320) 2025-07-04 10:04:43 -07:00
log.txt Litellm fix GitHub action testing (#11163) 2025-05-26 14:41:42 -07:00
readme.md Litellm fix GitHub action testing (#11163) 2025-05-26 14:41:42 -07:00
test_constants.py Litellm fix GitHub action testing (#11163) 2025-05-26 14:41:42 -07:00
test_cost_calculation_log_level.py fix: change cost calculation logs from INFO to DEBUG level 2025-06-27 11:36:58 -06:00
test_cost_calculator.py test: update test 2025-07-16 09:15:05 -07:00
test_logging.py [Bug Fix] StandardLoggingPayload on cache_hits should track custom llm provider + DD LLM Obs span type (#12652) 2025-07-16 15:43:15 -07:00
test_lowest_latency_zero_tokens.py fix(lowest_latency.py): Handle ZeroDivisionError with zero completion tokens (#12734) 2025-07-18 15:19:47 -07:00
test_main.py Fix async retryer on .acompletion() + forward clientside headers - filter out content-type from clientside request (causes llm api call to hang) (#12886) 2025-07-22 19:50:05 -07:00
test_router.py Allow forwarding clientside headers by model group (#12753) 2025-07-19 15:17:13 -07:00
test_utils.py test_proxy_model_resolution_with_custom_names_documentation 2025-07-23 13:13:46 -07:00

Testing for litellm/

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

  1. Increase test coverage of litellm/
  2. Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

  • litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
  • test_<filename>.py maps to litellm/<filename>.py