litellm/tests
Krish Dholakia c7e4435bdc
Fix - using managed files w/ OTEL + UI - add model group alias on UI (#13171)
* fix(router.py): safe deep copy kwargs

OTEL adds a parent_otel_span which cannot be deepcopied

* fix: use safe deep copy in other places as well

* test: add script to check and ban copy.deepcopy of kwargs

enforce safe_deep_copy usage

* build(ui/): new component for adding model group alias on UI

* fix(proxy_server.py): support updating model_group_alias via /config/update

allows ui component to work

* fix(router.py): update model_group_alias in router settings based on db value

* fix: fix code qa error
2025-07-31 21:22:04 -07:00
..
basic_proxy_startup_tests
batches_tests openai.ConflictError 2025-07-12 17:07:21 -07:00
code_coverage_tests Fix - using managed files w/ OTEL + UI - add model group alias on UI (#13171) 2025-07-31 21:22:04 -07:00
documentation_tests
enterprise [Prometheus] Move Prometheus to enterprise folder (#12659) 2025-07-18 11:54:47 -07:00
guardrails_tests feat: Add Pillar Security guardrail integration (#12791) 2025-07-22 23:17:33 -07:00
image_gen_tests [Feat] Add Google AI Studio Imagen4 model family (#13065) 2025-07-28 21:25:40 -07:00
litellm_utils_tests test: update test 2025-07-29 21:08:36 -07:00
litellm-proxy-extras
llm_responses_api_testing [MCP Guardrails] move pre and during hooks to ProxyLoggin (#13109) 2025-07-30 13:58:41 -07:00
llm_translation test fix xai - it goes through base llm tests already 2025-07-30 18:18:49 -07:00
load_tests
local_testing [MCP Gateway] Litellm mcp client list fail (#13114) 2025-07-30 15:23:19 -07:00
logging_callback_tests [Feat] Allow redacting message / response content for specific logging integrations - DD LLM Observability (#13158) 2025-07-31 16:44:16 -07:00
mcp_tests [MCP Gateway] Litellm mcp client list fail (#13114) 2025-07-30 15:23:19 -07:00
multi_instance_e2e_tests
old_proxy_tests/tests
openai_endpoints_tests
otel_tests test_bedrock_guardrail_triggered 2025-07-09 17:05:06 -07:00
pass_through_tests test_anthropic_basic_completion_with_headers ci/cd fix 2025-07-12 11:08:03 -07:00
pass_through_unit_tests Azure api_version="preview" support + Bedrock cost tracking via Anthropic /v1/messages (#13072) 2025-07-29 08:13:55 -07:00
proxy_admin_ui_tests Fix e2e test (#12549) 2025-07-12 10:42:57 -07:00
proxy_security_tests
proxy_unit_tests [Feat] Background Health Checks - Allow disabling background health checks for a specific (#13186) 2025-07-31 13:48:35 -07:00
router_unit_tests [Feat] Edit Auto Router Settings on UI (#12966) 2025-07-24 21:25:48 -07:00
scim_tests
spend_tracking_tests
store_model_in_db_tests [MCP Gateway] add Litellm mcp alias for prefixing (#12994) 2025-07-25 17:57:52 -07:00
test_litellm fix: correct patch path in langfuse test for MAX_LANGFUSE_INITIALIZED_CLIENTS (#13192) 2025-07-31 17:11:28 -07:00
unified_google_tests [Bug Fix] Gemini-CLI Integration - ensure tool calling works as expected on generateContent (#13189) 2025-07-31 16:42:57 -07:00
vector_store_tests [Feat] UI Vector Stores - Allow adding Vertex RAG Engine, OpenAI, Azure (#12752) 2025-07-18 18:25:26 -07:00
windows_tests
__init__.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_budget_management.py
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py
test_health.py
test_keys.py
test_logging.conf
test_models.py
test_openai_endpoints.py test_chat_completion_ratelimit 2025-07-30 23:12:11 -07:00
test_organizations.py
test_passthrough_endpoints.py
test_ratelimit.py
test_resource_cleanup.py
test_spend_logs.py
test_team_logging.py
test_team_members.py
test_team.py
test_users.py

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.