litellm

History

mubashir1osmani 3c595f6fd2 fix(test): update Phoenix OTEL test for dedicated TracerProvider architecture The old test assumed ArizePhoenixLogger reused the global TracerProvider. With the nested traces fix, Phoenix now creates its own dedicated provider and produces litellm_proxy_request + litellm_request + raw_gen_ai_request spans independently. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>		2026-02-26 06:40:24 -05:00
..
agent_tests
audio_tests
basic_proxy_startup_tests
batches_tests	fix(tests): fix flaky test_create_vertex_fine_tune_jobs_mocked - handle background Datadog flush (#21838 )	2026-02-21 14:44:01 -08:00
code_coverage_tests	fix(ci): resolve mypy and check_code_and_doc_quality CI failures (#21812 )	2026-02-21 13:08:47 -08:00
documentation_tests	fix failing tests	2026-02-21 15:48:26 -08:00
enterprise	fix: prevent double-counting of litellm_proxy_total_requests_metric (#21159 )	2026-02-16 09:10:49 -08:00
guardrails_tests	fix(ollama): thread api_base to get_model_info + graceful fallback (#21970 )	2026-02-23 21:00:37 -08:00
image_gen_tests
litellm	fix(proxy): recover from prisma-query-engine zombie process (#21899 )	2026-02-23 08:57:01 -08:00
litellm_core_utils
litellm_utils_tests	feat(proxy): limit concurrent health checks with health_check_concurrency (#20584 )	2026-02-24 08:16:59 -08:00
litellm-proxy-extras
llm_responses_api_testing	Fix anthropic responses	2026-02-20 17:30:42 -08:00
llm_translation	fix(anthropic): sanitize tool_use IDs in convert_to_anthropic_tool_invoke (#21964 )	2026-02-23 21:01:48 -08:00
load_tests
local_testing	fix(ollama): thread api_base to get_model_info + graceful fallback (#21970 )	2026-02-23 21:00:37 -08:00
logging_callback_tests	fix(test): update Phoenix OTEL test for dedicated TracerProvider architecture	2026-02-26 06:40:24 -05:00
mcp_tests	fix(tests): add spec_path=None to MCP server mocks to fix Pydantic validation	2026-02-20 13:13:48 -03:00
multi_instance_e2e_tests
ocr_tests
old_proxy_tests/tests
openai_endpoints_tests
otel_tests
pass_through_tests	FIx: replace deprecated claude-3-7-sonnet-20250219 with claude-4-sonnet-20250514	2026-02-20 17:27:59 -08:00
pass_through_unit_tests	Fix passthrough tests	2026-02-20 17:28:06 -08:00
proxy_admin_ui_tests	security: fix critical/high CVEs in OS-level libs and NPM transitive	2026-02-24 19:40:09 +05:30
proxy_e2e_anthropic_messages_tests	Fix: litellm/tests/llm_responses_api_testing/test_anthropic_responses_api.py	2026-02-20 17:30:53 -08:00
proxy_security_tests
proxy_unit_tests	feat(proxy): limit concurrent health checks with health_check_concurrency (#20584 )	2026-02-24 08:16:59 -08:00
router_unit_tests	Merge pull request #20593 from ryan-crabbe/perf/reuse-litellm-params	2026-02-21 12:11:02 -08:00
scim_tests
search_tests	Add duckcukgo in model map	2026-02-18 16:13:20 +05:30
spend_tracking_tests
store_model_in_db_tests
test_litellm	fix(arize-phoenix): enable nested traces coexistence with otel callback	2026-02-26 04:59:17 -05:00
unified_google_tests
vector_store_tests	Add support for vertex ai for rag/ingest	2026-02-13 20:11:10 +05:30
windows_tests
__init__.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_budget_management.py
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_default_encoding_non_root.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py
test_gpt5_azure_temperature_support.py
test_health.py
test_keys.py
test_litellm_proxy_responses_config.py
test_logging.conf
test_models.py
test_openai_endpoints.py
test_organizations.py
test_otel_thread_leak.py
test_passthrough_endpoints.py
test_presidio_latency.py
test_proxy_server_non_root.py
test_ratelimit.py
test_resource_cleanup.py
test_service_logger_otel.py
test_spend_logs.py
test_team_logging.py
test_team_members.py
test_team.py	fix(test): skip 'projects' field in team update assertion (#21777 )	2026-02-21 10:24:53 -08:00
test_users.py	fix(tests): update deprecated Anthropic model in test_user_model_access (#21826 )	2026-02-21 14:18:24 -08:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.