litellm

History

Ishaan Jaff dfada882f1 vtx test fix gemini-2.5-flash-lite		2025-08-07 00:11:10 -07:00
..
basic_proxy_startup_tests
batches_tests	openai.ConflictError	2025-07-12 17:07:21 -07:00
code_coverage_tests	Fix - using managed files w/ OTEL + UI - add model group alias on UI (#13171 )	2025-07-31 21:22:04 -07:00
documentation_tests
enterprise	[Feat] - When using custom tags on prometheus allow using wildcard patterns (#13316 )	2025-08-05 17:46:13 -07:00
guardrails_tests	feat: Add Pillar Security guardrail integration (#12791 )	2025-07-22 23:17:33 -07:00
image_gen_tests	[Feat] Add Google AI Studio Imagen4 model family (#13065 )	2025-07-28 21:25:40 -07:00
litellm_utils_tests	test: update test	2025-07-29 21:08:36 -07:00
litellm-proxy-extras
llm_responses_api_testing	Bug Fix - Responses API raises error with Gemini Tool Calls in `input` (#13260 )	2025-08-04 12:01:33 -07:00
llm_translation	test_function_calling_with_tool_response	2025-08-05 09:55:47 -07:00
load_tests
local_testing	vtx test fix gemini-2.5-flash-lite	2025-08-07 00:11:10 -07:00
logging_callback_tests	[Feat] Allow redacting message / response content for specific logging integrations - DD LLM Observability (#13158 )	2025-07-31 16:44:16 -07:00
mcp_tests	[MCP Gateway] fix auth on ui for bearer servers (#13312 )	2025-08-06 09:46:10 -07:00
multi_instance_e2e_tests
old_proxy_tests/tests
openai_endpoints_tests
otel_tests
pass_through_tests	test_anthropic_basic_completion_with_headers ci/cd fix	2025-07-12 11:08:03 -07:00
pass_through_unit_tests	Azure `api_version="preview"` support + Bedrock cost tracking via Anthropic `/v1/messages` (#13072 )	2025-07-29 08:13:55 -07:00
proxy_admin_ui_tests	Fix e2e test (#12549 )	2025-07-12 10:42:57 -07:00
proxy_security_tests
proxy_unit_tests	Exclude none fields on `/chat/completion` - fixes n8n bug + Allow calling `/v1/models` when end user over budget (#13320 )	2025-08-05 21:39:46 -07:00
router_unit_tests	[LLM Translation] Fix model group on clientside auth with API calls (#13314 )	2025-08-05 17:46:47 -07:00
scim_tests
spend_tracking_tests
store_model_in_db_tests	[MCP Gateway] fix auth on ui for bearer servers (#13312 )	2025-08-06 09:46:10 -07:00
test_litellm	Fix create, search vector store error (#13285 )	2025-08-06 11:15:17 -07:00
unified_google_tests	test fix: gcp deprecated gemini-1.5-flash	2025-08-06 08:43:45 -07:00
vector_store_tests	[Feat] UI Vector Stores - Allow adding Vertex RAG Engine, OpenAI, Azure (#12752 )	2025-07-18 18:25:26 -07:00
windows_tests
__init__.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_budget_management.py
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py
test_health.py
test_keys.py
test_logging.conf
test_models.py
test_openai_endpoints.py	test_chat_completion_ratelimit	2025-07-30 23:12:11 -07:00
test_organizations.py
test_passthrough_endpoints.py
test_ratelimit.py
test_resource_cleanup.py
test_spend_logs.py
test_team_logging.py
test_team_members.py
test_team.py
test_users.py

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.