litellm

History

Alexsander Hamir fab1b81b7f fix: add agent_id field to GCS PubSub spend_logs_payload.json test expectation (#17938 ) - Add agent_id: null to expected JSON to match actual payload structure - Fixes test_async_gcs_pub_sub_v1 test failure - agent_id is an optional field in SpendLogsPayload that is always included (as null when not provided)		2025-12-13 13:35:20 -08:00
..
agent_tests	[Feat] Agent Gateway - allow adding langgraph, bedrock agent core agents (#17802 )	2025-12-10 19:13:50 -08:00
audio_tests	[Feat] New model/provider - Adds support for Google Cloud Chirp3 HD on /speech (#17391 )	2025-12-02 15:36:23 -08:00
basic_proxy_startup_tests	Fix: remove merge markdown (#17586 )	2025-12-06 05:38:16 -08:00
batches_tests	Fix: apply_guardrail method and improve test isolation (#17555 )	2025-12-05 12:59:35 -08:00
code_coverage_tests	[Fix] CI/CD - Fix Bedrock tool calling test failures with non-serializable objects and internal parameters (#17930 )	2025-12-13 12:38:07 -08:00
documentation_tests
enterprise	fix(prometheus): add 'exception_status' to prometheus logger (#17847 )	2025-12-12 03:57:46 -08:00
guardrails_tests	Fix Presidio guardrail test TypeError and license base64 decoding error (#17538 )	2025-12-05 08:45:02 -08:00
image_gen_tests	fix	2025-11-26 17:11:33 -08:00
litellm/llms	feat(deepseek): add native support for thinking and reasoning_effort params (#17712 )	2025-12-11 15:28:43 -08:00
litellm_utils_tests	Fix flanky tests (#17665 )	2025-12-08 12:21:26 -08:00
litellm-proxy-extras	Fix: Distinguish permission errors from idempotent errors in Prisma migrations (#17064 )	2025-11-24 20:41:44 -08:00
llm_responses_api_testing	test_process_chunk_with_response_completed_event	2025-11-26 11:52:05 -08:00
llm_translation	[Feat] A2A Gateway - allow adding Azure Foundry Agents on UI (#17909 )	2025-12-12 16:38:04 -08:00
load_tests
local_testing	test_thought_true_with_empty_text_creates_block	2025-12-06 16:00:05 -08:00
logging_callback_tests	fix: add agent_id field to GCS PubSub spend_logs_payload.json test expectation (#17938 )	2025-12-13 13:35:20 -08:00
mcp_tests	feat: add support for using MCPs on /chat/completions	2025-12-10 10:55:33 +09:00
multi_instance_e2e_tests
ocr_tests
old_proxy_tests/tests
openai_endpoints_tests	test_e2e_batches_files	2025-11-27 09:14:43 -08:00
otel_tests	Model Armor - Logging guardrail response on llm responses (#16977 )	2025-11-22 15:44:28 -08:00
pass_through_tests
pass_through_unit_tests
proxy_admin_ui_tests	Fixing e2e	2025-12-05 12:40:58 -08:00
proxy_security_tests
proxy_unit_tests	fix: Add headers to Request scope in JWT tests to fix KeyError (#17927 )	2025-12-13 10:36:13 -08:00
router_unit_tests	fix(router): add minimum request threshold for error rate cooldown (#17464 )	2025-12-12 04:36:10 -08:00
scim_tests
search_tests
spend_tracking_tests
store_model_in_db_tests	test_edit_mcp_server_redacts_credentials	2025-11-26 11:54:11 -08:00
test_litellm	[QA] Cursor Integration x LiteLLM (#17855 )	2025-12-13 12:49:45 -08:00
unified_google_tests
vector_store_tests	Add vector store support for ragflow	2025-12-03 15:29:47 +05:30
windows_tests
__init__.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_budget_management.py
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py
test_gpt5_azure_temperature_support.py
test_health.py
test_keys.py
test_litellm_proxy_responses_config.py
test_logging.conf
test_models.py
test_openai_endpoints.py
test_organizations.py
test_passthrough_endpoints.py
test_ratelimit.py
test_resource_cleanup.py
test_spend_logs.py
test_team_logging.py
test_team_members.py
test_team.py
test_users.py

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.