litellm

History

Ishaan Jaff 50b106be11 [MCP Gateway] Ensure we use the same param for specifying groups (#12561 ) * just use 1 param for mcp groups * fix just use 1 param for access groups * test_get_tools_from_mcp_servers * docs access groups * group MCPs * test fix * fix screenshots on docs * TestMCPAccessGroupsE2E * update img * fix MCP connect		2025-07-12 16:41:58 -07:00
..
basic_proxy_startup_tests
batches_tests	Store batch output file id in DB + Store batch file status in DB + (experimental) BATCH API COST TRACKING	2025-06-25 22:41:22 -07:00
code_coverage_tests	UI - Azure Content Guardrails (#12341 )	2025-07-05 10:19:29 -07:00
documentation_tests
enterprise	[Enterprise] Support tag based mode for guardrails (#12508 )	2025-07-10 22:27:30 -07:00
guardrails_tests	test_bedrock_guardrail_blocked_action_shows_output_text_with_multiple_outputs	2025-07-09 17:03:56 -07:00
image_gen_tests	[Feat] Add XInference Image Generation API Provider (#12439 )	2025-07-08 21:17:38 -07:00
litellm_utils_tests	Prevent writing default user setting updates to yaml (error in non-root env) + Use central team member budget when max_budget_in_team set on UI (#12533 )	2025-07-12 10:13:07 -07:00
litellm-proxy-extras
llm_responses_api_testing	test_mcp_tools_with_responses_api	2025-07-03 14:53:30 -07:00
llm_translation	ruff check ./litellm --fix	2025-07-12 11:04:02 -07:00
load_tests
local_testing	test test_redis_caching_multiple_namespaces (#12552 )	2025-07-12 12:06:16 -07:00
logging_callback_tests	Team Members - reset budget, if duration set + Prometheus - support tag based metrics (#12534 )	2025-07-11 22:54:16 -07:00
mcp_tests	[MCP Gateway] Ensure we use the same param for specifying groups (#12561 )	2025-07-12 16:41:58 -07:00
multi_instance_e2e_tests
old_proxy_tests/tests
openai_endpoints_tests	Batches - support batch retrieve with target model Query Param + Anthropic - completion bridge, yield content_block_stop chunk (#12228 )	2025-07-01 22:13:48 -07:00
otel_tests	test_bedrock_guardrail_triggered	2025-07-09 17:05:06 -07:00
pass_through_tests	test_anthropic_basic_completion_with_headers ci/cd fix	2025-07-12 11:08:03 -07:00
pass_through_unit_tests	test fix - test_anthropic_messages_passthrough.py	2025-06-30 21:56:31 -07:00
proxy_admin_ui_tests	Fix e2e test (#12549 )	2025-07-12 10:42:57 -07:00
proxy_security_tests
proxy_unit_tests	[Security Fix] - Dont show pure JWT in "Logs" page on UI (#12524 )	2025-07-11 15:33:57 -07:00
router_unit_tests	test_mock_router_testing_params_str_to_bool_conversion	2025-06-27 18:07:33 -07:00
scim_tests
spend_tracking_tests
store_model_in_db_tests	Validation to mcp server name (#12515 )	2025-07-11 11:24:42 -07:00
test_litellm	[MCP Gateway] Ensure we use the same param for specifying groups (#12561 )	2025-07-12 16:41:58 -07:00
unified_google_tests	[Bug Fix] Using `gemini-cli` with Vertex Anthropic Models (#12246 )	2025-07-03 12:29:27 -07:00
vector_store_tests	[Feat] OpenAI/Azure OpenAI - Add support for creating vector stores on LiteLLM (#12021 )	2025-06-24 20:46:48 -07:00
windows_tests
__init__.py	[Feat] Add github co-pilot as a new LLM API provider (#12325 )	2025-07-04 13:12:16 -07:00
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_budget_management.py	Update enduser spend and budget reset date based on budget duration (#8460 )	2025-06-08 08:39:14 -07:00
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py
test_health.py
test_keys.py
test_logging.conf
test_models.py	Add model access groups on UI (#11719 )	2025-06-13 21:20:25 -07:00
test_openai_endpoints.py
test_organizations.py
test_passthrough_endpoints.py
test_ratelimit.py
test_resource_cleanup.py	Fix: Properly close aiohttp client sessions to prevent resource leaks (#12251 )	2025-07-09 09:25:17 -07:00
test_spend_logs.py
test_team_logging.py
test_team_members.py
test_team.py
test_users.py

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.