litellm/tests
Adam Holmberg 2ce03d9735 fix: make gemini and openai responses return reasoning by default
This aligns the proxy experience with other models that think
automatically (e.g. Deepseek R1 and grok3). It does so by setting
the necessary request input to return thinking, but not specifying
a budget or effort (thus defaulting to the internal automatic level).
2025-07-22 10:41:29 -05:00
..
basic_proxy_startup_tests
batches_tests openai.ConflictError 2025-07-12 17:07:21 -07:00
code_coverage_tests [Bug fix] [Bug]: Verbose log is enabled by default (#12596) 2025-07-14 20:06:16 -07:00
documentation_tests
enterprise [Prometheus] Move Prometheus to enterprise folder (#12659) 2025-07-18 11:54:47 -07:00
guardrails_tests [Feat] Bedrock Guardrails - Allow disabling exception on 'BLOCKED' action (#12693) 2025-07-17 08:46:33 -07:00
image_gen_tests feat: add input_fidelity parameter for OpenAI image generation (#12662) 2025-07-16 16:56:05 -07:00
litellm_utils_tests [Bug Fix] Always include tool calls in output of trim_messages (#11517) 2025-07-17 16:01:59 -07:00
litellm-proxy-extras
llm_responses_api_testing test_basic_openai_responses_api_streaming 2025-07-19 15:30:03 -07:00
llm_translation feat: add Morph provider support (#12821) 2025-07-21 13:52:45 -07:00
load_tests
local_testing test_provider_budgets_e2e_test_expect_to_fail 2025-07-19 16:00:25 -07:00
logging_callback_tests [Prometheus] Move Prometheus to enterprise folder (#12659) 2025-07-18 11:54:47 -07:00
mcp_tests [MCP Gateway] List tools from access list for keys (#12657) 2025-07-16 14:28:53 -07:00
multi_instance_e2e_tests
old_proxy_tests/tests
openai_endpoints_tests Batches - support batch retrieve with target model Query Param + Anthropic - completion bridge, yield content_block_stop chunk (#12228) 2025-07-01 22:13:48 -07:00
otel_tests test_bedrock_guardrail_triggered 2025-07-09 17:05:06 -07:00
pass_through_tests test_anthropic_basic_completion_with_headers ci/cd fix 2025-07-12 11:08:03 -07:00
pass_through_unit_tests test fix - test_anthropic_messages_passthrough.py 2025-06-30 21:56:31 -07:00
proxy_admin_ui_tests Fix e2e test (#12549) 2025-07-12 10:42:57 -07:00
proxy_security_tests
proxy_unit_tests Litellm fix proxy unit testing p2 (#12779) 2025-07-19 16:35:05 -07:00
router_unit_tests [Feat] LLM API Endpoint - Expose OpenAI Compatible /vector_stores/{vector_store_id}/search endpoint (#12749) 2025-07-18 18:18:53 -07:00
scim_tests
spend_tracking_tests
store_model_in_db_tests test_create_mcp_server_invalid_alias 2025-07-16 15:58:34 -07:00
test_litellm fix: make gemini and openai responses return reasoning by default 2025-07-22 10:41:29 -05:00
unified_google_tests [Bug Fix] Using gemini-cli with Vertex Anthropic Models (#12246) 2025-07-03 12:29:27 -07:00
vector_store_tests [Feat] UI Vector Stores - Allow adding Vertex RAG Engine, OpenAI, Azure (#12752) 2025-07-18 18:25:26 -07:00
windows_tests
__init__.py [Feat] Add github co-pilot as a new LLM API provider (#12325) 2025-07-04 13:12:16 -07:00
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_budget_management.py Update enduser spend and budget reset date based on budget duration (#8460) 2025-06-08 08:39:14 -07:00
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py Ollama Chat - parse tool calls on streaming (#11171) 2025-05-27 16:14:49 -07:00
test_health.py
test_keys.py
test_logging.conf
test_models.py Add model access groups on UI (#11719) 2025-06-13 21:20:25 -07:00
test_openai_endpoints.py
test_organizations.py
test_passthrough_endpoints.py
test_ratelimit.py
test_resource_cleanup.py Fix: Properly close aiohttp client sessions to prevent resource leaks (#12251) 2025-07-09 09:25:17 -07:00
test_spend_logs.py
test_team_logging.py
test_team_members.py
test_team.py build: publish new litellm-proxy-extras file 2025-05-27 17:44:23 -07:00
test_users.py test: fix imports 2025-05-26 22:06:53 -07:00

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.