ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
80acf6bc97
litellm/tests
History
Ryan Castner ac11bfabcb
Responses API - Add reasoning content support for non-OpenAI providers (#12055) 
Add reasoning content support when Responses API falls
back to completions API, enabling reasoning content for
all LLM providers (Anthropic, Vertex AI, etc.) since
OpenAI is currently the only native Responses API
provider.

* Add ReasoningSummaryTextDeltaEvent for streaming
  reasoning deltas
* Update streaming iterator to detect and transform
  reasoning content
* Extract reasoning content as separate output items in
  transformations
* Support reasoning content alongside regular message
  content

Closes https://github.com/BerriAI/litellm/issues/11302
2025-06-26 14:21:49 -07:00
..
basic_proxy_startup_tests
batches_tests Store batch output file id in DB + Store batch file status in DB + (experimental) BATCH API COST TRACKING 2025-06-25 22:41:22 -07:00
code_coverage_tests docs(litellm_logging_code_coverage.py): fix check 2025-06-18 21:36:03 -07:00
documentation_tests
enterprise Store batch output file id in DB + Store batch file status in DB + (experimental) BATCH API COST TRACKING 2025-06-25 22:41:22 -07:00
guardrails_tests [Bug Fix] Bedrock Guardrail - Don't raise exception on intervene action (#11875) 2025-06-23 19:59:44 -07:00
image_gen_tests [Fix]: Add cost tracking for image edits endpoint [OpenAI, Azure] (#11186) 2025-05-27 17:52:15 -07:00
litellm_utils_tests Update enduser spend and budget reset date based on budget duration (#8460) 2025-06-08 08:39:14 -07:00
litellm-proxy-extras
llm_responses_api_testing [Feat] Add Azure Codex Models on LiteLLM + new /v1 preview Azure OpenAI API (#11934) 2025-06-20 18:08:44 -07:00
llm_translation Anthropic /v1/messages - Custom LLM Server support (#12016) 2025-06-24 22:00:44 -07:00
load_tests test: test_embedding_performance 2025-05-14 21:31:07 -07:00
local_testing Minor Fixes (#11868) 2025-06-18 14:12:59 -07:00
logging_callback_tests [Feat] Add OpenAI Search Vector Store Operation (#12018) 2025-06-24 15:52:43 -07:00
mcp_tests [Feat] MCP - Allow connecting to MCP with authentication headers + Allow clients to specify MCP headers (#11890) (#11891) 2025-06-19 20:07:08 -07:00
multi_instance_e2e_tests
old_proxy_tests/tests
openai_endpoints_tests set flaky tests as flaky 2025-06-14 13:51:52 -07:00
otel_tests set flaky tests as flaky 2025-06-14 13:51:52 -07:00
pass_through_tests test_anthropic_basic_completion_with_headers 2025-06-14 13:56:06 -07:00
pass_through_unit_tests [Bug Fix] Cost tracking and logging via the /v1/messages API are not working when using Claude Code (#11928) 2025-06-20 18:08:35 -07:00
proxy_admin_ui_tests test(test_sso_sign_in.py): update test 2025-06-03 21:46:34 -07:00
proxy_security_tests
proxy_unit_tests Squashed commit of the following: 2025-06-20 23:11:53 -07:00
router_unit_tests [Fix] Router - cooldown time, allow using dynamic cooldown time for a specific deployment (#12037) 2025-06-25 08:46:27 -07:00
scim_tests
spend_tracking_tests
store_model_in_db_tests fix test MCP 2025-06-20 12:09:45 -07:00
test_litellm Responses API - Add reasoning content support for non-OpenAI providers (#12055) 2025-06-26 14:21:49 -07:00
unified_google_tests [Feat] gemini-cli integration - Add Logging + Cost tracking for stream + non-stream Vertex / Google AI Studio routes (#12058) 2025-06-25 22:26:20 -07:00
vector_store_tests [Feat] OpenAI/Azure OpenAI - Add support for creating vector stores on LiteLLM (#12021) 2025-06-24 20:46:48 -07:00
windows_tests [Bug Fix] UnicodeDecodeError: 'charmap' on Windows during litellm import (#10542) 2025-05-03 21:31:05 -07:00
__init__.py Litellm fix GitHub action testing (#11163) 2025-05-26 14:41:42 -07:00
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_budget_management.py Update enduser spend and budget reset date based on budget duration (#8460) 2025-06-08 08:39:14 -07:00
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py Ollama Chat - parse tool calls on streaming (#11171) 2025-05-27 16:14:49 -07:00
test_health.py
test_keys.py test: temporarily skip test due to change testing model change - need to update test for new model 2025-05-09 09:02:08 -07:00
test_logging.conf
test_models.py Add model access groups on UI (#11719) 2025-06-13 21:20:25 -07:00
test_openai_endpoints.py
test_organizations.py
test_passthrough_endpoints.py
test_ratelimit.py
test_spend_logs.py
test_team_logging.py
test_team_members.py
test_team.py build: publish new litellm-proxy-extras file 2025-05-27 17:44:23 -07:00
test_users.py test: fix imports 2025-05-26 22:06:53 -07:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.