ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
138b415e81
litellm/tests
History
Cesar Garcia 138b415e81
fix(responses-api): use list format with input_text for tool results (#18257) 
The Responses API expects tool results to use input_text/input_image types,
not output_text. This fix ensures consistent list format for all tool results:
- String content → [{"type": "input_text", "text": "..."}]
- Image content → [{"type": "input_image", "image_url": "..."}]

This resolves the conflict between tests that expected different formats
and aligns with OpenAI's Responses API requirements.

Fixes the regression introduced in #18226.
2025-12-20 13:46:14 +05:30
..
agent_tests [Fix] Security - Remove example API keys with high entropy (#18255) 2025-12-19 10:09:50 -08:00
audio_tests test_runwayml_tts_async 2025-12-13 16:10:48 -08:00
basic_proxy_startup_tests Fix: remove merge markdown (#17586) 2025-12-06 05:38:16 -08:00
batches_tests Add output file id in managed objects for batches 2025-12-16 15:52:07 +05:30
code_coverage_tests code qa check 2025-12-19 19:00:44 +05:30
documentation_tests
enterprise added extraction of top level metadata for custom lables in prometheus callbacks (#18087) 2025-12-17 11:17:12 +05:30
guardrails_tests [Feat] Guardrails Load Balancing - Allow Platform admins to load balance between guardrails (#18181) 2025-12-19 00:08:03 +05:30
image_gen_tests fix lint error 2025-12-19 23:45:37 +05:30
litellm Merge branch 'main' into litellm_staging_12_16_2025 2025-12-16 21:38:14 +05:30
litellm_utils_tests [Fix] Security - Remove example API keys with high entropy (#18255) 2025-12-19 10:09:50 -08:00
litellm-proxy-extras Fix: Distinguish permission errors from idempotent errors in Prisma migrations (#17064) 2025-11-24 20:41:44 -08:00
llm_responses_api_testing Revert "[Fix] CI/CD - local_testing & mapped tests (#18222)" (#18223) 2025-12-18 14:46:09 -08:00
llm_translation [Fix] Security - Remove example API keys with high entropy (#18255) 2025-12-19 10:09:50 -08:00
load_tests
local_testing [Fix] Security - Remove example API keys with high entropy (#18255) 2025-12-19 10:09:50 -08:00
logging_callback_tests [Fix] Security - Remove example API keys with high entropy (#18255) 2025-12-19 10:09:50 -08:00
mcp_tests feat: add support for using MCPs on /chat/completions 2025-12-10 10:55:33 +09:00
multi_instance_e2e_tests
ocr_tests vertex ai deepseek doesn't support pdf urls, so skip them 2025-12-19 23:53:17 +05:30
old_proxy_tests/tests [Fix] Security - Remove example API keys with high entropy (#18255) 2025-12-19 10:09:50 -08:00
openai_endpoints_tests test_e2e_batches_files 2025-11-27 09:14:43 -08:00
otel_tests [Fix] Security - Remove example API keys with high entropy (#18255) 2025-12-19 10:09:50 -08:00
pass_through_tests
pass_through_unit_tests [Fix] Security - Remove example API keys with high entropy (#18255) 2025-12-19 10:09:50 -08:00
proxy_admin_ui_tests Merge remote-tracking branch 'origin' into litellm_new_user_collision_handling 2025-12-06 19:58:35 -08:00
proxy_security_tests
proxy_unit_tests Merge pull request #18236 from BerriAI/litellm_add_background_responses_cost_tracking 2025-12-20 00:14:09 +05:30
router_unit_tests fix(router): add minimum request threshold for error rate cooldown (#17464) 2025-12-12 04:36:10 -08:00
scim_tests
search_tests [Feat] New Search API Provider - LinkUp Search (#18174) 2025-12-18 14:27:36 +05:30
spend_tracking_tests
store_model_in_db_tests test_edit_mcp_server_redacts_credentials 2025-11-26 11:54:11 -08:00
test_litellm fix(responses-api): use list format with input_text for tool results (#18257) 2025-12-20 13:46:14 +05:30
unified_google_tests
vector_store_tests [Feat] Add new Rag Search API / Query API with rerankers (#18217) 2025-12-19 19:05:07 +05:30
windows_tests
__init__.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_budget_management.py
test_callbacks_on_proxy.py [Fix] Security - Remove example API keys with high entropy (#18255) 2025-12-19 10:09:50 -08:00
test_config.py
test_debug_warning.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py
test_gpt5_azure_temperature_support.py
test_health.py
test_keys.py
test_litellm_proxy_responses_config.py
test_logging.conf
test_models.py
test_openai_endpoints.py
test_organizations.py
test_passthrough_endpoints.py
test_ratelimit.py
test_resource_cleanup.py
test_spend_logs.py [Fix] Security - Remove example API keys with high entropy (#18255) 2025-12-19 10:09:50 -08:00
test_team_logging.py
test_team_members.py
test_team.py [Fix] CI/CD - Add missing documentation for ENVs & Clean Functionality (#18211) 2025-12-18 13:16:15 -08:00
test_users.py

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.