ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
a65bfab697
litellm/tests
History
Krish Dholakia a65bfab697
Fix calling claude via invoke route + response_format support for claude on invoke route (#8908) 
* fix(anthropic_claude3_transformation.py): fix amazon anthropic claude 3 tool calling transformation on invoke route

move to using anthropic config as base

* fix(utils.py): expose anthropic config via providerconfigmanager

* fix(llm_http_handler.py): support json mode on async completion calls

* fix(invoke_handler/make_call): support json mode for anthropic called via bedrock invoke

* fix(anthropic/): handle 'response_format: {"type": "text"}` + migrate amazon claude 3 invoke config to inherit from anthropic config

Prevents error when passing in 'response_format: {"type": "text"}

* test: fix test

* fix(utils.py): fix base invoke provider check

* fix(anthropic_claude3_transformation.py): don't pass 'stream' param

* fix: fix linting errors

* fix(converse_transformation.py): handle response_format type=text for converse
2025-02-28 17:56:26 -08:00
..
basic_proxy_startup_tests
batches_tests cleanup_azure_files 2025-02-15 15:32:42 -08:00
code_coverage_tests (UI + Proxy) Cache Health Check Page - Cleanup/Improvements (#8665) 2025-02-19 19:08:50 -08:00
documentation_tests Litellm dev 12 28 2024 p1 (#7463) 2024-12-28 20:26:00 -08:00
image_gen_tests (Refactor / QA) - Use LoggingCallbackManager to append callbacks and ensure no duplicate callbacks are added (#8112) 2025-01-30 19:35:50 -08:00
litellm (Improvements) use /openai/ pass through with OpenAI Ruby for Assistants API (#8884) 2025-02-27 20:01:16 -08:00
litellm_utils_tests Litellm dev bedrock anthropic 3 7 v2 (#8843) 2025-02-26 16:05:33 -08:00
llm_translation Fix calling claude via invoke route + response_format support for claude on invoke route (#8908) 2025-02-28 17:56:26 -08:00
load_tests (perf) Fix memory leak on /completions route (#8551) 2025-02-14 18:58:16 -08:00
local_testing vertex ai anthropic thinking param support (#8853) 2025-02-26 21:37:18 -08:00
logging_callback_tests (Bug Fix) - Accurate token counting for /anthropic/ API Routes on LiteLLM Proxy (#8880) 2025-02-27 15:43:03 -08:00
multi_instance_e2e_tests (e2e testing) - add tests for using litellm /team/ updates in multi-instance deployments with Redis (#8440) 2025-02-10 19:33:27 -08:00
old_proxy_tests/tests vertex testing use pathrise-convert-1606954137718 2025-01-05 14:00:17 -08:00
openai_misc_endpoints_tests move test openai error handling tests 2025-02-27 21:20:25 -08:00
otel_tests test_user_email_metrics 2025-02-25 10:47:09 -08:00
pass_through_tests (Improvements) use /openai/ pass through with OpenAI Ruby for Assistants API (#8884) 2025-02-27 20:01:16 -08:00
pass_through_unit_tests (Bug Fix) - Accurate token counting for /anthropic/ API Routes on LiteLLM Proxy (#8880) 2025-02-27 15:43:03 -08:00
proxy_admin_ui_tests Show 'user_email' on key table on UI (#8887) 2025-02-27 21:56:14 -08:00
proxy_security_tests (Security fix) - remove code block that inserts master key hash into DB (#8268) 2025-02-05 17:25:42 -08:00
proxy_unit_tests (security fix) - Enforce model access restrictions on Azure OpenAI route (#8888) 2025-02-27 21:24:58 -08:00
router_unit_tests Litellm dev 02 10 2025 p2 (#8443) 2025-02-10 17:53:46 -08:00
store_model_in_db_tests fix test_moderations_bad_model 2025-02-28 08:51:51 -08:00
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD add bedrock llama vision support + cohere / infinity rerank - 'return_documents' support (#8684) 2025-02-20 21:23:54 -08:00
test_callbacks_on_proxy.py
test_config.py fix testing - langfuse apis are flaky, we unit test team / key based logging in test_langfuse_unit_tests.py 2024-12-03 11:24:36 -08:00
test_debug_warning.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py (Feat) - return x-litellm-attempted-fallbacks in responses from litellm proxy (#8558) 2025-02-15 14:54:23 -08:00
test_health.py
test_keys.py LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 2024-12-01 05:24:11 -08:00
test_logging.conf
test_models.py Improved wildcard route handling on /models and /model_group/info (#8473) 2025-02-11 19:37:43 -08:00
test_openai_endpoints.py (security fix) - Enforce model access restrictions on Azure OpenAI route (#8888) 2025-02-27 21:24:58 -08:00
test_organizations.py Add remaining org CRUD endpoints + support deleting orgs on UI (#8561) 2025-02-15 15:48:06 -08:00
test_passthrough_endpoints.py
test_ratelimit.py (Refactor / QA) - Use LoggingCallbackManager to append callbacks and ensure no duplicate callbacks are added (#8112) 2025-01-30 19:35:50 -08:00
test_spend_logs.py (feat) - track org_id in SpendLogs (#8253) 2025-02-04 21:08:05 -08:00
test_team_logging.py
test_team_members.py test: add more unit testing for team member endpoints (#8170) 2025-02-01 11:23:00 -08:00
test_team.py Litellm dev 02 18 2025 p3 (#8640) 2025-02-18 19:14:20 -08:00
test_users.py Internal User Endpoint - vulnerability fix + response type fix (#8228) 2025-02-04 06:41:14 -08:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.