litellm/tests
Krish Dholakia 010a4d44af
Fix passing standard optional params (#11124)
* fix(main.py): use processed non-default-params as standard input params for langfuse

Fixes https://github.com/BerriAI/litellm/issues/11072

 Fixes https://github.com/BerriAI/litellm/issues/11096

* fix(main.py): rename variable to be more accurate

* test(test_langfuse_e2e_test.py): add router unit test for langfuse e2e testing

Prevent https://github.com/BerriAI/litellm/issues/11072 from happening again

* build: update lock

* fix(utils.py): refactor optional params function

make it easier to get the standardized non default params

* fix(utils.py): improve process non default params function

* fix(main.py): include provider specific params in processed non default params used in logging

ensures user can see any provider specific params on langfuse

 ensures user can see any provider specific params on langfus e
2025-05-24 12:12:31 -07:00
..
basic_proxy_startup_tests
batches_tests Litellm managed file updates combined (#11040) 2025-05-22 17:20:41 -07:00
code_coverage_tests Remove + Check for unsafe enterprise/ folder imports (#11107) 2025-05-24 08:59:02 -07:00
documentation_tests
enterprise Expose /list and /info endpoints for Audit Log events (#11102) 2025-05-23 22:54:59 -07:00
guardrails_tests [Fix] List Guardrails - Show config.yaml guardrails on litellm ui (#10959) 2025-05-19 21:25:23 -07:00
image_gen_tests [Feat] Add /image/edits on LiteLLM (#11123) 2025-05-24 10:18:01 -07:00
litellm Fix passing standard optional params (#11124) 2025-05-24 12:12:31 -07:00
litellm_utils_tests [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
litellm-proxy-extras Prisma Migrate - support setting custom migration dir (#10336) 2025-04-26 12:05:06 -07:00
llm_responses_api_testing [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
llm_translation Fix passing standard optional params (#11124) 2025-05-24 12:12:31 -07:00
load_tests test: test_embedding_performance 2025-05-14 21:31:07 -07:00
local_testing Fix passing standard optional params (#11124) 2025-05-24 12:12:31 -07:00
logging_callback_tests Fix passing standard optional params (#11124) 2025-05-24 12:12:31 -07:00
mcp_tests test fixes 2025-03-29 18:34:58 -07:00
multi_instance_e2e_tests
old_proxy_tests/tests test: update tests to new deployment model (#10142) 2025-04-18 14:22:12 -07:00
openai_endpoints_tests # expect an error when getting the response again since 2025-04-25 09:42:35 -07:00
otel_tests [Feat] Prometheus - Track route on proxy_* metrics (#10992) 2025-05-20 22:55:55 -07:00
pass_through_tests test: add more debug logs 2025-04-29 15:40:18 -07:00
pass_through_unit_tests [Feat] - Add Support for Showing Passthrough endpoint Error Logs on LiteLLM UI (#10990) 2025-05-20 18:29:39 -07:00
proxy_admin_ui_tests [Feat] Add /image/edits on LiteLLM (#11123) 2025-05-24 10:18:01 -07:00
proxy_security_tests
proxy_unit_tests [Feat] Add /image/edits on LiteLLM (#11123) 2025-05-24 10:18:01 -07:00
router_unit_tests complete unified batch id support - replace model in jsonl to be deployment model name (#10719) 2025-05-10 12:04:01 -07:00
scim_tests [Feat SSO] Add LiteLLM SCIM Integration for Team and User management (#10072) 2025-04-16 19:21:47 -07:00
spend_tracking_tests test_long_term_spend_accuracy_with_bursts 2025-03-31 21:09:29 -07:00
store_model_in_db_tests fix(router.py): handle edge case where user sets 'model_group' inside… (#10191) 2025-04-21 16:17:45 -07:00
windows_tests [Bug Fix] UnicodeDecodeError: 'charmap' on Windows during litellm import (#10542) 2025-05-03 21:31:05 -07:00
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_end_users.py test: run test earlier to catch error 2025-03-27 23:08:52 -07:00
test_entrypoint.py
test_fallbacks.py
test_health.py
test_keys.py test: temporarily skip test due to change testing model change - need to update test for new model 2025-05-09 09:02:08 -07:00
test_logging.conf
test_models.py Litellm UI improvements 04 26 2025 p1 (#10346) 2025-04-26 18:24:49 -07:00
test_openai_endpoints.py
test_organizations.py UI - fix adding vertex models with reusable credentials + fix pagination on keys table + fix showing org budgets on table (#10528) 2025-05-03 08:16:53 -07:00
test_passthrough_endpoints.py
test_ratelimit.py
test_spend_logs.py
test_team_logging.py
test_team_members.py
test_team.py fix: test_team_update_sc_2 2025-05-09 11:59:13 -07:00
test_users.py

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.