litellm/tests/router_unit_tests
Krish Dholakia 80f7af510b
Improve Proxy Resiliency: Cooldown single-deployment model groups if 100% calls failed in high traffic (#7823)
* refactor(_is_cooldown_required): move '_is_cooldown_required' into cooldown_handlers.py

* refactor(cooldown_handlers.py): move cooldown constants into `.constants.py`

* fix(cooldown_handlers.py): remove if single deployment don't cooldown logic

move to traffic based cooldown logic

Addresses https://github.com/BerriAI/litellm/issues/7822

* fix: add unit tests for '_should_cooldown_deployment'

* test: ensure all tests pass

* test: update test

* fix(cooldown_handlers.py): don't cooldown single deployment models for anything besides traffic related errors

* fix(cooldown_handlers.py): fix cooldown handler logic

* fix(cooldown_handlers.py): fix check
2025-01-17 20:17:02 -08:00
..
create_mock_standard_logging_payload.py (refactor) - migrate router.deployment_callback_on_success to use StandardLoggingPayload (#7015) 2024-12-03 20:29:25 -08:00
gettysburg.wav
README.md
test_router_batch_utils.py Litellm router code coverage 3 (#6274) 2024-10-16 21:30:25 -07:00
test_router_cooldown_utils.py Improve Proxy Resiliency: Cooldown single-deployment model groups if 100% calls failed in high traffic (#7823) 2025-01-17 20:17:02 -08:00
test_router_endpoints.py (fix) litellm.amoderation - support using model=openai/omni-moderation-latest, model=omni-moderation-latest, model=None (#7475) 2024-12-30 09:42:51 -08:00
test_router_handle_error.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
test_router_helper_utils.py (litellm sdk speedup router) - adds a helper _cached_get_model_group_info to use when trying to get deployment tpm/rpm limits (#7719) 2025-01-12 15:14:54 -08:00
test_router_prompt_caching.py Litellm dev 12 07 2024 (#7086) 2024-12-08 00:30:33 -08:00

Router component unit tests.

Please name all files with the word 'router' in them.

This is used to ensure all functions in the router are tested.