ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7e9dbcd1a3
litellm/litellm/router_utils
History
Ishaan Jaff c8eff2dc65
[Feat-Prometheus] Track exception status on litellm_deployment_failure_responses (#5706) 
* add litellm_deployment_cooled_down

* track num cooldowns on prometheus

* track exception status

* fix linting

* docs prom metrics

* cleanup premium user checks

* prom track deployment failure state

* docs prometheus
2024-09-14 18:44:31 -07:00
..
router_callbacks [Fix] Router cooldown logic - use % thresholds instead of allowed fails to cooldown deployments (#5698) 2024-09-14 18:01:19 -07:00
batch_utils.py feat(router.py): Support Loadbalancing batch azure api endpoints (#5469) 2024-09-02 21:32:55 -07:00
client_initalization_utils.py fix import error 2024-09-05 10:09:44 -07:00
cooldown_cache.py [Fix] Router cooldown logic - use % thresholds instead of allowed fails to cooldown deployments (#5698) 2024-09-14 18:01:19 -07:00
cooldown_callbacks.py [Feat-Prometheus] Track exception status on litellm_deployment_failure_responses (#5706) 2024-09-14 18:44:31 -07:00
cooldown_handlers.py [Feat-Prometheus] Track exception status on litellm_deployment_failure_responses (#5706) 2024-09-14 18:44:31 -07:00
fallback_event_handlers.py fix run sync fallbacks 2024-08-20 12:55:36 -07:00
handle_error.py