* fix: test case 1, model hits saturation * fix: _check_rate_limits test case 2 * fix: _get_priority_allocation * test_default_priority_shared_pool * fix: No Rate Limiting when low saturatation * fix: correctly use model_saturation_check * fixes priority_descriptors * fix: tune default PriorityReservationSettings |
||
|---|---|---|
| .. | ||
| test_dynamic_rate_limiter_v3.py | ||
| test_parallel_request_limiter_v3.py | ||
| test_proxy_track_cost_callback.py | ||