fba736ca3c
- Use 'auto_router/adaptive_router' prefix in example yaml, docs, and README — the old 'adaptive_router/...' and 'openai/gpt-4o-mini' values silently skipped adaptive-router init because detection requires the 'auto_router/adaptive_router' prefix. - Read x-litellm-min-quality-tier from request headers (and the 'min_quality_tier' metadata key as fallback) in async_pre_routing_hook. Previously the documented header was defined but never extracted, so the quality-floor feature was inert. - Evict expired entries from _session_states. The cache grew without bound — added a parallel expiry map (same TTL as _owner_cache) and an opportunistic bulk sweep when the cache crosses a size threshold. - Align adaptive-router migration SQL with Prisma schema: all count columns and the 'clean_credit_awarded' / 'last_processed_turn' fields are NOT NULL in the data model, so the migration now declares them NOT NULL. Fixes test_aaaasschema_migration_check. Tests: 8 new covering header/metadata/precedence/invalid-value paths for min_quality_tier and TTL-based eviction of _session_states. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| _health_check_test_config.yaml | ||
| adaptive_router_example.yaml | ||
| aliases_config.yaml | ||
| azure_config.yaml | ||
| bad_schema.prisma | ||
| custom_auth_basic.py | ||
| custom_auth.py | ||
| custom_callbacks1.py | ||
| custom_callbacks.py | ||
| custom_guardrail.py | ||
| custom_handler.py | ||
| disable_schema_update.yaml | ||
| enterprise_config.yaml | ||
| langfuse_config.yaml | ||
| load_balancer.yaml | ||
| multi_instance_simple_config.yaml | ||
| oai_misc_config.yaml | ||
| opentelemetry_config.yaml | ||
| otel_test_config.yaml | ||
| pass_through_config.yaml | ||
| pipeline_test_guardrails.py | ||
| reject_clientside_metadata_tags_config.yaml | ||
| simple_config.yaml | ||
| spend_tracking_config.yaml | ||
| store_model_db_config.yaml | ||
| test_pipeline_config.yaml | ||
| tool_permission_example.yaml | ||
| websearch_interception_config.yaml | ||