ryan-crabbe-berri 9d9558e78f fix(auth): preserve 401 status for expired JWTs in OTel traces (#29510) ... * fix(auth): preserve 401 status for expired JWTs in OTel traces Expired JWT access tokens raised a generic Exception with no status code attached. Because the codeless exception was logged to OTel via post_call_failure_hook before auth_exception_handler re-wrapped it as ProxyException(401), the OTel span never set http.response.status_code and trace viewers displayed it as a generic 500. Clients still got a 401 back, so traces and actual responses diverged. Raise ProxyException(code=401, type=expired_key) directly at the source in both JWT decode paths so the 401 is consistent across the client response and the OTel http.response.status_code attribute, matching how virtual-key expirations are handled. * fix(auth): preserve 401 for expired JWTs on issuer-scoped path The issuer-scoped JWT path (_auth_jwt_with_issuer) still raised a generic Exception on expiry, surfacing as a 500 in client responses and OTel traces. Raise ProxyException with expired_key/401 there too, matching auth_jwt, and add a regression test exercising the issuer path end-to-end		2026-06-02 16:33:16 -07:00
..
_experimental/mcp_server	feat(proxy): add per-MCP-server RPM rate limiting for keys and teams (#29482)	2026-06-02 12:52:10 -07:00
a2a	feat(a2a): well-known agent-card discovery + LangGraph Platform mode (#28860)	2026-05-29 20:50:42 -07:00
agent_endpoints	feat(agents): add LangFlow agent provider with A2A session bridging (#28963)	2026-06-02 14:45:56 -07:00
anthropic_endpoints
auth	fix(auth): preserve 401 status for expired JWTs in OTel traces (#29510)	2026-06-02 16:33:16 -07:00
client
common_utils	fix(reset_budget): write only {spend, budget_reset_at} and stop pre-zeroing counter (#29358)	2026-05-30 17:48:16 -07:00
db	feat: add componentized proxy deployment with gateway, backend, ui, and migrations (#27557)	2026-05-16 09:25:17 -07:00
discovery_endpoints
experimental/mcp_server
google_endpoints	Gemini managed agents support (#28270)	2026-05-19 16:02:03 -07:00
guardrails	Litellm oss staging (#29492)	2026-06-02 08:48:10 -07:00
health_endpoints	feat(proxy): native /health/drain preStop hook for graceful shutdown (#29439)	2026-06-02 16:30:44 -07:00
hooks	feat(proxy): add per-MCP-server RPM rate limiting for keys and teams (#29482)	2026-06-02 12:52:10 -07:00
image_endpoints
management_endpoints	feat(proxy): add per-MCP-server RPM rate limiting for keys and teams (#29482)	2026-06-02 12:52:10 -07:00
management_helpers	feat(mcp/auth): additive key access-group grants + opt-in member assignment (#29313)	2026-05-30 17:35:31 -07:00
memory
middleware	fix(proxy): point /metrics 401 at the opt-out flag	2026-05-08 18:09:14 -07:00
openai_files_endpoint
pass_through_endpoints	fix(passthrough): emit otel guardrail span when a guardrail blocks (#29470)	2026-06-02 11:46:25 -07:00
policy_engine	fix(guardrails): return HTTP 400 for litellm content filter blocks (#28418)	2026-05-30 14:28:46 -07:00
prompts
proxy_server	tests(proxy_server): surface current behavior in tests (#29309)	2026-05-29 23:17:24 -07:00
public_endpoints	feat(a2a): well-known agent-card discovery + LangGraph Platform mode (#28860)	2026-05-29 20:50:42 -07:00
rag_endpoints	fix: harden /key/update authorization checks (#27878)	2026-05-14 04:16:04 +00:00
realtime_endpoints
response_api_endpoints
shutdown	feat(proxy): native /health/drain preStop hook for graceful shutdown (#29439)	2026-06-02 16:30:44 -07:00
spend_tracking	fix(proxy): strip NUL bytes from spend log payloads to prevent PostgreSQL 22P05 (#29515)	2026-06-02 12:07:11 -07:00
test_configs
types_utils	chore(proxy): also scrub guardrail callbacks / module paths from DB overlay	2026-05-14 01:24:51 +00:00
ui_crud_endpoints	chore(ci): merge dev branch (#28657)	2026-05-25 13:48:47 -07:00
vector_store_endpoints	fix(proxy): restrict vector store index create/delete to proxy admins (#29202)	2026-05-30 15:10:21 -07:00
__init__.py
conftest.py	feat(proxy): native /health/drain preStop hook for graceful shutdown (#29439)	2026-06-02 16:30:44 -07:00
test_aiohttp_cleanup_closed.py
test_aiohttp_session_recovery.py
test_api_key_masking_in_errors.py
test_audio_speech_prometheus_hooks.py
test_batch_expiry.py	fix(proxy): strip LiteLLM policy tracking from OpenAI batch metadata (#28425)	2026-05-26 11:35:42 -07:00
test_batch_metadata_none_fix.py
test_batch_retrieve_bedrock.py
test_budget_reservation.py	fix(proxy): gate image-gen reservation strictly on model mode	2026-05-09 09:16:27 -07:00
test_caching_routes.py
test_chat_completion_metadata.py
test_common_request_processing.py	perf: reduce per-request and per-chunk overhead across Anthropic streaming hot paths (#28289)	2026-05-23 12:15:59 -07:00
test_component_allowlists.py	feat: add componentized proxy deployment with gateway, backend, ui, and migrations (#27557)	2026-05-16 09:25:17 -07:00
test_cors_config.py
test_custom_proxy.py
test_dynamic_mcp_route.py	feat(mcp): support MCP access group names in URL-based namespacing (#27726)	2026-05-13 20:20:38 -07:00
test_empty_model_list.py
test_enforce_user_param.py
test_fallback_management_endpoints.py
test_fastapi_offline_routes.py
test_filter_models_by_team_access_group.py
test_health_check_functions.py	feat(proxy): skip disable_background_health_check models on GET /health when flag set (#27716)	2026-05-13 09:49:05 -07:00
test_health_check_max_tokens.py	Litellm agent oss staging 05 11 2026 (#27733)	2026-05-13 14:09:12 -07:00
test_langfuse_passthrough_security.py
test_lazy_openapi_snapshot.py
test_litellm_pre_call_utils.py	fix(proxy): enforce tag budgets for key-level tags (#29108)	2026-05-28 11:39:02 -07:00
test_max_budget_env_var.py
test_mcp_asgi_response.py	fix(mcp): surface upstream 401 for token-forwarding MCP servers (#27847)	2026-05-13 12:03:36 -07:00
test_model_dump_with_preserved_fields.py
test_model_id_header_propagation.py
test_model_info_default_limits.py
test_model_level_guardrails.py	fix(proxy): run model-level post_call guardrails on streaming requests (#26922)	2026-05-07 11:53:03 -07:00
test_openapi_schema_validation.py	fix(proxy): preserve HTTP operations when injecting WebSocket stubs into OpenAPI schema	2026-05-06 00:28:42 +02:00
test_pricing_field_strip.py	fix(proxy): move pricing strip below the litellm_metadata JSON-string parse	2026-05-03 02:04:05 +00:00
test_prometheus_cleanup.py
test_provider_url_destination_guard.py
test_proxy_cli.py	Add granian as a ASGI compliant web server. Provider better throughput stability, (#26027)	2026-05-21 19:08:37 -07:00
test_proxy_logging_hook_detection.py	perf: reduce per-request and per-chunk overhead across Anthropic streaming hot paths (#28289)	2026-05-23 12:15:59 -07:00
test_proxy_server.py	fix(proxy): omit OpenAI [DONE] on google-genai streamGenerateContent (#29426)	2026-06-01 14:38:19 -07:00
test_proxy_types.py	refactor(proxy/auth): normalize Bearer prefix in safe-hash helper (#29343)	2026-05-30 14:04:22 -07:00
test_proxy_utils.py	feat(otel): typed semconv-aligned OpenTelemetry instrumentation (#28909)	2026-05-29 23:15:27 -07:00
test_pyroscope.py	Implement normalize_nonempty_secret_str function to trim whitespace from secrets and treat empty values as unset. Update proxy_server to use this function for Grafana credentials. Enhance tests to validate the new normalization behavior.	2026-05-04 18:17:31 +00:00
test_redis_auth_cache_flag.py
test_response_model_sanitization.py	perf: eliminate per-request callback scanning on proxy hot path (#27858)	2026-05-14 09:28:31 -07:00
test_route_a2a_models.py
test_route_llm_request.py	feat(proxy): fix vector store retrieve/list/update/delete without model (#27929)	2026-05-15 04:37:59 -07:00
test_sensitive_route_auth.py
test_shared_health_check.py	feat(proxy): skip disable_background_health_check models on GET /health when flag set (#27716)	2026-05-13 09:49:05 -07:00
test_spend_log_cleanup.py	fix(proxy): keep spend log cleanup running after batch failures and surface DB errors (#27303)	2026-05-06 18:39:15 +00:00
test_swagger_chat_completions.py
test_team_member_update.py
test_team_org_move.py
test_tools_allowlist_enforcement.py
test_update_llm_router_resilience.py
test_utils.py