Shivam Rawat fbff60e9d9 fix(proxy): strip LiteLLM policy tracking from OpenAI batch metadata (#28425) ... * fix(proxy): strip LiteLLM policy tracking from OpenAI batch metadata Batch create was failing with `Invalid type for 'metadata.applied_policies': expected a string, but got an array instead` whenever a policy attachment matched the request. The policy engine helpers wrote `applied_policies`, `applied_guardrails`, and `policy_sources` into `data["metadata"]` unconditionally, and `/v1/batches` forwarded that dict straight to OpenAI, which only accepts string values. - Route proxy-internal tracking into `litellm_metadata` for batch/file routes via a shared `_get_or_create_proxy_metadata_bucket` helper. - Sanitize `data["metadata"]` in `create_batch` to drop known internal keys and non-string values before building the OpenAI request. - Cover both behaviors with unit + endpoint tests. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(proxy): merge metadata buckets for batch policy response headers Ensure get_logging_caching_headers reads both metadata and litellm_metadata so policy/guardrail headers are emitted on batch routes with user metadata, and log dropped non-string OpenAI metadata at debug level. Co-authored-by: Cursor <cursoragent@cursor.com> --------- Co-authored-by: Cursor <cursoragent@cursor.com>		2026-05-26 11:35:42 -07:00
..
_experimental/mcp_server	fix(mcp): forward upstream initialize instructions on cold gateway init (#28231)	2026-05-22 16:00:47 -07:00
agent_endpoints
anthropic_endpoints
auth	fix(team): keep team_alias cache in sync on _cache_team_object writes (#28737)	2026-05-25 19:16:36 -07:00
client
common_utils	fix(proxy): strip LiteLLM policy tracking from OpenAI batch metadata (#28425)	2026-05-26 11:35:42 -07:00
db	feat: add componentized proxy deployment with gateway, backend, ui, and migrations (#27557)	2026-05-16 09:25:17 -07:00
discovery_endpoints
experimental/mcp_server
google_endpoints	Gemini managed agents support (#28270)	2026-05-19 16:02:03 -07:00
guardrails	feat(guardrails): add Microsoft Purview DLP guardrail (#24966)	2026-05-22 15:59:04 -07:00
health_endpoints	fix(proxy): expose db status on public /health/readiness	2026-05-13 13:02:38 -07:00
hooks	fix(rate-limit): stop v3 limiter from leaking internal stash to provider body (#27913)	2026-05-14 10:53:04 -07:00
image_endpoints
management_endpoints	fix(model-edit): allow clearing custom pricing on wildcard models (#28719)	2026-05-26 09:37:23 -07:00
management_helpers	decouple S3 audit-log config via s3_audit_callback_params	2026-05-05 13:23:32 -07:00
memory
middleware	fix(proxy): point /metrics 401 at the opt-out flag	2026-05-08 18:09:14 -07:00
openai_files_endpoint
pass_through_endpoints	fix(proxy): Bedrock Knowledge Base pass-through: preserve SigV4 headers and signed request body (#27526)	2026-05-25 19:21:55 +05:30
policy_engine
prompts
proxy_server	test(proxy): add harness for proxy_server.py behavior-pinning (#28827)	2026-05-25 20:26:44 -07:00
public_endpoints
rag_endpoints	fix: harden /key/update authorization checks (#27878)	2026-05-14 04:16:04 +00:00
realtime_endpoints
response_api_endpoints
spend_tracking	fix(spend-logs): redact echoed prompts in error_information (LIT-2992) (#27689)	2026-05-13 22:11:24 -07:00
test_configs
types_utils	chore(proxy): also scrub guardrail callbacks / module paths from DB overlay	2026-05-14 01:24:51 +00:00
ui_crud_endpoints	chore(ci): merge dev branch (#28657)	2026-05-25 13:48:47 -07:00
vector_store_endpoints
__init__.py
conftest.py
test_aiohttp_cleanup_closed.py
test_aiohttp_session_recovery.py
test_api_key_masking_in_errors.py
test_audio_speech_prometheus_hooks.py
test_batch_expiry.py	fix(proxy): strip LiteLLM policy tracking from OpenAI batch metadata (#28425)	2026-05-26 11:35:42 -07:00
test_batch_metadata_none_fix.py
test_batch_retrieve_bedrock.py
test_budget_reservation.py	fix(proxy): gate image-gen reservation strictly on model mode	2026-05-09 09:16:27 -07:00
test_caching_routes.py
test_chat_completion_metadata.py
test_common_request_processing.py	perf: reduce per-request and per-chunk overhead across Anthropic streaming hot paths (#28289)	2026-05-23 12:15:59 -07:00
test_component_allowlists.py	feat: add componentized proxy deployment with gateway, backend, ui, and migrations (#27557)	2026-05-16 09:25:17 -07:00
test_cors_config.py
test_custom_proxy.py
test_dynamic_mcp_route.py	feat(mcp): support MCP access group names in URL-based namespacing (#27726)	2026-05-13 20:20:38 -07:00
test_empty_model_list.py
test_enforce_user_param.py
test_fallback_management_endpoints.py
test_fastapi_offline_routes.py
test_filter_models_by_team_access_group.py
test_health_check_functions.py	feat(proxy): skip disable_background_health_check models on GET /health when flag set (#27716)	2026-05-13 09:49:05 -07:00
test_health_check_max_tokens.py	Litellm agent oss staging 05 11 2026 (#27733)	2026-05-13 14:09:12 -07:00
test_langfuse_passthrough_security.py
test_lazy_openapi_snapshot.py
test_litellm_pre_call_utils.py	encrypt callback_vars in key/team metadata at rest (#27141)	2026-05-23 12:15:44 -07:00
test_max_budget_env_var.py
test_mcp_asgi_response.py	fix(mcp): surface upstream 401 for token-forwarding MCP servers (#27847)	2026-05-13 12:03:36 -07:00
test_model_dump_with_preserved_fields.py
test_model_id_header_propagation.py
test_model_info_default_limits.py
test_model_level_guardrails.py	fix(proxy): run model-level post_call guardrails on streaming requests (#26922)	2026-05-07 11:53:03 -07:00
test_openapi_schema_validation.py	fix(proxy): preserve HTTP operations when injecting WebSocket stubs into OpenAPI schema	2026-05-06 00:28:42 +02:00
test_pricing_field_strip.py
test_prometheus_cleanup.py
test_provider_url_destination_guard.py
test_proxy_cli.py	Add granian as a ASGI compliant web server. Provider better throughput stability, (#26027)	2026-05-21 19:08:37 -07:00
test_proxy_logging_hook_detection.py	perf: reduce per-request and per-chunk overhead across Anthropic streaming hot paths (#28289)	2026-05-23 12:15:59 -07:00
test_proxy_server.py	chore(admin-ui): regenerate static export with trailingSlash: true (#28112)	2026-05-25 21:06:50 -07:00
test_proxy_types.py
test_proxy_utils.py	feat(otel): OTel-standard attributes on the proxy SERVER span (status code, route/path, preprocessing latency) (#28040)	2026-05-16 13:45:08 -07:00
test_pyroscope.py
test_redis_auth_cache_flag.py
test_response_model_sanitization.py	perf: eliminate per-request callback scanning on proxy hot path (#27858)	2026-05-14 09:28:31 -07:00
test_route_a2a_models.py
test_route_llm_request.py	feat(proxy): fix vector store retrieve/list/update/delete without model (#27929)	2026-05-15 04:37:59 -07:00
test_sensitive_route_auth.py
test_shared_health_check.py	feat(proxy): skip disable_background_health_check models on GET /health when flag set (#27716)	2026-05-13 09:49:05 -07:00
test_spend_log_cleanup.py	fix(proxy): keep spend log cleanup running after batch failures and surface DB errors (#27303)	2026-05-06 18:39:15 +00:00
test_swagger_chat_completions.py
test_team_member_update.py
test_team_org_move.py
test_tools_allowlist_enforcement.py
test_update_llm_router_resilience.py
test_utils.py