litellm/litellm/proxy/pass_through_endpoints
Krish Dholakia 26fd6d5362
Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619)
* fix(unified_guardrails.py): send all chunks on completion of final stream

* feat(generic_guardrail_api.py): handle tool call response on streaming LLM responses

* fix(anthropic/chat/guardrail_translation): initial commit adding anthropic tool response streaming guardrails

enables guardrail checks on tool response from llm's to work via `/v1/messages`

* feat(anthropic/): working guardrail checks on tool response from LLMs

ensures guardrail checks on anthropic /v1/messages works as expected

* feat(responses/guardrail_translation): support tool call response guardrails on streaming for /v1/responses

ensures complete coverage of tool call responses

* refactor(openai.py): refactor to use consistent pydantic model for responses api tool response on streaming

enables non-openai model tool call response to work correctly with guardrail checks on /v1/responses

* test: update tests

* fix: fix linting error

* fix: fix failing tests

* fix: fix import errors

* fix(openai/chat/guardrail_transformation): fix final chunk returned on streaming
2025-12-15 18:19:52 +05:30
..
llm_provider_handlers Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619) 2025-12-15 18:19:52 +05:30
common_utils.py
jsonpath_extractor.py [Feat] Add guardrails for pass through endpoints (#17221) 2025-11-27 12:06:53 -08:00
llm_passthrough_endpoints.py updated docs links for mistral and anthropic (#17852) 2025-12-11 17:57:56 -08:00
pass_through_endpoints.py fix _update_metadata_with_tags_in_header 2025-12-05 17:20:14 -08:00
passthrough_endpoint_router.py VertexAI Search Vector Store - Passthrough endpoint support + Vector store search Cost tracking support (#15824) 2025-10-25 13:17:15 -07:00
passthrough_guardrails.py [Feat] UI - allow adding pass through guardrails through UI (#17226) 2025-11-27 12:27:16 -08:00
streaming_handler.py Add cost tracking for streaming in vertex ai 2025-11-20 15:08:38 +05:30
success_handler.py Add batch passthrough endpoint cost tracking for anthropic 2025-12-10 18:24:31 +05:30