litellm/tests/test_litellm/proxy
Krish Dholakia 26fd6d5362
Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619)
* fix(unified_guardrails.py): send all chunks on completion of final stream

* feat(generic_guardrail_api.py): handle tool call response on streaming LLM responses

* fix(anthropic/chat/guardrail_translation): initial commit adding anthropic tool response streaming guardrails

enables guardrail checks on tool response from llm's to work via `/v1/messages`

* feat(anthropic/): working guardrail checks on tool response from LLMs

ensures guardrail checks on anthropic /v1/messages works as expected

* feat(responses/guardrail_translation): support tool call response guardrails on streaming for /v1/responses

ensures complete coverage of tool call responses

* refactor(openai.py): refactor to use consistent pydantic model for responses api tool response on streaming

enables non-openai model tool call response to work correctly with guardrail checks on /v1/responses

* test: update tests

* fix: fix linting error

* fix: fix failing tests

* fix: fix import errors

* fix(openai/chat/guardrail_transformation): fix final chunk returned on streaming
2025-12-15 18:19:52 +05:30
..
_experimental/mcp_server fix: add MCP auth header propagation 2025-12-15 07:45:35 +09:00
agent_endpoints Merge pull request #17781 from BerriAI/litellm_daily_agent_table 2025-12-11 15:01:50 -08:00
anthropic_endpoints
auth [Feat] JWT Auth - auth allow selecting team_id from request header (#17884) 2025-12-12 10:18:20 -08:00
client add a new feature fix to expose the team alias when authenticating th… (#17725) 2025-12-10 10:10:28 -08:00
common_utils
db Merge pull request #16764 from BerriAI/litellm_tag_spend_dedupe 2025-12-11 15:20:16 -08:00
discovery_endpoints
experimental/mcp_server
google_endpoints fix: Preserve systemInstructions for vertex ai generate content request 2025-12-11 09:52:32 +05:30
guardrails Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619) 2025-12-15 18:19:52 +05:30
health_endpoints fix: remove dependency on database and redis from health test (#17880) 2025-12-12 08:21:48 -08:00
hooks [Fix] CI/CD – Clean Up Performance PR Changes & others (#17838) 2025-12-11 12:50:03 -08:00
image_endpoints
management_endpoints async def test_update_team_guardrails_with_org_id(): 2025-12-13 16:24:58 -08:00
management_helpers
middleware
openai_files_endpoint Merge pull request #17758 from BerriAI/litellm_managed_files_target_storage 2025-12-12 22:26:34 +05:30
pass_through_endpoints Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619) 2025-12-15 18:19:52 +05:30
prompts
public_endpoints
response_api_endpoints Fix x-litellm-key-spend update 2025-12-12 11:44:51 +05:30
spend_tracking [Fix] CI/CD – Clean Up Performance PR Changes & others (#17838) 2025-12-11 12:50:03 -08:00
test_configs
ui_crud_endpoints Merge pull request #17668 from BerriAI/litellm_sso_config_2 2025-12-11 15:17:33 -08:00
vector_store_endpoints
__init__.py
conftest.py Add health endpoint tests to CI with database and Redis support (#17877) 2025-12-12 07:35:50 -08:00
test_batch_metadata_none_fix.py
test_caching_routes.py
test_common_request_processing.py Fix x-litellm-key-spend update 2025-12-12 11:44:51 +05:30
test_custom_proxy.py
test_enforce_user_param.py
test_fastapi_offline_routes.py
test_health_check_functions.py
test_litellm_pre_call_utils.py
test_model_id_header_propagation.py
test_proxy_cli.py
test_proxy_server.py fix: MCP OAuth callback routing and URL handling (#17789) 2025-12-11 08:22:59 -08:00
test_proxy_types.py
test_proxy_utils.py
test_route_llm_request.py
test_shared_health_check.py
test_spend_log_cleanup.py
test_swagger_chat_completions.py
test_team_member_update.py