ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
fabbd28b45
litellm/litellm/integrations
History
Krish Dholakia 26fd6d5362
Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619) 
* fix(unified_guardrails.py): send all chunks on completion of final stream

* feat(generic_guardrail_api.py): handle tool call response on streaming LLM responses

* fix(anthropic/chat/guardrail_translation): initial commit adding anthropic tool response streaming guardrails

enables guardrail checks on tool response from llm's to work via `/v1/messages`

* feat(anthropic/): working guardrail checks on tool response from LLMs

ensures guardrail checks on anthropic /v1/messages works as expected

* feat(responses/guardrail_translation): support tool call response guardrails on streaming for /v1/responses

ensures complete coverage of tool call responses

* refactor(openai.py): refactor to use consistent pydantic model for responses api tool response on streaming

enables non-openai model tool call response to work correctly with guardrail checks on /v1/responses

* test: update tests

* fix: fix linting error

* fix: fix failing tests

* fix: fix import errors

* fix(openai/chat/guardrail_transformation): fix final chunk returned on streaming
2025-12-15 18:19:52 +05:30
..
_types Support responses API streaming in langfuse otel (#16153) 2025-11-02 09:36:34 -08:00
agentops
arize [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
azure_storage fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
bitbucket [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
cloudzero [Bug] Updated spend would not be sent to CloudZero (#16201) 2025-11-10 19:43:15 -08:00
datadog Fix: Datadog callback regression when ddtrace is installed (#17393) 2025-12-02 17:27:50 -08:00
deepeval fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
dotprompt [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
email_templates [Feat] Email Notifications - Ensure Users get Key Rotated Email (#16292) 2025-11-05 15:56:49 -08:00
gcs_bucket fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
gcs_pubsub
generic_api Native Webhook Integration Sumologic (#17630) 2025-12-07 23:23:39 -08:00
generic_prompt_management Prompt Management - new API for integrating providers (#17829) 2025-12-11 15:43:40 -08:00
gitlab [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
langfuse [Fix] CI/CD - Fix failing proxy unit test and langfuse trace_id test (#17924) 2025-12-13 09:32:43 -08:00
opentelemetry_utils [Feat] s3 logger, add support for ssl_verify when using minio logger (#16211) 2025-11-03 13:56:00 -08:00
opik fix Tuple 2025-11-06 16:19:10 -08:00
prometheus_helpers
SlackAlerting Fix/organization max budget not enforced (#17334) 2025-12-02 22:46:03 -08:00
vector_store_integrations [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
weave feat: Basic Weave OTEL integration (#17439) 2025-12-03 21:26:22 -08:00
__init__.py
additional_logging_utils.py
anthropic_cache_control_hook.py [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
argilla.py
athina.py
braintrust_logging.py Add details in docs (#15721) 2025-10-21 16:57:51 -07:00
callback_configs.json Working setting generic callbacks on UI 2025-12-05 14:37:48 -08:00
custom_batch_logger.py
custom_guardrail.py Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619) 2025-12-15 18:19:52 +05:30
custom_logger.py Prompt Management - new API for integrating providers (#17829) 2025-12-11 15:43:40 -08:00
custom_prompt_management.py [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
custom_secret_manager.py [Feat] Add Custom Secret Manager - Allow users to define and write a custom secret manager (#16297) 2025-11-05 17:20:26 -08:00
custom_sso_handler.py
dynamodb.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
email_alerting.py
galileo.py
greenscale.py
helicone.py (Bug) Fix JSON serialization error in Helicone logging by removing OpenTelemetry span from metadata (#15728) 2025-10-20 08:53:22 -07:00
humanloop.py [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
lago.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
langsmith.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
langtrace.py
literal_ai.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
logfire_logger.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
lunary.py
mlflow.py Fix: MLflow streaming spans for Anthropic passthrough (#17288) 2025-12-05 14:59:36 -08:00
openmeter.py
opentelemetry.py [Fix] CI/CD - Fix failing proxy and core integration tests (#17926) 2025-12-13 10:11:01 -08:00
posthog.py fix: Add atexit handlers to flush callbacks for async completions (#16487) 2025-11-11 19:12:53 -08:00
prometheus_services.py
prometheus.py refactor: litellm init file #1 2025-11-24 16:59:56 -08:00
prompt_layer.py
prompt_management_base.py Prompt Management - new API for integrating providers (#17829) 2025-12-11 15:43:40 -08:00
Readme.md
s3_v2.py Add allowing Key based prefix to s3 path (#16237) 2025-11-05 14:43:21 -08:00
s3.py Add allowing Key based prefix to s3 path (#16237) 2025-11-05 14:43:21 -08:00
sqs.py Add Langfuse OTEL and SQS to health check (#16514) 2025-11-12 18:25:30 -08:00
supabase.py
test_httpx.py
traceloop.py
weights_biases.py

Readme.md

Integrations

This folder contains logging integrations for litellm

eg. logging to Datadog, Langfuse, Prometheus, s3, GCS Bucket, etc.