litellm/tests/logging_callback_tests
Krish Dholakia 1cb5fcddba
make generic api OSS + support multiple generic API's (#17152)
* feat(generic_api_callback.py): make generic api OSS + support multiple generic API's

Enables https://github.com/BerriAI/litellm/pull/17094#discussion_r2562832967

* feat(callback_utils.py): support custom generic api callbacks

* feat(generic_api_callback.py): support specifying which event types to run the generic api for

* fix(litellm_logging.py): log system prompt for anthropic messages

* feat(generic_api_callback.py): support generic api compatible api's - e.g. rubrik agent cloud

* docs(sidebars.js): document new OSS generic api

* docs(generic_api.md): document new OSS Generic API

* docs(custom_webhook_api.md): document custom webhook api integration tutorial

* docs(custom_webhook_api.md): cleanup

* docs(custom_webhook_api.md): document what get's logged to custom webhook api

* Refactor: Pass callback config to GenericAPILogger

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Fix: Handle empty messages list in logging payload

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Checkpoint before follow-up message

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* feat: Cache GenericAPILogger instances to improve performance

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-11-26 18:38:38 -08:00
..
gcs_pub_sub_body Changes for CI/CD Tests 2025-11-22 10:21:52 -08:00
langfuse_expected_request_body test logging tests + mcp server QA checks 2025-11-15 08:58:46 -08:00
base_test.py
conftest.py
create_mock_standard_logging_payload.py
gettysburg.wav
log.txt
test_alerting.py
test_amazing_s3_logs.py fix tests 2025-10-25 10:19:24 -07:00
test_assemble_streaming_responses.py
test_azure_blob_storage.py
test_bedrock_knowledgebase_hook.py [Fix] - Bedrock Knowledge Bases - add support for filtering kb queries (#16543) 2025-11-12 12:38:50 -08:00
test_built_in_tools_cost_tracking.py
test_custom_callback_router.py fix tests 2025-10-25 10:19:24 -07:00
test_datadog_llm_obs.py
test_datadog.py test_datadog_message_redaction 2025-11-08 14:02:24 -08:00
test_gcs_pub_sub.py
test_generic_api_callback.py make generic api OSS + support multiple generic API's (#17152) 2025-11-26 18:38:38 -08:00
test_humanloop_unit_tests.py
test_langfuse_e2e_test.py fix LF tests 2025-10-04 10:39:17 -07:00
test_langfuse_unit_tests.py
test_langsmith_unit_test.py test logging tests + mcp server QA checks 2025-11-15 08:58:46 -08:00
test_log_db_redis_services.py
test_logging_redaction_e2e_test.py test_redaction_responses_api 2025-11-08 13:43:22 -08:00
test_moderations_api_logging.py
test_opentelemetry_unit_tests.py test_opentelemetry_integration 2025-11-26 12:28:47 -08:00
test_otel_logging.py [Feat] OTEL - Log Cost Breakdown on OTEL Logger (#16334) 2025-11-06 13:53:53 -08:00
test_pagerduty_alerting.py
test_posthog.py fix: Add atexit handlers to flush callbacks for async completions (#16487) 2025-11-11 19:12:53 -08:00
test_spend_logs.py fix tests 2025-10-25 10:19:24 -07:00
test_sqs_logger.py Add Langfuse OTEL and SQS to health check (#16514) 2025-11-12 18:25:30 -08:00
test_standard_logging_payload.py
test_token_counting.py test_stream_token_counting_anthropic_with_include_usage 2025-10-31 20:24:58 -07:00
test_unit_test_litellm_logging.py
test_unit_tests_init_callbacks.py use_callback_in_llm_call 2025-10-01 18:32:37 -07:00
test_view_request_resp_logs.py