litellm/tests/logging_callback_tests
Ishaan Jaff b9132968b2
[Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905)
* [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895)

* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix

* create LoggingWorker

* add GLOBAL_LOGGING_WORKER for async task handling

* fix logging tests

* add conftest

* fix conftest

* test fix location of encode bedrock runtime modelid arn

* fix conftest.py

* tuning LoggingWorker

* conftest.py

* fix conftest batches/

* test_async_chat_azure

* event_loop

* test_bedrock_streaming_passthrough_test2

* fix GLOBAL_LOGGING_WORKER

* logging worker

* add flush for global logging worker

* Revert "fix GLOBAL_LOGGING_WORKER"

This reverts commit d254f508f48935652f054777652938ad71976cce.

* fix conftest clear_queue

* fix conftest clear_queue

* setup_and_teardown for llm translation

* docs AWS_REGION

* test_async_chat_azure

* change test DIR

* run ci/cd again

* use 1 job for litellm_router_unit_testing

* fix space

* fix litellm_router_unit_testing

* test_aaarouter_dynamic_cooldown_message_retry_time

* litellm_router_unit_testing

* conftest.py clearing qu

* fixes litellm_router_unit_testing

* fixes clear_queue

* fix router_unit_tests

* remove conftest

* add back conftest for router

* fix event loop test

* test fix

* fixes for LoggingWorker

* ruff fix
2025-08-23 13:13:23 -07:00
..
gcs_pub_sub_body MCP - usage tracking (#12397) 2025-07-08 22:08:16 -07:00
langfuse_expected_request_body fix(utils.py): support non default params for audio transcription (#11212) 2025-05-28 22:24:02 -07:00
base_test.py
conftest.py [Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905) 2025-08-23 13:13:23 -07:00
create_mock_standard_logging_payload.py
gettysburg.wav
log.txt
test_alerting.py [Feat] Performance - Don't create 1 task for every hanging request alert (#11385) 2025-06-03 21:12:54 -07:00
test_amazing_s3_logs.py [Feat] Responses API Session Handling - Multi media support (#13347) 2025-08-07 10:59:53 -07:00
test_assemble_streaming_responses.py
test_azure_blob_storage.py
test_bedrock_knowledgebase_hook.py [Refactor] Vector Stores - Use class VectorStorePreCallHook for all Vector Store Integrations (#12715) 2025-07-17 16:31:58 -07:00
test_built_in_tools_cost_tracking.py
test_custom_callback_router.py [Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905) 2025-08-23 13:13:23 -07:00
test_datadog_llm_obs.py [Feat] Allow redacting message / response content for specific logging integrations - DD LLM Observability (#13158) 2025-07-31 16:44:16 -07:00
test_datadog.py Ensure message redaction works for responses API logging (#12291) 2025-07-04 15:11:20 -07:00
test_gcs_pub_sub.py [Feat] Responses API Session Handling - Multi media support (#13347) 2025-08-07 10:59:53 -07:00
test_generic_api_callback.py
test_humanloop_unit_tests.py
test_langfuse_e2e_test.py Litellm dev 05 26 2025 p1 (#11165) 2025-05-26 22:00:48 -07:00
test_langfuse_unit_tests.py test: fixes 2025-05-31 12:42:56 -07:00
test_langsmith_unit_test.py
test_log_db_redis_services.py
test_logging_redaction_e2e_test.py add fix for redaction (#13005) 2025-07-25 17:48:48 -07:00
test_moderations_api_logging.py [Bug Fix] Fix model_group tracked for /v1/messages and /moderations (#11933) 2025-06-20 14:51:50 -07:00
test_opentelemetry_unit_tests.py
test_otel_logging.py [Feat] Responses API Session Handling - Multi media support (#13347) 2025-08-07 10:59:53 -07:00
test_pagerduty_alerting.py
test_spend_logs.py
test_sqs_logger.py [Feat] Add new AWS SQS Logging Integration (#12176) 2025-06-30 14:02:49 -07:00
test_standard_logging_payload.py
test_token_counting.py Revert "test_stream_token_counting_anthropic_with_include_usage" 2025-08-16 13:07:00 -07:00
test_unit_test_litellm_logging.py
test_unit_tests_init_callbacks.py feat(integrations): allow setting of braintrust callback base url (#13368) 2025-08-07 08:40:11 -07:00
test_view_request_resp_logs.py