ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
56fc0cf374
litellm/tests/test_litellm
History
Ishaan Jaff ee70d593c1
[Feat] Allow redacting message / response content for specific logging integrations - DD LLM Observability (#13158) 
* fix redact_standard_logging_payload

* add StandardCustomLoggerInitParams

* allow defining DatadogLLMObsInitParams

* fix init DataDogLLMObsLogger

* fix import

* update redact_standard_logging_payload_from_model_call_details

* test_dd_llms_obs_redaction

* docs DD logging

* docs DD

* docs DD

* Redacting Messages, Response docs DD LLM Obs

* fix redaction logic

* fix create_llm_obs_payload

* fix logging response

* fixes

* ruff fix

* fix test

* test_dd_llms_obs_redaction

* test_create_llm_obs_payload

* redact_standard_logging_payload_from_model_call_details

* img - dd_llm_obs

* docs DD

* fix linting

* fix linting

* fix mypy

* test_create_llm_obs_payload

* test_create_llm_obs_payload

* fix mock_env_vars

* fix _handle_anthropic_messages_response_logging
2025-07-31 16:44:16 -07:00
..
caching test_qdrant_semantic_cache_async_set_cache 2025-07-19 15:59:56 -07:00
completion_extras/litellm_responses_transformation fix: handle reasoning parameters and response in responses bridge (#12433) 2025-07-10 18:06:45 -07:00
enterprise/enterprise_callbacks [Feat] Backend - Add support for disabling callbacks in request body (#12762) 2025-07-19 10:10:30 -07:00
experimental_mcp_client [MCP Gateway] Allow using stdio MCPs with LiteLLM (#12530) 2025-07-11 20:21:02 -07:00
google_genai [Bug Fix] Gemini-CLI - The Gemini Custom API request has an incorrect authorization format (#13098) 2025-07-29 13:46:43 -07:00
integrations [Feat] Allow redacting message / response content for specific logging integrations - DD LLM Observability (#13158) 2025-07-31 16:44:16 -07:00
litellm_core_utils Fix token counter to ignore unsupported keys like prefix (#11791) (#11954) 2025-07-29 16:04:09 -07:00
llms Revert "add framework name to UserAgent header in AWS Bedrock API call (#13159)" 2025-07-30 23:12:36 -07:00
passthrough Refactor: bedrock passthrough fixes - migrate to Passthrough SDK (#12089) 2025-06-26 22:51:35 -07:00
proxy [Bug Fix] Infra - ensure that stale Prisma clients disconnect DB connection (#13140) 2025-07-31 16:43:26 -07:00
responses Remove duplicate test case verifying field filtering logic (#13023) 2025-07-28 16:40:06 -07:00
router_strategy fix mapped test 2025-07-25 07:24:42 -07:00
router_utils fix mapped tests (#12320) 2025-07-04 10:04:43 -07:00
secret_managers Added handling for pwd protected cert files in AOAI CertificateCredential auth (#12995) 2025-07-28 21:34:54 -07:00
types fix: correct CompletionRequest messages type to match OpenAI API spec (#12980) 2025-07-28 16:47:20 -07:00
vector_stores [Fix] QA Fixes - Vector Store Object Permissions (#11291) 2025-05-31 09:41:05 -07:00
__init__.py [Feat] Add github co-pilot as a new LLM API provider (#12325) 2025-07-04 13:12:16 -07:00
conftest.py fix mapped tests (#12320) 2025-07-04 10:04:43 -07:00
log.txt
readme.md
test_constants.py
test_cost_calculation_log_level.py fix: change cost calculation logs from INFO to DEBUG level 2025-06-27 11:36:58 -06:00
test_cost_calculator.py test: update test 2025-07-16 09:15:05 -07:00
test_logging.py [Bug Fix] StandardLoggingPayload on cache_hits should track custom llm provider + DD LLM Obs span type (#12652) 2025-07-16 15:43:15 -07:00
test_lowest_latency_zero_tokens.py fix(lowest_latency.py): Handle ZeroDivisionError with zero completion tokens (#12734) 2025-07-18 15:19:47 -07:00
test_main.py Fix async retryer on .acompletion() + forward clientside headers - filter out content-type from clientside request (causes llm api call to hang) (#12886) 2025-07-22 19:50:05 -07:00
test_router.py move to use_prisma_migrate by default + resolve team-only models on auth checks + UI - add sagemaker on UI (#13117) 2025-07-29 21:56:18 -07:00
test_utils.py [Feat] Add Google AI Studio Imagen4 model family (#13065) 2025-07-28 21:25:40 -07:00

readme.md

Testing for litellm/

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

  1. Increase test coverage of litellm/
  2. Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

  • litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
  • test_<filename>.py maps to litellm/<filename>.py