litellm

History

Tim Elfrink 7c61fa3427 Add comprehensive tests for Bedrock inference profiles with Nova Canvas - Test ARN format inference profile model detection - Test model_id parameter filtering to prevent API errors - Test cross-region inference profile format support - Ensure backward compatibility with regular Nova Canvas models - Cover both request body generation and parameter transformation		2025-09-15 16:53:52 +02:00
..
basic_proxy_startup_tests
batches_tests	[Feat] Bedrock Batches - Working e2e flow to upload file + create batch (#14518 )	2025-09-12 15:37:09 -07:00
code_coverage_tests	[Security] Fix: Ensure .info() logs are not used for request/responses + Add code QA check for possible violations (#14386 )	2025-09-09 13:55:56 -07:00
documentation_tests
enterprise	test mapped test fixes	2025-08-23 17:04:23 -07:00
guardrails_tests
image_gen_tests	Add comprehensive tests for Bedrock inference profiles with Nova Canvas	2025-09-15 16:53:52 +02:00
litellm/llms	Revert "fix: remove anthropic-beta header for Vertex AI requests with prompt caching" (#14421 )	2025-09-10 15:47:18 -07:00
litellm_utils_tests	test: remove end of life model from tests	2025-09-09 21:01:45 -07:00
litellm-proxy-extras
llm_responses_api_testing	[Feat]Add cancel endpoint support for openai and azure (#14561 )	2025-09-15 07:08:56 -07:00
llm_translation	fix: get_base_completion_call_args	2025-09-13 09:59:08 -07:00
load_tests
local_testing	[Performance] Use _PROXY_MaxParallelRequestsHandler_v3 by default again (#14450 )	2025-09-12 17:33:55 -07:00
logging_callback_tests	Switch to string constant based truncation	2025-08-28 16:28:36 -06:00
mcp_tests	[Fixes] Bug fixes to using LiteLLM MCP Gateway (#14392 )	2025-09-10 19:12:11 -07:00
multi_instance_e2e_tests
old_proxy_tests/tests
openai_endpoints_tests	[Feat]Add cancel endpoint support for openai and azure (#14561 )	2025-09-15 07:08:56 -07:00
otel_tests	Added user_email labels to the prometheus monitoring.	2025-09-12 15:38:23 -07:00
pass_through_tests	test: update test - anthropic returns input tokens in final usage chunk now	2025-08-16 12:31:52 -07:00
pass_through_unit_tests	[Bug fix] - Fix /messages fallback from Anthropic API -> Bedrock API (#13946 )	2025-08-25 13:44:54 -07:00
proxy_admin_ui_tests	Fixed Log Tab Key Alias filtering inaccurately for failed logs	2025-09-11 13:05:48 -07:00
proxy_security_tests
proxy_unit_tests	Litellm gemini cli bug fix (#14451 )	2025-09-12 11:55:26 -07:00
router_unit_tests	[Bug Fix] x-litellm-tags not routing with Responses API (#14289 )	2025-09-05 09:40:37 -07:00
scim_tests
spend_tracking_tests
store_model_in_db_tests	[MCP Gateway] fix auth on ui for bearer servers (#13312 )	2025-08-06 09:46:10 -07:00
test_litellm	Fix: Bedrock cross-region inference profile cost calculation (#14566 )	2025-09-15 07:10:20 -07:00
unified_google_tests	[Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905 )	2025-08-23 13:13:23 -07:00
vector_store_tests	[Bug Fix] Bedrock KB - Using LiteLLM Managed Credentials for Query (#13787 )	2025-08-19 15:39:36 -07:00
windows_tests
__init__.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_budget_management.py
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py
test_health.py
test_keys.py
test_logging.conf
test_models.py
test_openai_endpoints.py	test fix	2025-09-01 17:04:47 -07:00
test_organizations.py
test_passthrough_endpoints.py
test_ratelimit.py
test_resource_cleanup.py
test_spend_logs.py	Revert "Allow configuration to on what threshold to try truncating request content in db"	2025-08-28 16:12:42 -06:00
test_team_logging.py
test_team_members.py
test_team.py
test_users.py

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.