ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
b757bb68f9
litellm/tests
History
Cole McIntosh b757bb68f9
fix: add implicit caching cost calculation for Gemini 2.x models (#12585) 
Added cache_read_input_token_cost (25% of regular input cost) to all 39 Gemini 2.x models
to properly support implicit context caching cost calculations. Previously, cached tokens
were being charged at full price instead of the discounted rate.

Fixes #11156
2025-07-14 16:37:17 -07:00
..
basic_proxy_startup_tests
batches_tests openai.ConflictError 2025-07-12 17:07:21 -07:00
code_coverage_tests UI - Azure Content Guardrails (#12341) 2025-07-05 10:19:29 -07:00
documentation_tests
enterprise [Enterprise] Support tag based mode for guardrails (#12508) 2025-07-10 22:27:30 -07:00
guardrails_tests test_bedrock_guardrail_blocked_action_shows_output_text_with_multiple_outputs 2025-07-09 17:03:56 -07:00
image_gen_tests [Feat] Add XInference Image Generation API Provider (#12439) 2025-07-08 21:17:38 -07:00
litellm_utils_tests Prevent writing default user setting updates to yaml (error in non-root env) + Use central team member budget when max_budget_in_team set on UI (#12533) 2025-07-12 10:13:07 -07:00
litellm-proxy-extras
llm_responses_api_testing test_mcp_tools_with_responses_api 2025-07-03 14:53:30 -07:00
llm_translation ruff check ./litellm --fix 2025-07-12 11:04:02 -07:00
load_tests test: test_embedding_performance 2025-05-14 21:31:07 -07:00
local_testing test test_redis_caching_multiple_namespaces (#12552) 2025-07-12 12:06:16 -07:00
logging_callback_tests Team Members - reset budget, if duration set + Prometheus - support tag based metrics (#12534) 2025-07-11 22:54:16 -07:00
mcp_tests [MCP Gateway] Ensure we use the same param for specifying groups (#12561) 2025-07-12 16:41:58 -07:00
multi_instance_e2e_tests
old_proxy_tests/tests
openai_endpoints_tests Batches - support batch retrieve with target model Query Param + Anthropic - completion bridge, yield content_block_stop chunk (#12228) 2025-07-01 22:13:48 -07:00
otel_tests test_bedrock_guardrail_triggered 2025-07-09 17:05:06 -07:00
pass_through_tests test_anthropic_basic_completion_with_headers ci/cd fix 2025-07-12 11:08:03 -07:00
pass_through_unit_tests test fix - test_anthropic_messages_passthrough.py 2025-06-30 21:56:31 -07:00
proxy_admin_ui_tests Fix e2e test (#12549) 2025-07-12 10:42:57 -07:00
proxy_security_tests
proxy_unit_tests [Security Fix] - Dont show pure JWT in "Logs" page on UI (#12524) 2025-07-11 15:33:57 -07:00
router_unit_tests test_mock_router_testing_params_str_to_bool_conversion 2025-06-27 18:07:33 -07:00
scim_tests
spend_tracking_tests
store_model_in_db_tests Validation to mcp server name (#12515) 2025-07-11 11:24:42 -07:00
test_litellm fix: add implicit caching cost calculation for Gemini 2.x models (#12585) 2025-07-14 16:37:17 -07:00
unified_google_tests [Bug Fix] Using gemini-cli with Vertex Anthropic Models (#12246) 2025-07-03 12:29:27 -07:00
vector_store_tests [Feat] OpenAI/Azure OpenAI - Add support for creating vector stores on LiteLLM (#12021) 2025-06-24 20:46:48 -07:00
windows_tests [Bug Fix] UnicodeDecodeError: 'charmap' on Windows during litellm import (#10542) 2025-05-03 21:31:05 -07:00
__init__.py [Feat] Add github co-pilot as a new LLM API provider (#12325) 2025-07-04 13:12:16 -07:00
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_budget_management.py Update enduser spend and budget reset date based on budget duration (#8460) 2025-06-08 08:39:14 -07:00
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py Ollama Chat - parse tool calls on streaming (#11171) 2025-05-27 16:14:49 -07:00
test_health.py
test_keys.py test: temporarily skip test due to change testing model change - need to update test for new model 2025-05-09 09:02:08 -07:00
test_logging.conf
test_models.py Add model access groups on UI (#11719) 2025-06-13 21:20:25 -07:00
test_openai_endpoints.py
test_organizations.py UI - fix adding vertex models with reusable credentials + fix pagination on keys table + fix showing org budgets on table (#10528) 2025-05-03 08:16:53 -07:00
test_passthrough_endpoints.py
test_ratelimit.py
test_resource_cleanup.py Fix: Properly close aiohttp client sessions to prevent resource leaks (#12251) 2025-07-09 09:25:17 -07:00
test_spend_logs.py
test_team_logging.py
test_team_members.py
test_team.py build: publish new litellm-proxy-extras file 2025-05-27 17:44:23 -07:00
test_users.py test: fix imports 2025-05-26 22:06:53 -07:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.