litellm/tests
Aaron Vogler 4c466ef157
Integration: Bytez as a model provider (#12121)
* Get the basics of the integration working.

* Cleanup bytez integration.

* Update user agent for Bytez integration.

* Use the config class directly. Create the start of the docs.

* Finish up bytez documentation. Include a provider integration guide.

* Fix typing bug in custom_logger_utils. Add tests for bytez integration.

* Add token tracking for model usage for Bytez integration.

* Create a units test for the Bytez config.

* Make changes to Bytez transformation code per PR feedback.

* Cleanup coment in Bytez transformation test.

* Remove LRU usage for bytez integration.

* Consolidate Bytez tests into a single file. Conform to project structure for tests.

* Fix linting error with Bytez impl.
2025-07-12 10:50:39 -07:00
..
basic_proxy_startup_tests
batches_tests Store batch output file id in DB + Store batch file status in DB + (experimental) BATCH API COST TRACKING 2025-06-25 22:41:22 -07:00
code_coverage_tests UI - Azure Content Guardrails (#12341) 2025-07-05 10:19:29 -07:00
documentation_tests
enterprise [Enterprise] Support tag based mode for guardrails (#12508) 2025-07-10 22:27:30 -07:00
guardrails_tests test_bedrock_guardrail_blocked_action_shows_output_text_with_multiple_outputs 2025-07-09 17:03:56 -07:00
image_gen_tests [Feat] Add XInference Image Generation API Provider (#12439) 2025-07-08 21:17:38 -07:00
litellm_utils_tests Prevent writing default user setting updates to yaml (error in non-root env) + Use central team member budget when max_budget_in_team set on UI (#12533) 2025-07-12 10:13:07 -07:00
litellm-proxy-extras
llm_responses_api_testing test_mcp_tools_with_responses_api 2025-07-03 14:53:30 -07:00
llm_translation test_gemini_url_context 2025-07-03 16:13:44 -07:00
load_tests
local_testing fix test_qdrant_semantic_cache_acompletion 2025-07-11 22:07:19 -07:00
logging_callback_tests Team Members - reset budget, if duration set + Prometheus - support tag based metrics (#12534) 2025-07-11 22:54:16 -07:00
mcp_tests [MCP Gateway] Allow mcp access groups on test key and tool calls (#12529) 2025-07-12 10:36:42 -07:00
multi_instance_e2e_tests
old_proxy_tests/tests
openai_endpoints_tests Batches - support batch retrieve with target model Query Param + Anthropic - completion bridge, yield content_block_stop chunk (#12228) 2025-07-01 22:13:48 -07:00
otel_tests test_bedrock_guardrail_triggered 2025-07-09 17:05:06 -07:00
pass_through_tests add jest.retryTimes(3); 2025-06-27 21:31:51 -07:00
pass_through_unit_tests test fix - test_anthropic_messages_passthrough.py 2025-06-30 21:56:31 -07:00
proxy_admin_ui_tests Fix e2e test (#12549) 2025-07-12 10:42:57 -07:00
proxy_security_tests
proxy_unit_tests [Security Fix] - Dont show pure JWT in "Logs" page on UI (#12524) 2025-07-11 15:33:57 -07:00
router_unit_tests test_mock_router_testing_params_str_to_bool_conversion 2025-06-27 18:07:33 -07:00
scim_tests
spend_tracking_tests
store_model_in_db_tests Validation to mcp server name (#12515) 2025-07-11 11:24:42 -07:00
test_litellm Integration: Bytez as a model provider (#12121) 2025-07-12 10:50:39 -07:00
unified_google_tests [Bug Fix] Using gemini-cli with Vertex Anthropic Models (#12246) 2025-07-03 12:29:27 -07:00
vector_store_tests [Feat] OpenAI/Azure OpenAI - Add support for creating vector stores on LiteLLM (#12021) 2025-06-24 20:46:48 -07:00
windows_tests
__init__.py [Feat] Add github co-pilot as a new LLM API provider (#12325) 2025-07-04 13:12:16 -07:00
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_budget_management.py
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py
test_health.py
test_keys.py
test_logging.conf
test_models.py
test_openai_endpoints.py
test_organizations.py
test_passthrough_endpoints.py
test_ratelimit.py
test_resource_cleanup.py Fix: Properly close aiohttp client sessions to prevent resource leaks (#12251) 2025-07-09 09:25:17 -07:00
test_spend_logs.py
test_team_logging.py
test_team_members.py
test_team.py
test_users.py

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.