litellm/tests
Krish Dholakia 0865e52db3
fix(proxy_server.py): get master key from environment, if not set in … (#9617)
* fix(proxy_server.py): get master key from environment, if not set in general settings or general settings not set at all

* test: mark flaky test

* test(test_proxy_server.py): mock prisma client

* ci: add new github workflow for testing just the mock tests

* fix: fix linting error

* ci(conftest.py): add conftest.py to isolate proxy tests

* build(pyproject.toml): add respx to dev dependencies

* build(pyproject.toml): add prisma to dev dependencies

* test: fix mock prompt management tests to use a mock anthropic key

* ci(test-litellm.yml): parallelize mock testing

make it run faster

* build(pyproject.toml): add hypercorn as dev dep

* build(pyproject.toml): separate proxy vs. core dev dependencies

make it easier for non-proxy contributors to run tests locally - e.g. no need to install hypercorn

* ci(test-litellm.yml): pin python version

* test(test_rerank.py): move test - cannot be mocked, requires aws credentials for e2e testing

* ci: add thank you message to ci

* test: add mock env var to test

* test: add autouse to tests

* test: test mock env vars for e2e tests
2025-03-28 12:32:04 -07:00
..
basic_proxy_startup_tests
batches_tests
code_coverage_tests
documentation_tests
image_gen_tests Nova Canvas complete image generation tasks (#9177) (#9525) 2025-03-26 11:28:20 -07:00
litellm fix(proxy_server.py): get master key from environment, if not set in … (#9617) 2025-03-28 12:32:04 -07:00
litellm_utils_tests Support discovering gemini, anthropic, xai models by calling their /v1/model endpoint (#9530) 2025-03-27 22:50:48 -07:00
llm_responses_api_testing
llm_translation fix(proxy_server.py): get master key from environment, if not set in … (#9617) 2025-03-28 12:32:04 -07:00
load_tests fix vertex embedding perf test 2025-03-26 10:25:50 -07:00
local_testing Allow team admins to add/update/delete models on UI + show api base and model id on request logs (#9572) 2025-03-27 12:06:31 -07:00
logging_callback_tests Merge pull request #9508 from BerriAI/litellm_fix_gcs_pub_sub 2025-03-24 18:22:43 -07:00
mcp_tests ci_cd_server_path 2025-03-21 19:06:29 -07:00
multi_instance_e2e_tests
old_proxy_tests/tests
openai_endpoints_tests
otel_tests
pass_through_tests add litellm mcp endpoints 2025-03-20 21:12:56 -07:00
pass_through_unit_tests test: update tests 2025-03-22 12:56:42 -07:00
proxy_admin_ui_tests test: update tests 2025-03-22 12:56:42 -07:00
proxy_security_tests
proxy_unit_tests test: fix test 2025-03-27 22:04:59 -07:00
router_unit_tests test: update tests 2025-03-22 12:56:42 -07:00
store_model_in_db_tests
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_end_users.py test: run test earlier to catch error 2025-03-27 23:08:52 -07:00
test_entrypoint.py
test_fallbacks.py
test_health.py
test_keys.py
test_logging.conf
test_models.py
test_openai_endpoints.py
test_organizations.py
test_passthrough_endpoints.py
test_ratelimit.py
test_spend_logs.py
test_team_logging.py
test_team_members.py
test_team.py
test_users.py

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.