litellm/tests
Krish Dholakia 62ad84fb64
UI (new_usage.tsx): Report 'total_tokens' + report success/failure calls (#9675)
* feat(internal_user_endpoints.py): return 'total_tokens' in `/user/daily/analytics`

* test(test_internal_user_endpoints.py): add unit test to assert spend metrics and dailyspend metadata always report the same fields

* build(schema.prisma): record success + failure calls to daily user table

allows understanding why model requests might exceed provider requests (e.g. user hit rate limit error)

* fix(internal_user_endpoints.py): report success / failure requests in API

* fix(proxy/utils.py): default to success

status can be missing or none at times for successful requests

* feat(new_usage.tsx): show success/failure calls on UI

* style(new_usage.tsx): ui cleanup

* fix: fix linting error

* fix: fix linting error

* feat(litellm-proxy-extras/): add new migration files
2025-03-31 22:48:43 -07:00
..
basic_proxy_startup_tests
batches_tests cleanup_azure_files 2025-02-15 15:32:42 -08:00
code_coverage_tests install prisma migration files - connects litellm proxy to litellm's prisma migration files (#9637) 2025-03-29 15:27:09 -07:00
documentation_tests
image_gen_tests Nova Canvas complete image generation tasks (#9177) (#9525) 2025-03-26 11:28:20 -07:00
litellm UI (new_usage.tsx): Report 'total_tokens' + report success/failure calls (#9675) 2025-03-31 22:48:43 -07:00
litellm_utils_tests build(pyproject.toml): add new dev dependencies - for type checking (#9631) 2025-03-29 11:02:13 -07:00
llm_responses_api_testing test_openai_o1_pro_response_api_streaming 2025-03-20 13:04:49 -07:00
llm_translation Openrouter streaming fixes + Anthropic 'file' message support (#9667) 2025-03-31 21:22:59 -07:00
load_tests fix vertex embedding perf test 2025-03-26 10:25:50 -07:00
local_testing fix(cost_calculator.py): allows checking received + sent model name when checking for cost calculation (#9669) 2025-03-31 21:29:48 -07:00
logging_callback_tests fix tests 2025-03-29 17:38:24 -07:00
mcp_tests test fixes 2025-03-29 18:34:58 -07:00
multi_instance_e2e_tests (e2e testing) - add tests for using litellm /team/ updates in multi-instance deployments with Redis (#8440) 2025-02-10 19:33:27 -08:00
old_proxy_tests/tests
openai_endpoints_tests test_bad_request_bad_param_error 2025-03-13 16:02:21 -07:00
otel_tests test local spend accuracy 2025-03-28 19:52:39 -07:00
pass_through_tests test fix 2025-03-29 18:36:13 -07:00
pass_through_unit_tests use new anthropic interface 2025-03-31 14:31:09 -07:00
proxy_admin_ui_tests test: update tests 2025-03-22 12:56:42 -07:00
proxy_security_tests (Security fix) - remove code block that inserts master key hash into DB (#8268) 2025-02-05 17:25:42 -08:00
proxy_unit_tests test fix update spend 2025-03-31 14:20:47 -07:00
router_unit_tests test: update tests 2025-03-22 12:56:42 -07:00
store_model_in_db_tests test_chat_completion_bad_model_with_spend_logs 2025-02-28 20:19:43 -08:00
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD add bedrock llama vision support + cohere / infinity rerank - 'return_documents' support (#8684) 2025-02-20 21:23:54 -08:00
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_end_users.py test: run test earlier to catch error 2025-03-27 23:08:52 -07:00
test_entrypoint.py
test_fallbacks.py test: fix test 2025-03-10 22:00:50 -07:00
test_health.py
test_keys.py
test_logging.conf
test_models.py Improved wildcard route handling on /models and /model_group/info (#8473) 2025-02-11 19:37:43 -08:00
test_openai_endpoints.py test string checked for model access control 2025-03-10 20:04:18 -07:00
test_organizations.py Add remaining org CRUD endpoints + support deleting orgs on UI (#8561) 2025-02-15 15:48:06 -08:00
test_passthrough_endpoints.py
test_ratelimit.py (Refactor / QA) - Use LoggingCallbackManager to append callbacks and ensure no duplicate callbacks are added (#8112) 2025-01-30 19:35:50 -08:00
test_spend_logs.py (feat) - track org_id in SpendLogs (#8253) 2025-02-04 21:08:05 -08:00
test_team_logging.py
test_team_members.py test: add more unit testing for team member endpoints (#8170) 2025-02-01 11:23:00 -08:00
test_team.py fix(team_endpoints.py): ensure 404 raised when team not found (#9038) 2025-03-06 22:04:36 -08:00
test_users.py Internal User Endpoint - vulnerability fix + response type fix (#8228) 2025-02-04 06:41:14 -08:00

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.