litellm/tests/README.MD

**In total litellm runs 1000+ tests**

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in `tests/test_litellm`

This folder can only run mock tests.
[Feat] MCP Gateway Fine-grained Tools Addition (#15153) * feat: UI to add specific tools under creating MCP connection * chore: pydantic + prisma changes * feat: adding specific MCP tools now works * fix: allowed tools filtering * chore: filtered list to mcp server cost config * chore: update Readme * chore: refactor the filtering * test: Added tests When the allowed_tests is null, empty list or populated * chore: resolve the proxy issue * feat: updating MCP tool filtering 2025-10-04 01:16:29 +08:00			`In total litellm runs 1000+ tests`
add bedrock llama vision support + cohere / infinity rerank - 'return_documents' support (#8684) * build(model_prices_and_context_window.json): mark bedrock llama as supporting vision based on docs * Add price for Cerebras llama3.3-70b (#8676) * docs(readme.md): fix contributing docs point people to new mock directory testing structure s/o @vibhavbhat * build: update contributing readme * docs(readme.md): improve docs * docs(readme.md): cleanup readme on tests/ * docs(README.md): cleanup doc * feat(infinity/): support returning documents when return_documents=True * test(test_rerank.py): add e2e testing for cohere rerank * fix: fix linting errors * fix(together_ai/): fix together ai transformation * fix: fix linting error * fix: fix linting errors * fix: fix linting errors * test: mark cohere as flaky * build: fix model supports check * test: fix test * test: mark flaky test * fix: fix test * test: fix test --------- Co-authored-by: Yury Koleda <fut.wrk@gmail.com> 2025-02-21 13:23:54 +08:00
			`[02/20/2025] Update:`

			`To make it easier to contribute and map what behavior is tested,`

[Feat] MCP Gateway Fine-grained Tools Addition (#15153) * feat: UI to add specific tools under creating MCP connection * chore: pydantic + prisma changes * feat: adding specific MCP tools now works * fix: allowed tools filtering * chore: filtered list to mcp server cost config * chore: update Readme * chore: refactor the filtering * test: Added tests When the allowed_tests is null, empty list or populated * chore: resolve the proxy issue * feat: updating MCP tool filtering 2025-10-04 01:16:29 +08:00			we've started mapping the litellm directory in `tests/test_litellm`
add bedrock llama vision support + cohere / infinity rerank - 'return_documents' support (#8684) * build(model_prices_and_context_window.json): mark bedrock llama as supporting vision based on docs * Add price for Cerebras llama3.3-70b (#8676) * docs(readme.md): fix contributing docs point people to new mock directory testing structure s/o @vibhavbhat * build: update contributing readme * docs(readme.md): improve docs * docs(readme.md): cleanup readme on tests/ * docs(README.md): cleanup doc * feat(infinity/): support returning documents when return_documents=True * test(test_rerank.py): add e2e testing for cohere rerank * fix: fix linting errors * fix(together_ai/): fix together ai transformation * fix: fix linting error * fix: fix linting errors * fix: fix linting errors * test: mark cohere as flaky * build: fix model supports check * test: fix test * test: mark flaky test * fix: fix test * test: fix test --------- Co-authored-by: Yury Koleda <fut.wrk@gmail.com> 2025-02-21 13:23:54 +08:00
[Feat] MCP Gateway Fine-grained Tools Addition (#15153) * feat: UI to add specific tools under creating MCP connection * chore: pydantic + prisma changes * feat: adding specific MCP tools now works * fix: allowed tools filtering * chore: filtered list to mcp server cost config * chore: update Readme * chore: refactor the filtering * test: Added tests When the allowed_tests is null, empty list or populated * chore: resolve the proxy issue * feat: updating MCP tool filtering 2025-10-04 01:16:29 +08:00			`This folder can only run mock tests.`