* add sap gen ai hub * add async tests * add async and streaming support * add embedding model support * add embedding support * remove unused import * fix structured output * clean-up * remove timeout and add tool support * remove unused code * fix(sap): improve streaming robustness; restore embed URL builder compatibility - sap/embed/transformation: add api_key and litellm_params to get_complete_url to align with core flow and prevent failures - sap/chat/handler: wrap async/sync streaming iterators to safely handle Stop(Async)Iteration and errors - sap/chat/transformation: remove unused imports and dead code * fix(sap): linter fix * fix(sap): made gen_ai_hub optional: import check + OptionalDependencyError with install hint if missing. * test(sap): add chat/stream/async tests and OptionalDependencyError check * Fix tool call handling in SAP GenAI Hub transformation Add sap models to model_prices_and_context_window.json and model_prices_and_context_window_backup.json * fix(sap): delete unnecessary code, linter fix * fix(sap): - refactor chat transformation - add support of list and dict content * fix(sap): - fix tests * fix(sap): - fix lint * Update transformation.py * fix(sap): fix model description and fix after rebase * change(sap): - http calls in chat handler, response transformation and auth handling without sap sdk. * change(sap): switching to v2 (chat handler, chat transformation), code clean up * add deployment discovery and improved crendentials handling * add deployment discovery and improved crendentials handling * change(sap): - fix sync stream * change(sap): - fix sync stream * fix(sap): - fix response format * fix(sap): - switch embedding to v2 and http request - reimplement stream creator - improve request transformation * fix async streaming * fix(sap): linters, transformation models, remove sap dependency test * fix(sap): code clean up * add unit test for sap chat completion * linters fix * move token, rg and base_url to properties * (sap): add embedding unit test Signed-off-by: Vasilisa Parshikova <vasilisa.parshikova@sap.com> * fix(sap): bypass response format for some models Signed-off-by: Vasilisa Parshikova <vasilisa.parshikova@sap.com> * fix(sap): fix chat transformation and list of supported params Signed-off-by: Vasilisa Parshikova <vasilisa.parshikova@sap.com> * fix(sap): fix lint * add sap service key module parameter * fix(sap): remove unused code * fix(sap): remove prices * add service key support * fix(sap): - add message content validations - change get_supported_openai_params in chat transformation * typo in mock * fix(sap): - fix in supported params map * fix(sap): - fix in message content validation * fix(sap): - fix in message content validation * fix(sap): - use litellm client for credentials * fix(sap): - linter fix * fix(sap): - use build in custom_http_client - move credentials handling to transformation * fix(sap): - handle stream_options * fix(sap): - fix tests * fix(sap): - code clean up, linter fix * skip other authentication options when creds are provided * fix local variable --------- Signed-off-by: Vasilisa Parshikova <vasilisa.parshikova@sap.com> Co-authored-by: Mathis Boerner <mathis.boerner@sap.com> Co-authored-by: karimmohraz <37623804+karimmohraz@users.noreply.github.com> Co-authored-by: Karim <karim.mohraz@sap.com> |
||
|---|---|---|
| .. | ||
| caching | ||
| completion_extras | ||
| containers | ||
| enterprise | ||
| experimental_mcp_client | ||
| google_genai | ||
| integrations | ||
| litellm_core_utils | ||
| llms | ||
| passthrough | ||
| proxy | ||
| responses | ||
| router_strategy | ||
| router_utils | ||
| secret_managers | ||
| types | ||
| vector_stores | ||
| __init__.py | ||
| conftest.py | ||
| log.txt | ||
| readme.md | ||
| test_acompletion_session_reuse_e2e.py | ||
| test_add_deployment_no_master_key.py | ||
| test_aembedding_session_reuse_e2e.py | ||
| test_azure_video_router.py | ||
| test_claude_haiku_4_5_config.py | ||
| test_constants.py | ||
| test_container_router.py | ||
| test_cost_calculation_log_level.py | ||
| test_cost_calculator.py | ||
| test_exception_mapping_request_attribute.py | ||
| test_filter_out_litellm_params.py | ||
| test_groq_streaming_encoding.py | ||
| test_logging.py | ||
| test_lowest_latency_zero_tokens.py | ||
| test_main.py | ||
| test_redis.py | ||
| test_responses_id_security.py | ||
| test_router_google_genai.py | ||
| test_router.py | ||
| test_shared_session_integration.py | ||
| test_system_message_format_bug.py | ||
| test_utils.py | ||
| test_uuid_helper.py | ||
| test_video_generation.py | ||
Testing for litellm/
This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.
The point of this is to:
- Increase test coverage of
litellm/ - Make it easy for contributors to add tests for the
litellm/package and easily run tests without needing LLM API keys.
File name conventions
litellm/proxy/test_caching_routes.pymaps tolitellm/proxy/caching_routes.pytest_<filename>.pymaps tolitellm/<filename>.py