litellm/tests/llm_translation
katsuhiro muto ca43514db4
[Feat] Support reasoning_effort in Groq (#14207)
* Support reasoning_effort in groq

* add test
2025-09-03 10:43:47 -07:00
..
test_llm_response_utils Support caching on reasoning content + other fixes (#8973) 2025-03-04 21:12:16 -08:00
base_audio_transcription_unit_tests.py [Feat] Perf fix - ensure deepgram provider uses async httpx calls (#11641) 2025-06-11 18:32:01 -07:00
base_embedding_unit_tests.py
base_llm_unit_tests.py [Bug Fix] Gemini Tool Calling - fix gemini empty enum property (#14155) 2025-09-01 17:05:01 -07:00
base_rerank_unit_tests.py Add cost tracking for rerank via bedrock (#8691) 2025-02-20 21:00:18 -08:00
conftest.py [Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905) 2025-08-23 13:13:23 -07:00
dog.wav
duck.png fix vertex ai multimodal embedding translation (#9471) 2025-03-24 23:23:28 -07:00
gettysburg.wav
guinea.png fix vertex ai multimodal embedding translation (#9471) 2025-03-24 23:23:28 -07:00
log.xt Litellm dev 04 05 2025 p2 (#9774) 2025-04-07 21:02:52 -07:00
Readme.md
test_aiohttp_openai.py
test_anthropic_completion.py Revert "Merge pull request #14126 from TomeHirata/citation-supported-text-2" 2025-09-01 20:24:14 -07:00
test_aws_base_llm.py Add support for AWS assume_role with a session token 2025-08-23 22:37:21 -07:00
test_azure_ai.py [Bug Fix]: Azure OpenAI GPT-5 max_tokens + reasoning param support (#13510) 2025-08-11 15:40:53 -07:00
test_azure_o_series.py test azure o series 2025-04-02 09:46:45 -07:00
test_azure_openai.py feat(common_utils.py): make default azure openai responses api use /openai/v1/responses logic 2025-08-11 23:40:05 -07:00
test_bedrock_agents.py Add 'audio_url' message type support for VLLM (#12270) 2025-07-02 20:37:45 -07:00
test_bedrock_completion.py [Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905) 2025-08-23 13:13:23 -07:00
test_bedrock_dynamic_auth_params_unit_tests.py Litellm staging 05 10 2025 - openai pdf url support + sagemaker chat content length error fix (#10724) 2025-05-10 17:41:57 -07:00
test_bedrock_embedding.py fix: remove aws params from bedrock embedding request body (#8618) (#8696) 2025-02-24 10:04:58 -08:00
test_bedrock_govcloud.py [LLM Translation] Add Gov Cloud bedrock model pricing and context windows (#12773) 2025-07-19 16:12:05 -07:00
test_bedrock_gpt_oss.py [Feat] Add Streaming support + Docs for bedrock gpt-oss model family (#13346) 2025-08-12 08:39:36 -07:00
test_bedrock_invoke_tests.py [Bedrock] Fixes to only allow accepted fields for tool json schema (#10062) 2025-05-13 19:49:30 -07:00
test_bedrock_llama.py Add bedrock llama4 pricing + handle llama4 templating on bedrock invoke route (#10582) 2025-05-06 16:06:24 -07:00
test_bedrock_nova_json.py Extract 'thinking' from nova response + Add 'drop_params' support for gpt-image-1 (#10680) 2025-05-08 23:01:38 -07:00
test_clarifai_completion.py
test_cloudflare.py
test_cohere_generate_api.py
test_cohere.py feat: Add support for Cohere Embed v4.0 model (#11329) 2025-06-02 11:25:29 -07:00
test_convert_dict_to_image.py Fix None values in usage field for gpt-image-1 model responses (#11448) 2025-06-05 13:19:18 -07:00
test_databricks.py test: skip dbrx claude 3-7 sonnet test - rate limit errors 2025-07-28 17:34:42 -07:00
test_deepgram.py
test_deepseek_completion.py test_completion_cost_deepseek 2025-07-23 13:16:12 -07:00
test_elevenlabs.py [Feat] Add Eleven Labs - Speech To Text Support on LiteLLM (#12119) 2025-06-27 17:50:49 -07:00
test_fireworks_ai_translation.py [LLM Translation] Fix Realtime API endpoint for no intent (#13476) 2025-08-14 16:24:14 -07:00
test_gemini.py feat(vertex_ai.py): support parsing thinking content into gemini format 2025-08-30 18:49:34 -07:00
test_gpt4o_audio.py Add gemini audio input support + handle special tokens in sagemaker response (#9640) 2025-03-29 19:23:09 -07:00
test_groq.py [Feat] Support reasoning_effort in Groq (#14207) 2025-09-03 10:43:47 -07:00
test_huggingface_chat_completion.py Revert "Revert "fix tests (#12286)"" 2025-07-03 12:08:27 -07:00
test_hyperbolic.py Revert "Litellm dev 07 21 2025 p1 (#12848)" 2025-07-22 18:28:36 -07:00
test_infinity.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_jina_ai.py
test_lambda_ai.py [Performance] Use O(1) Set lookups for model routing (#13879) 2025-08-21 22:56:46 -07:00
test_litellm_proxy_provider.py [Bug Fix] image_edit() function returns APIConnectionError with litellm_proxy - Support for both image edits and image generations (#13735) 2025-08-18 18:26:32 -07:00
test_mistral_api.py test: reduce mistral direct tests b/c of rate limit errors 2025-08-23 11:15:03 -07:00
test_morph.py fix morph api tests 2025-07-22 18:44:44 -07:00
test_nvidia_nim.py [Feat] Add tools support for Nvidia NIM (#10763) 2025-05-12 14:07:35 -07:00
test_openai_o1.py test: remove o1-preview 2025-07-28 17:47:57 -07:00
test_openai_realtime.py [LLM Translation] Fix Realtime API endpoint for no intent (#13476) 2025-08-14 16:24:14 -07:00
test_openai.py [Feat]Add support for safety_identifier parameter in chat.completions.create (#14174) 2025-09-02 09:37:08 -07:00
test_openrouter.py test_completion_openrouter_reasoning_content 2025-08-30 09:27:37 -07:00
test_optional_params.py fix: resolve invalid model name error for Gemini Imagen models (#13851) 2025-08-27 04:17:35 +02:00
test_perplexity_reasoning.py [Feat] Add reasoning_effort support for perplexity models (#11562) 2025-06-09 17:07:31 -07:00
test_prompt_caching.py
test_prompt_factory.py Add DBRX Anthropic w/ thinking + response_format support (#9744) 2025-04-04 22:13:32 -07:00
test_rerank.py test: update tests to new deployment model (#10142) 2025-04-18 14:22:12 -07:00
test_router_llm_translation_tests.py test_prompt_caching 2025-02-26 09:29:15 -08:00
test_snowflake.py ruff check ./litellm --fix 2025-07-12 11:04:02 -07:00
test_text_completion_unit_tests.py test: fixes 2025-05-31 12:42:56 -07:00
test_text_completion.py Add inference providers support for Hugging Face (#8258) (#9738) (#9773) 2025-04-05 10:50:15 -07:00
test_together_ai.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_triton.py fix(triton/completion/transformation.py): remove bad_words / stop wor… (#10163) 2025-04-19 11:23:37 -07:00
test_unit_test_bedrock_invoke.py Litellm staging 05 10 2025 - openai pdf url support + sagemaker chat content length error fix (#10724) 2025-05-10 17:41:57 -07:00
test_v0.py feat: add v0 provider support (#12751) 2025-07-18 18:26:44 -07:00
test_voyage_ai.py Add support for voyage-context-3 embedding model 2025-08-22 00:15:12 +05:30
test_watsonx.py Support env var vertex credentials for passthrough + ignore space id on watsonx deployment (throws Json validation errors) (#11527) 2025-06-07 20:31:05 -07:00
test_xai.py [Bug]: grok-4 does not support frequency_penalty, litellm should drop this param for grok-4 (#14078) 2025-08-29 17:31:48 -07:00

Unit tests for individual LLM providers.

Name of the test file is the name of the LLM provider - e.g. test_openai.py is for OpenAI.