litellm/tests/llm_translation
2026-03-27 20:42:16 +05:30
..
fixtures
realtime [Fix] Update realtime websocket tests for websockets v15+ API 2026-03-12 14:40:48 -07:00
test_llm_response_utils fix(types): normalize null top_logprobs to [] in ChatCompletionTokenLogprob (#22245) 2026-02-28 15:59:29 -08:00
test_skills_data Remove Apache 2 license from SKILL.md (#22322) 2026-02-27 19:33:55 -08:00
test-skill
base_audio_transcription_unit_tests.py
base_embedding_unit_tests.py
base_llm_unit_tests.py Fix mistral ocr failing test 2026-03-09 11:29:33 +05:30
base_rerank_unit_tests.py
conftest.py [Fix] Restore unconditional importlib.reload for llm_translation conftest 2026-03-16 00:35:02 -07:00
dog.wav
duck.png
gettysburg.wav
guinea.png
log.xt
Readme.md
test_a2a.py
test_anthropic_completion.py fix(anthropic): strip undocumented keys from metadata before sending to API 2026-03-27 20:42:16 +05:30
test_aws_base_llm.py
test_azure_agents.py fix(azure-ai-agents): accumulate annotations from multiple text items in streaming 2026-03-18 09:04:00 +05:30
test_azure_ai.py
test_azure_o_series.py
test_azure_openai.py fix: support prompt_cache_key for OpenAI and Azure chat completions (#20989) 2026-02-11 12:25:29 -08:00
test_bedrock_agentcore.py
test_bedrock_agents.py
test_bedrock_anthropic_regression.py
test_bedrock_common_utils.py
test_bedrock_completion.py fix(tests): remove test_completion_bedrock_claude_sts_oidc_auth and test_completion_bedrock_httpx_command_r_sts_oidc_auth that depend on external infra 2026-03-13 11:53:53 -07:00
test_bedrock_dynamic_auth_params_unit_tests.py
test_bedrock_embedding.py
test_bedrock_govcloud.py
test_bedrock_gpt_oss.py
test_bedrock_invoke_tests.py [Release Fix] (#22411) 2026-02-28 09:46:35 -08:00
test_bedrock_llama.py
test_bedrock_moonshot.py
test_bedrock_nova_embedding.py fix(cost-calc): use per-image pricing for Bedrock multimodal embeddings (#21646) 2026-02-20 08:51:21 -08:00
test_bedrock_nova_json.py
test_clarifai_completion.py
test_cloudflare.py
test_cohere.py Revert "Fix xdist test isolation: capture true defaults and poll instead of sleep" 2026-03-15 22:57:39 -07:00
test_containers_api.py
test_convert_dict_to_image.py
test_databricks.py
test_deepgram.py
test_deepseek_completion.py
test_elevenlabs.py
test_evals_api.py fix(tests): add flaky retries to flaky CI tests (#21795) 2026-02-21 11:56:29 -08:00
test_fireworks_ai_translation.py fix(fireworks): skip #transform=inline for base64 data URLs (#23729) 2026-03-16 22:30:18 -07:00
test_gemini_image_usage.py fix(gemini): resolve image token undercounting in usage metadata (#22608) 2026-03-04 18:52:08 -08:00
test_gemini.py Fix flaky test_gemini_image_generation_async by removing non-deterministic content assertion 2026-03-15 17:58:00 -07:00
test_gigachat.py
test_gpt4o_audio.py
test_groq.py
test_hosted_vllm_embedding_e2e.py move e2e to llm translation 2026-02-17 22:33:13 +05:30
test_huggingface_chat_completion.py
test_hyperbolic.py
test_infinity.py
test_jina_ai.py
test_lambda_ai.py
test_langgraph.py
test_litellm_proxy_provider.py
test_minimax_tts.py
test_mistral_api.py
test_model_cost_map_resilience.py
test_morph.py
test_nvidia_nim.py
test_openai_o1.py fix(tests): update outdated model names in o1 and gemini tests 2026-03-12 22:50:52 -07:00
test_openai.py Fix _supports_reasoning_effort_level for responses bridge 2026-03-13 13:29:39 +05:30
test_openrouter.py fix(test): update openrouter image generation assertion for gemini-2.5-flash-image (#23070) 2026-03-07 16:52:04 -08:00
test_optional_params.py fix(tests): update outdated model names in o1 and gemini tests 2026-03-12 22:50:52 -07:00
test_perplexity_reasoning.py
test_prompt_caching.py
test_prompt_factory.py fix(prompting): preserve separator for assistant(tc)->assistant edge case 2026-03-18 17:13:42 +05:30
test_replicate.py
test_rerank.py
test_router_llm_translation_tests.py fix(tests): move test_router_azure_acompletion to llm_translation testing (#21837) 2026-02-21 14:41:53 -08:00
test_sambanova_chat_transformation.py
test_skills_api.py Reapply "feat: add model_cost aliases expansion support" 2026-03-12 13:36:57 -03:00
test_skills_e2e.py
test_snowflake.py
test_text_completion_unit_tests.py
test_text_completion.py
test_together_ai.py
test_triton.py
test_unit_test_bedrock_invoke.py
test_v0.py
test_voyage_ai.py
test_watsonx.py
test_xai.py Fix usage in xai 2026-02-19 18:48:30 +05:30

Unit tests for individual LLM providers.

Name of the test file is the name of the LLM provider - e.g. test_openai.py is for OpenAI.