litellm/tests
Andrés 9768eca33e
fix(azure): add logprobs support for Azure OpenAI GPT-5.2 model (#18856)
* fix(azure): add logprobs support for Azure OpenAI GPT-5 models

Azure OpenAI GPT-5 models (including gpt-5.2) support logprobs
parameters, unlike OpenAI's GPT-5 reasoning models. This fix
overrides the parent class restriction to enable logprobs for Azure.

Changes:
- Override get_supported_openai_params() in AzureOpenAIGPT5Config
- Add "logprobs" and "top_logprobs" to supported params
- Add comprehensive tests for logprobs functionality

Testing:
- Verified with direct Azure API calls to gpt-5.2
- API version: 2025-01-01-preview
- Successfully returns logprobs data

Related: #7974, #4022

* refactor: restrict logprobs support to gpt-5.2 only

Only gpt-5.2 has been verified to support logprobs on Azure.
Other gpt-5 variants (gpt-5, gpt-5.1) have not been tested.

Changes:
- Add conditional check for is_model_gpt_5_2_model()
- Update tests to be specific to gpt-5.2
- Add negative tests for gpt-5 and gpt-5.1
- Update documentation to reflect gpt-5.2 specificity
2026-01-09 22:57:50 +05:30
..
agent_tests Fix CI: Revert security scan changes and add GitGuardian ignore rules (#18358) 2025-12-22 17:03:53 -08:00
audio_tests [Feat] New provider TTS - Add AWS polly API for TTS (#18326) 2025-12-22 18:19:34 +05:30
basic_proxy_startup_tests
batches_tests
code_coverage_tests Litellm improve endpoint discovery (#18762) 2026-01-07 17:35:01 +05:30
documentation_tests
enterprise Revert "feat: Add built-in migration lock to prevent concurrent Prisma migrat…" (#18719) 2026-01-06 23:56:02 +05:30
guardrails_tests
image_gen_tests TestAzureAIFlux2ImageEdit 2026-01-08 18:23:05 +05:30
litellm Merge pull request #18833 from BerriAI/litellm_staging_01_08_2026 2026-01-09 17:04:29 +05:30
litellm_utils_tests Potential fix for code scanning alert no. 3954: Clear-text logging of sensitive information 2026-01-05 16:06:10 +05:30
litellm-proxy-extras Revert "feat: Add built-in migration lock to prevent concurrent Prisma migrat…" (#18719) 2026-01-06 23:56:02 +05:30
llm_responses_api_testing responses API fixes 2026-01-08 19:16:23 +05:30
llm_translation Merge pull request #18250 from sjmatta/claude/fix-issue-17910-QBgDq 2026-01-09 17:30:51 +05:30
load_tests
local_testing Litellm embeddings calltype fix for guardrail precallhook (#18740) 2026-01-07 21:40:36 +05:30
logging_callback_tests test_completion_claude_3_function_call_with_otel 2026-01-07 14:22:54 +05:30
mcp_tests feat: add UI support for configuring meta URLs 2026-01-02 15:07:37 +09:00
multi_instance_e2e_tests
ocr_tests
old_proxy_tests/tests remove prompt caching headers as the support has been removed 2026-01-02 11:08:35 +05:30
openai_endpoints_tests
otel_tests
pass_through_tests test_anthropic_messages_to_wildcard_model 2026-01-07 15:03:06 +05:30
pass_through_unit_tests Fix CI: Revert security scan changes and add GitGuardian ignore rules (#18358) 2025-12-22 17:03:53 -08:00
proxy_admin_ui_tests
proxy_security_tests
proxy_unit_tests fix list keys 2026-01-07 14:34:37 +05:30
router_unit_tests test_routing_strategy_init 2026-01-07 14:21:03 +05:30
scim_tests
search_tests
spend_tracking_tests
store_model_in_db_tests fix: test mock 2026-01-02 17:38:52 +09:00
test_litellm fix(azure): add logprobs support for Azure OpenAI GPT-5.2 model (#18856) 2026-01-09 22:57:50 +05:30
unified_google_tests [Feat] Interactions API - allow using all litellm providers (interactions -> responses api bridge) (#18373) 2025-12-23 22:30:22 +05:30
vector_store_tests
windows_tests
__init__.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_budget_management.py
test_callbacks_on_proxy.py Fix CI: Revert security scan changes and add GitGuardian ignore rules (#18358) 2025-12-22 17:03:53 -08:00
test_config.py
test_debug_warning.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py
test_gpt5_azure_temperature_support.py
test_health.py
test_keys.py
test_litellm_proxy_responses_config.py
test_logging.conf
test_models.py
test_openai_endpoints.py
test_organizations.py
test_passthrough_endpoints.py
test_ratelimit.py
test_resource_cleanup.py
test_spend_logs.py Fix CI: Revert security scan changes and add GitGuardian ignore rules (#18358) 2025-12-22 17:03:53 -08:00
test_team_logging.py
test_team_members.py
test_team.py
test_users.py

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.