litellm/litellm
Ryan Crabbe 81be07aaeb fix: remove StreamingResponse monkey-patch, bump uvicorn >=0.32.1
Uvicorn 0.31.x falsely advertised ASGI spec_version "2.4" without
implementing send() raising OSError on disconnect. Starlette trusted
this and skipped its disconnect listener, causing generators to run
forever. Uvicorn 0.32.1 corrected this to "2.3", restoring native
disconnect detection. The monkey-patch is no longer needed.

Also adds fallback_response cleanup in stream_with_fallbacks and
moves inline import anyio to module level in streaming_handler.
2026-02-14 16:24:40 -08:00
..
a2a_protocol fix(mypy): resolve type checking errors in 5 files (#20627) 2026-02-06 18:34:55 -08:00
anthropic_interface
assistants
batch_completion fix(batch_completion): submit all model futures before waiting (#20705) 2026-02-11 15:44:37 +05:30
batches Fix: LoggingWorker Missing Azure Credentials When Fetching 2026-02-13 13:05:49 +05:30
caching fix(cache): prevent DualCache async batch check-then-act race (#20986) 2026-02-13 18:32:41 +05:30
completion_extras fix openai tests 2026-02-12 17:53:47 -08:00
containers
endpoints/speech/speech_to_completion_bridge
experimental_mcp_client fix(mcp): resolve OAuth2 'Capabilities: none' bug for upstream MCP servers (#20602) 2026-02-06 15:00:35 -08:00
files
fine_tuning
google_genai
images
integrations Guardrails - new Policy Templates (pre-configured guardrail combinations for specific use-cases) (#21025) 2026-02-13 11:53:02 -08:00
interactions
litellm_core_utils fix: remove StreamingResponse monkey-patch, bump uvicorn >=0.32.1 2026-02-14 16:24:40 -08:00
llms revert: remove unrelated timeout default change 2026-02-14 15:05:37 -08:00
ocr
passthrough
proxy fix: remove StreamingResponse monkey-patch, bump uvicorn >=0.32.1 2026-02-14 16:24:40 -08:00
proxy_auth Fix mypy issues 2026-02-05 09:44:05 +05:30
rag fix(ci): Fix ruff lint error - unused import in vertex_ai_ingestion (#21178) 2026-02-13 18:14:23 -08:00
realtime_api [Feat] Add xAI /realtime API Support - works with LiveKitSDK (#20381) 2026-02-03 19:58:28 -08:00
rerank_api
responses fix(ci): Fix mypy type errors across 6 files (#21179) 2026-02-13 18:14:43 -08:00
router_strategy fix(router): remove repeated provider parsing in budget limiter hot path (#21043) 2026-02-12 20:05:55 -08:00
router_utils feat: add support for anthropic_messages call type in prompt caching (#19233) 2026-02-07 22:51:06 -08:00
search
secret_managers Fix authorization issues, same alias; verified working 2026-02-05 14:14:20 +05:30
skills
types Add pipeline flow builder UI for guardrail policies (#21188) 2026-02-13 20:06:03 -08:00
vector_store_files
vector_stores
videos
__init__.py Add support sync with remote URL for beta headers 2026-02-13 15:49:42 +05:30
_lazy_imports_registry.py fix: remove duplicate PerplexityResponsesConfig from LLM_CONFIG_NAMES (#21105) 2026-02-13 08:38:50 -08:00
_lazy_imports.py
_logging.py fix:Parse embedded JSON in the message field of logs (#20366) 2026-02-10 16:13:33 +05:30
_redis.py
_service_logger.py
_uuid.py
_version.py
anthropic_beta_headers_config.json Merge branch 'main' into litellm_litellm_anthropic_remote_url3 2026-02-13 18:40:00 +05:30
anthropic_beta_headers_manager.py Add support sync with remote URL for beta headers 2026-02-13 15:49:42 +05:30
budget_manager.py
constants.py feat(bedrock): add support for 4 new beta models (#20974) 2026-02-13 18:32:12 +05:30
cost_calculator.py perf: guard debug log f-strings and remove redundant dict copy in hot path (#19961) 2026-02-07 10:40:29 -08:00
cost.json
exceptions.py
main.py feat(vertex_ai): preserve usageMetadata in _hidden_params (#20559) 2026-02-12 20:44:59 -08:00
model_prices_and_context_window_backup.json feat(bedrock): add support for 4 new beta models (#20974) 2026-02-13 18:32:12 +05:30
mypy.ini
policy_templates_backup.json Guardrails - new Policy Templates (pre-configured guardrail combinations for specific use-cases) (#21025) 2026-02-13 11:53:02 -08:00
py.typed
router.py fix: remove StreamingResponse monkey-patch, bump uvicorn >=0.32.1 2026-02-14 16:24:40 -08:00
scheduler.py fix(scheduler): remove orphan entries from queue - causing memory leak. (#20866) 2026-02-10 22:34:52 -08:00
timeout.py
utils.py Merge branch 'main' into litellm_oss_staging_02_11_2026 2026-02-12 20:04:46 +05:30