Commit Graph

31845 Commits

Author SHA1 Message Date
Sameer Kankute
29e6efade9 Add inference_geo as supported messages param 2026-02-09 10:57:04 +05:30
Sameer Kankute
20440bcadc Add inference based costing 2026-02-09 10:51:50 +05:30
Sameer Kankute
3307f3d1c6 Add inference_geo as supported messages param 2026-02-09 10:47:13 +05:30
Sameer Kankute
d41df6053a Add all new feat for v1/messages 2026-02-09 10:35:11 +05:30
Sameer Kankute
8cd8a01d5a Add compaction for vertex ai 2026-02-09 10:18:19 +05:30
Varun Chawla
4f96a3b126
Fix Bedrock Claude Opus 4.6 model ID format (#20671)
Remove incorrect `:0` suffix from regional Bedrock model identifiers:
- us.anthropic.claude-opus-4-6-v1:0 → us.anthropic.claude-opus-4-6-v1
- au.anthropic.claude-opus-4-6-v1:0 (duplicate removed)

The `:0` suffix is invalid for Bedrock inference profile ARNs and causes
"The provided model identifier is invalid" errors when calling the model.

Fixes #20562
2026-02-07 22:57:59 -08:00
Iver Jordal
de11c3258b
Correct ElevenLabs support status in README (#20643)
Add a missing check symbol for /audio/transcriptions, which seems to be supported already, according to the docs at https://docs.litellm.ai/docs/providers/elevenlabs
2026-02-07 22:29:07 -08:00
yuneng-jiang
fb9f997dc1
Merge pull request #20687 from BerriAI/litellm_ui_minor_issues
[Refactor] AntD refactoring and 0 cost models fix
2026-02-07 18:09:04 -08:00
yuneng-jiang
7798d52cd4 truncate filter options 2026-02-07 18:04:35 -08:00
yuneng-jiang
53cf43dff6 fallback to team id and truncate 2026-02-07 18:04:10 -08:00
yuneng-jiang
5dd84df215
Merge pull request #20682 from BerriAI/litellm_avail_teams
[Fix] UI - Teams: Available Teams
2026-02-07 17:58:25 -08:00
ryan-crabbe
f39c1e9045
docs: add middleware performance blog post (#20677)
* docs: add middleware performance blog post

* docs: add Krrish, Ishaan, and author details to middleware blog post
2026-02-07 17:36:53 -08:00
yuneng-jiang
6fad659ae2 Migrate to antd + fix cost to 0 costs models 2026-02-07 17:28:55 -08:00
ryan-crabbe
94db421e67
docs: add callback registration optimization to v1.81.9 release notes (#20681)
* docs: add callback registration optimization to v1.81.9 release notes

* Update v1.81.9.md

---------

Co-authored-by: Alexsander Hamir <alexsanderhamirgomesbaptista@gmail.com>
2026-02-07 17:09:45 -08:00
yuneng-jiang
78f28d7c30 adding test 2026-02-07 16:46:11 -08:00
yuneng-jiang
70ebdeec8b modernize /team/available endpoint, migrate link to UI 2026-02-07 16:44:29 -08:00
yuneng-jiang
5a084cef41
Merge pull request #20657 from BerriAI/litellm_ui_logs_request
[Fix] UI - Logs: Input and Output Copying
2026-02-07 16:19:32 -08:00
yuneng-jiang
9fd887b843
Merge pull request #20678 from BerriAI/litellm_ui_refactor_05
[Refactor] Add knip and removed some unused files
2026-02-07 16:06:31 -08:00
Ishaan Jaffer
d8528fbfdb docs fix 2026-02-07 16:00:28 -08:00
Ishaan Jaffer
02cfc87bdb fidocs fix 2026-02-07 15:58:13 -08:00
yuneng-jiang
54828e3783 add knip as a dev dependency, remove some unused files 2026-02-07 15:51:21 -08:00
Alexsander Hamir
5de7fe2897
docs: add LiteLLM Observatory section to v1.81.9 release notes (#20675)
- Add paragraph on release validation, extensibility, and 100% coverage goal
- Include OOMs and CPU regressions as issues surfaced under sustained load
2026-02-07 15:24:15 -08:00
yuneng-jiang
394946f02c
Merge pull request #20676 from BerriAI/docs_yj_feb7
[Docs] Reorganize Admin UI Subsection
2026-02-07 15:21:11 -08:00
yuneng-jiang
0531254899 reorganize admin UI docs 2026-02-07 15:20:24 -08:00
yuneng-jiang
a23ba746e4
Merge pull request #20674 from BerriAI/docs_yj_feb7
[Docs] UI Contributing and Troubleshooting
2026-02-07 15:13:15 -08:00
yuneng-jiang
ea255e2bd0 UI contributing and trouble shooting docs 2026-02-07 15:11:49 -08:00
yuneng-jiang
c0627b7772
Merge pull request #20669 from BerriAI/docs_yj_feb7
[Docs] UI Team Soft Budget
2026-02-07 14:44:51 -08:00
yuneng-jiang
6e984122ba Adding to release notes + sidebar 2026-02-07 14:43:46 -08:00
yuneng-jiang
ca24f56b39 Merge remote-tracking branch 'origin' into docs_yj_feb7 2026-02-07 14:40:21 -08:00
Alexsander Hamir
0f7104f8a5
docs: polish LiteLLM Observatory blog post (#20670) 2026-02-07 14:35:28 -08:00
yuneng-jiang
5876441aa2 warning placement 2026-02-07 14:35:11 -08:00
yuneng-jiang
b29572cebc adjusting to add email integration prereq 2026-02-07 14:33:04 -08:00
yuneng-jiang
f7fbcefd26 UI team soft budget docs 2026-02-07 14:27:53 -08:00
Shivam Rawat
dd5c14baf8
posthog serilization fix (#20668) 2026-02-07 14:24:32 -08:00
Ishaan Jaffer
8bce48daa4 docs fix 2026-02-07 14:22:04 -08:00
Ishaan Jaff
caf51a4ca9
Litellm docs rc fixes (#20667)
* docs

* review 1

* docs fix

* docs

* docs fix

* docs
2026-02-07 13:32:15 -08:00
Krish Dholakia
d26878af70
fix: only show semantic tool filter warning when feature is configured (#20651)
The warning 'Semantic tool filter hook not initialized' was appearing on
every startup, even when the mcp_semantic_tool_filter feature was not
configured. This was confusing for users.

Now the function checks if the feature is actually configured and enabled
before proceeding with initialization. The warning will only appear if
the feature was explicitly enabled but failed to initialize.

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-02-07 13:17:13 -08:00
Ishaan Jaff
f2ba3cc6e1
[Docs] 1.81.9 stability (#20665)
* docs

* review 1

* docs fix
2026-02-07 13:15:23 -08:00
Ishaan Jaffer
a09d3e9162 _route_user_config_request fix 2026-02-07 12:30:58 -08:00
Ishaan Jaffer
272bd703a4 fix test 2026-02-07 12:25:40 -08:00
shin-bot-litellm
5fb7644d8e
fix(proxy): only create Router when models or search_tools exist (#20661)
Previously, PR #19818 (via #20205) removed the model_list check entirely,
causing Router to be created even with no models AND no search_tools.

This fix adds back a conditional check that creates the Router only when:
- There are models to route, OR
- There are search_tools configured

This preserves the PR #19818 goal (search-tools-only deployments) while
avoiding unnecessary Router creation when there's nothing to route.

Fixes test_add_and_delete_deployments[0-None]
2026-02-07 12:18:45 -08:00
Ishaan Jaffer
b6a75a1085 fix scans 2026-02-07 12:12:44 -08:00
Ishaan Jaffer
ef5579c636 bump v 2026-02-07 12:02:16 -08:00
Ishaan Jaff
14e2714162
Revert "perf: skip enterprise callback check when no dynamic disabling config…" (#20659)
This reverts commit ffc6af3f2f.
2026-02-07 11:52:07 -08:00
yuneng-jiang
73ddab2b46 fix input and output copying 2026-02-07 11:35:50 -08:00
shin-bot-litellm
1477b4b46b
fix(tests): Add missing mocks for MCP IP filtering and updated APIs (#20652)
Fixes 15 failing tests in the MCP test suite:

1. **OAuth discoverable endpoints** (test_discoverable_endpoints.py):
   - Added autouse fixture to mock IPAddressUtils.get_mcp_client_ip
   - This bypasses IP-based access control which was blocking server lookup
   - Fixes: test_authorize_*, test_token_*, test_oauth_*, test_register_*

2. **A2A endpoints** (test_a2a_endpoints.py):
   - Fixed mock path for add_litellm_data_to_request
   - Was patching litellm_pre_call_utils but function is called from common_request_processing

3. **MCP guardrail handler** (test_mcp_guardrail_handler.py):
   - Updated tests to match new handler behavior
   - Handler now passes tools (not texts) to guardrail
   - Handler checks for mcp_tool_name (not messages array)

4. **MCP path-based segregation** (test_user_api_key_auth_mcp.py):
   - Added client_ip to get_auth_context unpacking (7 values now)
   - get_auth_context was updated to include client_ip

5. **MCP registry** (test_mcp_management_endpoints.py):
   - Added mock for get_filtered_registry (not just get_registry)
   - Registry endpoint uses get_filtered_registry for IP filtering

Co-authored-by: Shin <shin@openclaw.ai>
2026-02-07 11:30:49 -08:00
Ishaan Jaffer
ef66a6cb62 fix security scans 2026-02-07 11:15:02 -08:00
ryan-crabbe
ffc6af3f2f
perf: skip enterprise callback check when no dynamic disabling configured (#20449)
Add cheap .get() guards in should_run_callback() to short-circuit
the expensive EnterpriseCallbackControls.is_callback_disabled_dynamically()
call. When neither litellm_disabled_callbacks nor x-litellm-disable-callbacks
header is set (the common case), the enterprise function is never entered,
reducing should_run_callback from ~485ms to ~93-165ms across 54k calls.
2026-02-07 11:12:47 -08:00
yuneng-jiang
fe30e8a7d0
Merge pull request #20653 from BerriAI/litellm_deleted_table_soft_budget
[Infra] Deleted Teams Table soft_budget
2026-02-07 11:12:15 -08:00
yuneng-jiang
5f680faa48 adding build files 2026-02-07 11:07:45 -08:00