Commit Graph

30881 Commits

Author SHA1 Message Date
Krrish Dholakia
ecb6c0e814 fix(mcp_server_manager.py): ensure only allowed params sent to MCP server 2025-10-08 16:37:50 -07:00
Krrish Dholakia
dd4249db78 feat(mcp_server_manager.py): initial commit adding allowed params support
allow admin to specify which parameters to allow/disallow by MCP tool
2025-10-08 16:27:01 -07:00
Krish Dholakia
5c6fb5eb29
Merge pull request #15309 from BerriAI/litellm_cookie_spasm_mitigation
potentially fixes a UI spasm issue with an expired cookie
2025-10-08 16:13:38 -07:00
Krrish Dholakia
cd13e533a2 feat(mcp_server_manager.py): expand allowed/disallowed list 2025-10-08 16:06:17 -07:00
Krrish Dholakia
28698933fc feat(mcp_server_manager.py): ensure list tools for openapi servers works as expected 2025-10-08 15:59:42 -07:00
Ishaan Jaff
1c56a0d856
[Fix] Watsonx - Apply correct prompt templates for openai/gpt-oss model family (#15341)
* fix: apply_prompt_template

* Revert "fix: apply_prompt_template"

This reverts commit 3e0e40b497.

* add apply_prompt_template for WatsonX

* feat: add apply_prompt_template

* test_watsonx_gpt_oss_prompt_transformation

* Revert "add apply_prompt_template for WatsonX"

This reverts commit 3e80903796e39d4fe7206d63445e024c3ad8d0c4.

* add apply_prompt_template for WatsonX

* fix apply_prompt_template

* fix: add hf template handler

* fix hf_chat_template

* fix _get_tokenizer_config

* fix hf_chat_template

* add WatsonXModelPattern

* fix aapply_prompt_template
2025-10-08 15:39:36 -07:00
Krrish Dholakia
1c317a35af feat(mcp/): initial working list tools for openapi spec mcp tools 2025-10-08 15:32:31 -07:00
Krrish Dholakia
ff893cce42 feat(mcp_server_manager.py): working call tools for openapi to mcp servers 2025-10-08 15:31:52 -07:00
Krrish Dholakia
386468ad77 feat: initial commit for openapi to mcp conversion
allows users to give openapi spec for a server, and litellm to serve it as an mcp
2025-10-08 15:27:48 -07:00
Achintya Rajan
dceaf2f0f1 eliminates recursion for an explicit stack 2025-10-08 15:00:52 -07:00
Achintya Rajan
ce8a520a86 new deep merge behavior when processing config 2025-10-08 14:41:41 -07:00
Achintya Rajan
fe2d4addfa Update CreateKeyPage.expiredToken.test.tsx 2025-10-08 14:10:09 -07:00
Ishaan Jaffer
9d84a7cc8b Revert "fix: apply_prompt_template"
This reverts commit 3e0e40b497.
2025-10-08 13:56:47 -07:00
Ishaan Jaffer
3e0e40b497 fix: apply_prompt_template 2025-10-08 13:56:25 -07:00
Felipe Garé
f12b8bf2c1
feat(files): add @client decorator to file operations (#15339)
- Decorate sync/async file APIs (retrieve, delete, list, content) with @client
- Ensures calls route through the configured client, honoring provider/client config
- Standardizes behavior across file endpoints and aligns with existing patterns
- No API signature changes; improves consistency and client-bound usage
2025-10-08 13:42:34 -07:00
Achintya Rajan
d6852b11ae Create CreateKeyPage.expiredToken.test.tsx 2025-10-08 13:41:00 -07:00
Krrish Dholakia
45ec1ffdaa fix(ui/): set is sso modal visible to true for all users
allow backend to handle more complex state management
2025-10-08 13:13:21 -07:00
Achintya Rajan
7595acff42 empty commit for CI/CD 2025-10-08 12:03:44 -07:00
Sameer Kankute
0b6b69cd5b
fix issue with parsing assistant messages (#15320)
* Update factory.py

* reinclude the test cases

* fixed test

---------

Co-authored-by: Weijie <weijie-tan3@github.com>
2025-10-08 09:49:02 -07:00
Sameer Kankute
85d4142845 Fix litellm_param based costing 2025-10-08 21:14:23 +05:30
IQHL (Hans Jacob Landelius)
6633b33085 formatting 2025-10-08 14:15:15 +02:00
IQHL (Hans Jacob Landelius)
5b9d516e43 unit test 2025-10-08 13:58:25 +02:00
IQHL (Hans Jacob Landelius)
5a1b6fe1a6 Do not cooldown deployment if exception_status is empty string 2025-10-08 10:55:08 +02:00
Tim Elfrink
f8af72bbf1 fix: redact AWS credentials when redact_user_api_key_info enabled
Use SensitiveDataMasker in print_deployment() to mask all sensitive
credentials including AWS keys when redact_user_api_key_info is True.

Fixes #14839
2025-10-08 10:31:35 +02:00
Leslie Cheng
86affa405c Unused type 2025-10-07 21:11:56 -07:00
Leslie Cheng
f0c9dfbaf8 Add some tests 2025-10-07 20:57:08 -07:00
Leslie Cheng
1579752e06 Implement fix 2025-10-07 20:53:38 -07:00
Krish Dholakia
13703f289b
Merge pull request #15292 from timelfrink/fix/bedrock-prompt-caching-cost-calculation
fix(bedrock): include cacheWriteInputTokens in prompt_tokens calculation
2025-10-07 19:11:45 -07:00
Krish Dholakia
3f4d2c6ada
Add Cohere Embed v4 support for AWS Bedrock
Add Cohere Embed v4 support for AWS Bedrock
2025-10-07 19:10:22 -07:00
Krrish Dholakia
c671dceb24 feat(pass_through_endpoints.py): have updates not require pod restarts
ensures db updates work on live passthrough endpoints without requiring pod restarts
2025-10-07 19:03:32 -07:00
Ishaan Jaffer
5d6cd3ffed UI new build 2025-10-07 18:59:11 -07:00
Ishaan Jaffer
a8243079d3 doc fix 2025-10-07 18:51:27 -07:00
Ishaan Jaff
8a8cc5a1d3
[QA/Fixes] - Dynamic Rate Limiter v3 - final QA (#15311)
* fix: PriorityReservationSettings

* fix: use correct casting

* fix type casting
2025-10-07 18:42:17 -07:00
Krish Dholakia
1238464e20
Merge pull request #15303 from BerriAI/litellm_tenacity_upgrade
Upgrades tenacity version to 8.5.0
2025-10-07 18:19:52 -07:00
Krish Dholakia
60fb8cdb87
Merge pull request #15308 from BerriAI/litellm_models_page_crash_fix
fix: model + endpoints page crash when config file contains router_settings.model_group_alias
2025-10-07 18:19:15 -07:00
Achintya Rajan
4de4e4af1a Update page.tsx 2025-10-07 18:14:20 -07:00
Krrish Dholakia
032a213b9b feat(pass_through_endpoint.py): cleanup error message + validate it works across multiple instances 2025-10-07 18:04:44 -07:00
Krrish Dholakia
b4fc7d3cfa feat(pass_through_endpoints.py): raise 404 if passthrough endpoint has been deleted by the user
Ensures passthrough endpoint deletion works as expected (single-instance)
2025-10-07 17:58:15 -07:00
Ishaan Jaffer
7b82473bfb fix gpt-image-1-mini 2025-10-07 17:56:51 -07:00
Ishaan Jaffer
e1ab3620ee fix: mapped tests 2025-10-07 17:55:52 -07:00
Ishaan Jaffer
8590646b84 fix code QA check 2025-10-07 17:49:57 -07:00
Ishaan Jaffer
f2a96e6830 fix: e2eUI testing 2025-10-07 17:45:30 -07:00
Achintya Rajan
9fa8c6099e Update model_group_alias_settings.tsx 2025-10-07 17:42:04 -07:00
Ishaan Jaff
36c971a6fd
[MCP Gateway] QA/Fixes - Ensure Team/Key level enforcement works for MCPs (#15305)
* fix: _set_object_permission

* fix: _set_object_permission on teams

* fix: _set_object_permission

* fixes for team/key permissions

* statsh: object permission view

* fix: MCPServerPermissions

* fix: _get_team_object_permission

* test mcp checks for permissions

* fix server checks with prefix names

* test_list_tools_strips_prefix_when_matching_permissions

* ruff fix

* docs - refactor MCP

* docs update MCP docs

* docs allowed tools
2025-10-07 17:34:48 -07:00
Krrish Dholakia
6c4436215c feat(pass_through_endpoints.py): initial commit trying to delete passthrough endpoints successfully 2025-10-07 17:19:18 -07:00
Ishaan Jaff
7b56ba240e
[MCP Gateway] Litellm mcp fixes team control (#15304)
* fix: _set_object_permission

* fix: _set_object_permission on teams

* fix: _set_object_permission

* fixes for team/key permissions

* statsh: object permission view

* fix: MCPServerPermissions
2025-10-07 16:48:00 -07:00
Alexsander Hamir
49e04e0217
[Fix] Networking: remove limitations (#15302)
* fix: remove limitations

* fix: linter issues
2025-10-07 16:45:42 -07:00
Achintya Rajan
f72f21b261 Update requirements.txt 2025-10-07 16:18:48 -07:00
Ishaan Jaff
bc26eff98f
Fix: Make PATCH /model/{model_id}/update handle team_id consistently with POST /model/new (#15297)
* fix: _update_team_model_in_db

* test_patch_model_with_team_id_creates_proper_setup
2025-10-07 14:04:08 -07:00
Tim Elfrink
d71d801e4d Add Cohere Embed v4 support for AWS Bedrock
- Add cohere.embed-v4:0 to model pricing configs
- Update bedrock_embedding_models constant
- Update documentation with v4 model support

Fixes #15272
2025-10-07 22:08:12 +02:00