Krrish Dholakia
9ed83d44e3
test: remove unnecessary test
2025-09-29 13:35:34 -07:00
Krrish Dholakia
df828718c5
feat(user_api_key_auth_mcp.py): correctly dereference mcp server name from ids
2025-09-29 13:30:37 -07:00
Sameer Kankute
3ab1c31e4e
(Feat) Add cost tracking for Vertex AI Passthrough /predict endpoint ( #15019 )
...
* Add cost tracking for passthrough for predict endpoint
* restore file
2025-09-29 13:19:04 -07:00
Krrish Dholakia
bc6e6e7a28
fix(auth_checks.py): add auth checks to mcp server on call tools
2025-09-29 13:13:10 -07:00
Ishaan Jaff
038863a1fe
[Feat] Add new claude-sonnet-4-5 model family ( #15041 )
...
* add new claude-sonnet-4-5
* docs fix
* fix tool_use_system_prompt_tokens
* add anthropic.claude-sonnet-4-5-20250929 to bedrock converse models
2025-09-29 13:09:00 -07:00
Cedar Myers
5357b1e102
fix: remove invalid vertex -latest models
2025-09-29 16:04:33 -04:00
Ishaan Jaff
4dc23e8079
Revert "feat: improve vertex AI/gemini api_base handling for proxy services (…" ( #15042 )
...
This reverts commit ff2d19e4ca
2025-09-29 13:03:46 -07:00
Krrish Dholakia
a9dcb51d03
fix: add lint
2025-09-29 12:28:43 -07:00
Zero Clover
ff2d19e4ca
feat: improve vertex AI/gemini api_base handling for proxy services ( #15039 )
2025-09-29 12:12:32 -07:00
Shubham Pathak
3f312d0527
Added test
2025-09-29 21:43:31 +05:30
Henry Wang
4e5db9476c
fix mypy type check issues
2025-09-29 23:11:49 +08:00
Henry Wang
0c1104fbe0
fix(lint): Resolve F821 Undefined name errors in litellm/main.py
2025-09-29 22:42:09 +08:00
Ihsan Soydemir
a44b9ebb3c
fix(files): use extra_query for GET/DELETE in Files endpoints
2025-09-29 14:07:18 +02:00
Kowyo
858f557bce
docs: use docker compose instead of docker-compose
2025-09-29 11:59:53 +00:00
Sameerlite
58955a0348
Ignore type param for gemini tools
2025-09-29 16:32:21 +05:30
Henry Wang
99a884019b
test(gemini): Add unit tests for Google GenAI adapter
...
This commit adds a comprehensive suite of unit tests for the Google GenAI adapter to ensure compliance with the project's contribution guidelines.
The new tests cover four main areas:
- Request parameter translation
- Streaming response handling
- Router methods for Google GenAI
- Proxy endpoints for Google GenAI
Additionally, this commit includes minor formatting and linting fixes identified during development.
2025-09-29 18:51:35 +08:00
anthony-liner
9ca73d5504
fix: set usage_details.total in langfuse integration
2025-09-29 16:30:44 +09:00
Shubham Pathak
b8195f091b
Fixed formatting
2025-09-29 12:19:00 +05:30
Shubham Pathak
acdf9b64d9
Update request handling for original exceptions
2025-09-29 12:04:44 +05:30
shagunb-acn
11084868a3
Merge branch 'BerriAI:main' into bugfix-14404-image-gen-azure-managed-identity
2025-09-29 09:55:17 +05:30
Krish Dholakia
0d738b2899
Merge pull request #14986 from uc4w6c/fix/remove-servername-prefix-mcp_tools-tests
...
Fix/remove servername prefix mcp tools tests
2025-09-28 18:00:23 -07:00
Krish Dholakia
e7939b0521
Merge pull request #14983 from abhijitjavelin/main
...
Feat: Add Javelin standalone guardrails integration for LiteLLM Proxy
2025-09-28 17:59:07 -07:00
Krish Dholakia
0995b335ca
Merge pull request #15004 from BerriAI/cursor/update-litellm-docs-from-latest-release-d2ca
...
Update litellm docs from latest release
2025-09-28 17:57:47 -07:00
Krish Dholakia
b68510275b
Merge pull request #15005 from jpetrucciani/pop_atranscription
...
fix passthrough of atranscription into kwargs going to upstream provider
2025-09-28 17:57:00 -07:00
Krrish Dholakia
5d8e1c4409
fix: fix tests
2025-09-28 17:55:51 -07:00
Krrish Dholakia
f32b0364c4
fix: fix tests
2025-09-28 17:55:46 -07:00
Krish Dholakia
7454e5a118
Merge pull request #15008 from wenxi-onyx/add-ollama-cloud-models
...
feat: add ollama cloud models
2025-09-28 17:49:22 -07:00
Krish Dholakia
ddb81a6883
Merge pull request #15010 from eycjur/fix_vllm_audio_transcription_json_format
...
[Fix] response_format bug in hosted vllm audio_transcription
2025-09-28 17:47:15 -07:00
Krrish Dholakia
ba5cc5a5b3
fix: fix linting errors
2025-09-28 17:45:04 -07:00
eycjur
070094c739
Set the response_format as it is
2025-09-29 08:11:24 +09:00
Yuta Saito
be5010a675
test: fix tests
2025-09-29 07:21:32 +09:00
Yuta Saito
4f15d1240e
fix: resolve linting errors
2025-09-29 07:13:20 +09:00
Yuta Saito
dae7d08ff2
Revert "Revert "Merge pull request #14720 from uc4w6c/feat/remove-servername-prefix-mcp_tools""
...
This reverts commit a88d774f94
2025-09-29 07:12:24 +09:00
Wenxi Onyx
ad29d2f944
add models served from ollama cloud
2025-09-28 14:06:08 -07:00
Wenxi Onyx
4adb854e51
add models served from ollama cloud
2025-09-28 13:20:35 -07:00
Abhijit L
feac008331
fix: format
2025-09-28 23:52:44 +05:30
Abhijit L
9122614dbe
fix: make it discoverable on ui
2025-09-28 23:49:20 +05:30
TobiMayr
3c99d2236a
feature/add max requests env var
2025-09-28 19:18:56 +01:00
jacobi petrucciani
6249f4efa5
fix passthrough of atranscription into kwargs going to upstream provider
2025-09-28 12:46:43 -04:00
Cursor Agent
c684a18e38
feat: Add OAuth2 auth and scheduled key rotation
...
Co-authored-by: teddy <teddy@berri.ai>
2025-09-28 16:39:35 +00:00
Krrish Dholakia
208cd5fcb5
bump: version 1.77.5 → 1.77.6
2025-09-28 09:27:08 -07:00
Krish Dholakia
c328b4a036
Merge pull request #15002 from BerriAI/litellm_dev_09_27_2025_p3
...
MCP - specify forwardable headers, specify allowed/disallowed tools for MCP servers
2025-09-28 09:21:52 -07:00
Krrish Dholakia
433624706e
fix: fix linting errors
2025-09-28 09:18:02 -07:00
Krish Dholakia
cd4b05f61d
Merge pull request #14997 from eycjur/fix_azure_batch
...
[Fix] Use the `extra_query` parameter for GET requests in Azure Batch
2025-09-28 09:13:07 -07:00
Krish Dholakia
1257033e27
Merge pull request #14998 from herve-ves/fix_ui_blank_litellm_model_name_field
...
[Fix] Fix LiteLLM model name fallback in dashboard overview
2025-09-28 09:12:08 -07:00
Krrish Dholakia
53d0cbb1b7
fix: update tests + logic for passing multiple headers
2025-09-28 09:09:11 -07:00
Krrish Dholakia
9403efa511
test: fix tests
2025-09-28 08:54:15 -07:00
Krrish Dholakia
1256dd53d9
test: update tests
2025-09-28 08:53:11 -07:00
Krrish Dholakia
e6810b5f87
docs(mcp.md): add allow/disallowed tools to docs
2025-09-28 08:50:40 -07:00
Henry Wang
b46407fa76
feat(gemini): Add full support for native Gemini API translation
...
This commit implements a complete, end-to-end fix for the native Gemini API translation feature, allowing requests to be correctly routed to other model providers via `model_group_alias`.
The original implementation was broken, causing `systemInstruction` and `tools` to be dropped from requests. This was resolved by refactoring the Gemini endpoint to use a dedicated translation path, similar to the Anthropic adapter.
Additionally, this commit hardens the streaming response adapter to correctly handle tool calls generated by the newly-fixed request path. Key improvements to the response handling include:
- Replaced the fragile `id`-based tool call tracking with a robust `index`-based accumulation logic.
- Fixed a memory leak and improved logging in the stream finalization process.
- Prevented empty, non-compliant chunks from being sent to the client during tool call streaming.
- Optimized the accumulator to skip and log superfluous empty chunks sent by some models.
2025-09-28 21:01:31 +08:00
