Eddie Richter
1e1e4c36ac
Fixing key name
2025-09-30 12:12:24 -06:00
Eddie Richter
bbfa00c61b
fixing mypy lint errors
2025-09-30 12:12:24 -06:00
Eddie Richter
3d62596daa
fix lint-ruff
2025-09-30 12:12:24 -06:00
Eddie Richter
abaf77da43
Small updates to documentation
2025-09-30 12:12:24 -06:00
Eddie Richter
929510ef5d
Adding unit tests and documentation
2025-09-30 12:12:24 -06:00
Eddie Richter
6916f43843
Adding functionality for Lemonade to check to see if it is aware of a model and if so use that model
2025-09-30 12:12:24 -06:00
Eddie Richter
351b63bc67
Adding max_tokens to constructor of LemonadeChatConfig
2025-09-30 12:12:24 -06:00
Eddie Richter
f9e98f75a6
Adding max_input_tokens and max_output_tokens
2025-09-30 12:12:24 -06:00
Eddie Richter
0e045e0bb7
Setting the response model so the cost can be calculated
2025-09-30 12:12:24 -06:00
Eddie Richter
eb71611a97
Adding lemonade transform
2025-09-30 12:12:24 -06:00
Eddie Richter
ae92404d05
Initial addition of Lemonade provider.
2025-09-30 12:12:24 -06:00
Henry Wang
cb8194c22b
Fix Google GenAI types import to handle missing google.genai module
2025-10-01 01:56:52 +08:00
Jack Temple
7212116d8c
test: add UI theme settings retrieval and update tests
2025-09-30 10:01:44 -05:00
Jack Temple
382614911f
fix: make /get/ui_theme_settings public for all users to access custom branding
2025-09-30 09:23:23 -05:00
João Speglich
7ec6a3684a
oci: undo stop crop
2025-09-30 10:46:14 -03:00
Kowyo
eecb2ba77a
fix: add 'think' parameter handling in ollama_chat.py
2025-09-30 12:46:22 +00:00
Henry Wang
fcd539af33
fix the issue from the tests for pr review
2025-09-30 18:15:25 +08:00
Henry Wang
cce05ac2b4
fix test issues from pr review
2025-09-30 16:44:15 +08:00
Henry Wang
d838c96ffb
fix test issues from pr review
2025-09-30 16:05:17 +08:00
shagunb-acn
66731139b4
Merge branch 'BerriAI:main' into bugfix-14404-image-gen-azure-managed-identity
2025-09-30 13:20:01 +05:30
Kowyo
bb8e676ded
Merge branch 'BerriAI:main' into kowyo/fix-ollama-think
2025-09-30 15:10:37 +08:00
Krish Dholakia
fd1a986596
Merge pull request #15013 from serializer/patch-1
...
[bug]: Update request handling for original exceptions
2025-09-29 21:59:26 -07:00
Krish Dholakia
79d071c25c
Merge pull request #15022 from BerriAI/litellm_gemini_tool_search
...
Ignore type param for gemini tools
2025-09-29 21:57:50 -07:00
Krish Dholakia
db62e33a4f
Merge pull request #15025 from Isydmr/main
...
fix: use extra_query for download results (Batch API)
2025-09-29 21:57:15 -07:00
Krish Dholakia
551a171243
Merge pull request #15043 from cedarm/fix-remove-vertex-latest
...
fix: remove invalid vertex -latest models
2025-09-29 21:54:53 -07:00
Krish Dholakia
9a44fcdc32
Merge pull request #15050 from uc4w6c/fix/regression-mcp-protocol-version
...
fix: resolve regression with duplicate Mcp-Protocol-Version header
2025-09-29 21:53:00 -07:00
Krish Dholakia
56fccee731
Merge pull request #15058 from uc4w6c/doc/add_api_key_to_bedrock
...
doc: add missing api_key parameter
2025-09-29 21:52:31 -07:00
Kowyo
9810c05a99
fix(ollama/chat): 'think' param handling
2025-09-30 04:21:36 +00:00
Yuta Saito
def4afedd7
doc: add missing api_key parameter
2025-09-30 12:52:17 +09:00
Ishaan Jaff
708c0bd78d
[Feat] Return Cost for Responses API Streaming requests ( #15053 )
...
* test_basic_openai_responses_api_streaming
* _transform_chat_completion_usage_to_responses_usage
* ResponseAPIUsage.cost
* test fixes for anthropic cost with /responses
* fix mypy typng
2025-09-29 19:47:04 -07:00
Henry Wang
33218606b8
fix mypy check issues
2025-09-30 10:37:21 +08:00
Ishaan Jaffer
3e474b9e81
fix claude-sonnet-4-5 model cost map
2025-09-29 18:26:29 -07:00
Ishaan Jaffer
f1578b49e2
vertex_httpx_mock_post
2025-09-29 18:25:54 -07:00
Copilot
f22fd4cddd
Fix: Add /v1/messages/count_tokens to Anthropic routes for non-admin user access ( #15034 )
...
* Initial plan
* Fix: Add /v1/messages/count_tokens to Anthropic routes for user access
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
2025-09-29 18:16:52 -07:00
Ishaan Jaff
ebf72f5eb9
[Fix] Parallel Request Limiter v3 - use well known redis cluster hashing algorithm ( #15052 )
...
* test_keyslot_for_redis_cluster
* fix _is_redis_cluster
* Update litellm/proxy/hooks/parallel_request_limiter_v3.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-09-29 18:12:44 -07:00
Ishaan Jaff
f6d7683261
[Feat] LiteLLM Overhead metric tracking - Add support for tracking litellm overhead on cache hits ( #15045 )
...
* test_litellm_overhead
* vertex track overhead
* fix config.yaml used for testing
* test_litellm_overhead_stream
* add update_response_metadata for caching handler
* add CachingDetails
* fix update_response_metadata import
* add CachingDetails metrics
* add CachingDetails
* test_litellm_overhead_cache_hit
* test_litellm_overhead_cache_hit
* test_litellm_overhead_cache_hit
2025-09-29 17:33:27 -07:00
João Speglich
aeae6cffe4
oci: drop params automatically and add DEDICATED Support
2025-09-29 20:42:42 -03:00
Ishaan Jaffer
55110ba6ae
Revert "fix _is_redis_cluster"
...
This reverts commit 67abd8880a
2025-09-29 16:42:31 -07:00
Ishaan Jaffer
f303860881
Revert "test_keyslot_for_redis_cluster"
...
This reverts commit 52de33787b
2025-09-29 16:42:15 -07:00
Ishaan Jaffer
52de33787b
test_keyslot_for_redis_cluster
2025-09-29 16:41:32 -07:00
Ishaan Jaffer
67abd8880a
fix _is_redis_cluster
2025-09-29 16:40:46 -07:00
Alexsander Hamir
d4830e34e5
fix: remove router inefficiencies (from O(M*N) to O(1)) - 62.5% faster P99 latency ( #15046 )
...
* fix: remove redundant deep copy
set_model_list already does the deep copy at the beginning of the call.
* fix: remove unused model_list arguments
The `model_list` parameter was being passed to classes that did not use it.
* fix: reduce per-request memory and time from O(N×M) to O(N)
No need to create a whole array for a simple look up.
* add: missing test
* fix: remove unused parameter
2025-09-29 15:49:46 -07:00
Ishaan Jaffer
e0172b86e2
test_litellm_overhead_non_streaming
2025-09-29 15:48:32 -07:00
Yuta Saito
5359a0d6a6
fix: test
2025-09-30 07:25:32 +09:00
Ishaan Jaff
619577d4e8
[Feat] Add litellm overhead metric for VertexAI ( #15040 )
...
* test_litellm_overhead
* vertex track overhead
* fix config.yaml used for testing
* test_litellm_overhead_stream
* add update_response_metadata for caching handler
* Revert "add update_response_metadata for caching handler"
This reverts commit f2a891f2b448b878a5dbf4b5b0a6166c807b3705.
2025-09-29 15:15:25 -07:00
Yuta Saito
f1f58bd1d1
fix: resolve regression with duplicate Mcp-Protocol-Version header
2025-09-30 07:12:56 +09:00
Ishaan Jaff
05955042d5
Add model pricing and context window for claude-sonnet-4-5 ( #15049 )
...
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
2025-09-29 15:09:40 -07:00
Krrish Dholakia
4a09507c58
fix(auth_utils.py): add model specific 'tpm_limit' to team's on litellm
2025-09-29 14:25:08 -07:00
Krrish Dholakia
117d5963d0
fix(auth_utils.py): check if team level model-specific rpm limit set
2025-09-29 14:24:03 -07:00
Krrish Dholakia
91f420160f
docs(mcp.md): document oauth support
2025-09-29 13:47:21 -07:00
