Ishaan Jaff
32d87c242b
[Fixes] Using Qwen API Tiered Pricing ( #14479 )
...
* fix: use dashscope cost calc
* add qwen logo
2025-09-11 20:07:41 -07:00
Ishaan Jaff
1e230e87e3
fixes for mypy
2025-09-11 20:05:29 -07:00
Ishaan Jaff
94038108ad
fix dashscope api base
2025-09-11 20:00:54 -07:00
Ishaan Jaff
69ef062f55
fix tiered_pricing test
2025-09-11 19:56:44 -07:00
Ishaan Jaff
51d5255452
[Bug]: Azure OpenAI & AI Foundry Reject Image Generation Payload Due to extra_body Injection in LiteLLM v1.76.3 ( #14475 )
...
* add request body azure img gen
* fix test_get_optional_params_image_gen_filters_empty_values
* test_azure_image_generation_request_body
* test_azure_image_generation_request_body
2025-09-11 19:39:06 -07:00
Ishaan Jaff
dda115cc6d
[Feat] Cost Tracking - Add support for Tiered Cost Tracking for Qwen API (Dashscope) ( #14471 )
...
* add dashscope logo
* docs fix
* docs fix
* fix supports_batch_calling
* fix naming
* fix input_cost_per_audio_token
* use output_cost_per_reasoning_token
* add tiered_pricing in get_model_info
* test fixes
* fix cost calc
* ruff fix
2025-09-11 18:14:39 -07:00
Krish Dholakia
b1025b54fb
Merge pull request #14466 from BerriAI/revert-14252-main
...
Revert "Add additionalProperties to vertex ai Schema definition"
2025-09-11 14:38:57 -07:00
Krish Dholakia
5c3d407b7a
Revert "Add additionalProperties to vertex ai Schema definition"
2025-09-11 14:38:25 -07:00
Ishaan Jaff
258b674dbb
fix deepinfra test
2025-09-10 19:39:23 -07:00
Ishaan Jaff
385206c4bc
fix code QA
2025-09-10 19:35:29 -07:00
Ishaan Jaff
ea377de5a5
fixes mypy linting
2025-09-10 19:34:35 -07:00
Ishaan Jaff
a13aa4740a
[Fixes] Bug fixes to using LiteLLM MCP Gateway ( #14392 )
...
* fix: use _get_mcp_servers_in_path
* fix checks for using litellm_proxy as MCP tool provider
* fix: fix mcp_tools_with_litellm_proxy
* fix: fix aresponses_api_with_mcp
* aresponses_api_with_mcp
* test_mcp_allowed_tools_filtering
* fix: _filter_mcp_tools_by_allowed_tools
* fix: _filter_mcp_tools_by_allowed_tools
* test_streaming_responses_api_with_mcp_tools
* fixes: test tools transfrom MCP->OpenaI spec
* test_streaming_responses_api_with_mcp_tools
* fix: chat ui allow multi select with allowed tools
* fix: use correct MCP events with litellm proxy response API
* fix get_event_model_class
* fix litellm proxy MCP handler
* fix MCPEnhancedStreamingIterator
* chat ui show list tools result
* UI: show MCP events
* fix stream iterator
* fixes: litellm proxy mcp handler
* test responses + mcp
* fix: update responses api with mcp handling
* ruff check fix
* central: _process_mcp_tools_to_openai_format
* fix: refactor code
* test_mcp_allowed_tools_filtering
* test mcp with litellm proxy
* fix mcp call
* demo: video using MCP ui
* fixes for using stream iterator
* test_no_duplicate_mcp_tools_in_streaming_e2e
* docs fix
* fix code snippet
2025-09-10 19:12:11 -07:00
Ishaan Jaff
c09d9e5e8e
feat: Validate LiteLLM Virtual Key format ( #14428 )
...
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
2025-09-10 18:58:48 -07:00
Ishaan Jaff
1f42e41c8d
[Bug]: Fix Authorization header not being sent to configured MCP servers ( #14422 )
...
* test: test_mcp_server_config_auth_value_header_used
* fix: authentication_token
* docs: fix instructions on using responses api with MCPs
* mcp fixes
2025-09-10 16:41:08 -07:00
Ishaan Jaff
d78ed53cbb
fix mypy linting
2025-09-10 16:17:22 -07:00
Ishaan Jaff
199c262e33
EXPERIMENTAL_MULTI_INSTANCE_RATE_LIMITING
2025-09-10 15:55:27 -07:00
Ishaan Jaff
d544c6e595
fix DatabricksFunction
2025-09-10 15:52:29 -07:00
Ishaan Jaff
dc5650eeda
Revert "fix: remove anthropic-beta header for Vertex AI requests with prompt caching" ( #14421 )
2025-09-10 15:47:18 -07:00
Arseny Boykov
f3c5a59e57
Revert "Use _PROXY_MaxParallelRequestsHandler_v3 by default ( #14352 )" ( #14420 )
...
This reverts commit 5b680bb4a3
2025-09-10 15:46:27 -07:00
Krish Dholakia
037d2380b4
Merge pull request #14410 from BerriAI/krrishdholakia-patch-1
...
Update README.md
2025-09-10 08:48:48 -07:00
Krish Dholakia
2668112a18
Update README.md
2025-09-10 08:48:37 -07:00
Krish Dholakia
6a47ac15ab
Merge pull request #13886 from frankzye/feature/databricks-function-call-missing-pass-description
...
pass function tool description for databricks provider
2025-09-09 22:42:42 -07:00
Krish Dholakia
a80cfe5fb5
Merge branch 'main' into feature/databricks-function-call-missing-pass-description
2025-09-09 22:42:32 -07:00
Krish Dholakia
53bf023876
Merge pull request #14092 from gotsysdba/main
...
OCI Provder: Update OCIPromptTokensDetails
2025-09-09 22:39:16 -07:00
Krish Dholakia
d72081113e
Merge pull request #14111 from dharamendrak/feature/aiohttp-dependency-injection
...
feat: Add dependency injection support to BaseLLMAIOHTTPHandler
2025-09-09 22:35:30 -07:00
Krish Dholakia
03a457842d
Merge pull request #14310 from swarna1101/fix-anthropic-prompt-caching-vertex-ai
...
fix: remove anthropic-beta header for Vertex AI requests with prompt caching
2025-09-09 22:32:40 -07:00
Krish Dholakia
e57a05b2dc
Merge pull request #14324 from Toy-97/patch-1
...
update: DeepInfra model data refresh [2025-09-08]
2025-09-09 22:31:44 -07:00
Krish Dholakia
b45ce6e4f2
Merge pull request #14374 from dworthen/fix-embedding-with-azure-ad-token-provider
...
Fix embeddings using azure_ad_token_provider.
2025-09-09 22:21:09 -07:00
Krish Dholakia
dde2712ade
Merge pull request #14379 from teremterem/main
...
[Fix] Restore forgotten `raise` keyword in front of an `exception_type()` call
2025-09-09 22:19:58 -07:00
Krish Dholakia
34c5bc7bb0
Merge pull request #14391 from mubashir1osmani/fix_all_docs
...
added tags to langchain
2025-09-09 22:15:16 -07:00
mubashir1osmani
c20a5b0bbd
more info for turn_off_logging
2025-09-10 00:51:37 -04:00
Krrish Dholakia
a504c7dae3
test: update tests
2025-09-09 21:43:37 -07:00
Krrish Dholakia
bdd7255bab
test: remove redundant tests - moved to parallel_request_limiter_v3.py
2025-09-09 21:35:50 -07:00
mubashir1osmani
f51036e092
added tags to langchain
2025-09-10 00:32:26 -04:00
Krrish Dholakia
c45ede7187
test: update test
2025-09-09 21:31:34 -07:00
Krrish Dholakia
f0de7d1dfd
fix: remove EOL model name
2025-09-09 21:15:12 -07:00
Krrish Dholakia
d05f58721e
test: remove end of life model from tests
2025-09-09 21:01:45 -07:00
Krrish Dholakia
e443d01925
test: remove redundant test
2025-09-09 20:37:09 -07:00
Krrish Dholakia
bff76715a5
test: skip test with invalid arn
2025-09-09 20:35:44 -07:00
Krrish Dholakia
07a83056a6
test: update test
2025-09-09 20:30:50 -07:00
Krrish Dholakia
44566977f1
test: update test
2025-09-09 20:18:03 -07:00
Krrish Dholakia
ba6819dc18
bump: version 1.77.0 → 1.77.1
2025-09-09 19:58:21 -07:00
Krish Dholakia
22aef4e7b2
Merge pull request #14387 from BerriAI/litellm_dev_09_09_2025_p1
...
fix(internal_user_endpoints.py): ensure only proxy admin can update v…
2025-09-09 19:54:13 -07:00
Krrish Dholakia
076b46c806
build: remove end of life bedrock model
2025-09-09 19:49:22 -07:00
Krrish Dholakia
0854c35d3e
test: remove eol bedrock model from tests
2025-09-09 19:48:35 -07:00
Krrish Dholakia
7cbf91cf36
fix(proxy_server.py): fix api call
2025-09-09 19:44:25 -07:00
Krrish Dholakia
62fcc52eb6
fix(internal_user_endpoints.py): ensure only proxy admin can update values for other users
...
prevents proxy_admin_viewer from updating other user passwords
2025-09-09 19:28:16 -07:00
Krrish Dholakia
98444a900b
fix(config_settings.md): document new env var
2025-09-09 19:25:38 -07:00
Krrish Dholakia
944176f5e8
fix: check if metadata is not none
2025-09-09 19:23:07 -07:00
Ishaan Jaff
555efd60b5
[Security] Fix: Ensure .info() logs are not used for request/responses + Add code QA check for possible violations ( #14386 )
...
* test: info log
* fixes for debug
* add info_log_check
* fix: debug level
* fix: debug level
* fix: use .debug
* fix info statements
* fix info log check
* fix: fix emit_standard_logging_payload
* fix RequestBody
* Potential fix for code scanning alert no. 3339: Clear-text logging of sensitive information
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
* fix check
* fix code qa check
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-09-09 13:55:56 -07:00
