Duc Tran
fd70ccfd5b
Update proxy_cli.py help message ( #14369 )
2025-09-09 13:52:59 -07:00
Arseny Boykov
5b680bb4a3
Use _PROXY_MaxParallelRequestsHandler_v3 by default ( #14352 )
...
(cherry picked from commit f3fa45cf8fbd5f5cce2f45a7312776d5005fb08e)
2025-09-09 13:51:00 -07:00
Pedro Azevedo
44dc6d3aef
Fix: Add supports_function_calling for GPT OSS in Bedrock provider ( #14375 )
...
* Refactor JSON formatting and remove unnecessary whitespace in model prices and context window
* Fix formatting inconsistencies and remove unnecessary whitespace in model prices JSON
2025-09-09 13:49:32 -07:00
Ishaan Jaff
af7d3cd334
[Fix] Remove INFO level log from /messages endpoint ( #14377 )
...
* fix: verbose_proxy_logger.debug
* fix: chat_completion_pass_through_endpoint
2025-09-09 12:51:03 -07:00
Arseny Boykov
29309f767c
Use fastuuid for litellm_call_id ( #14346 )
...
(cherry picked from commit 201806401ff12564fb6065b69cd8af347ed7c8e6)
2025-09-09 11:21:31 -07:00
pinkgu
285b14bd69
Fix/gcp model armor ( #14381 )
...
* chore: fix model armor always success
Signed-off-by: bjorn <bjornjee95@gmail.com>
* chore: fix sanitisation field extraction
Signed-off-by: bjorn <bjornjee95@gmail.com>
---------
Signed-off-by: bjorn <bjornjee95@gmail.com>
2025-09-09 09:18:37 -07:00
Oleksandr Tereshchenko
4d7e918b63
restore forgotten raise keyword in front of an exception_type() call
2025-09-09 17:55:03 +03:00
Derek Worthen
59360e64f9
Fix embeddings using azure_ad_token_provider.
2025-09-09 07:01:05 -07:00
swarnabhasinha
f8ddd123d1
fix: add missing patch import in vertex_ai test
2025-09-09 16:16:59 +05:30
swarnabhasinha
4076e20b35
fix: lint
2025-09-09 16:05:04 +05:30
swarnabhasinha
7c5ec380c1
fix: remove anthropic-beta header for Vertex AI requests with prompt caching
2025-09-09 15:57:53 +05:30
Krish Dholakia
351896cd1d
Merge pull request #12414 from dotmobo/feature/fix-timestamp-granularities
...
The parameter timestamp_granularities is broken for openai-like transcription
2025-09-08 23:13:13 -07:00
Krish Dholakia
b9ce3a1587
Merge pull request #12416 from dotmobo/feature/fix-alloy
...
feat: add a health_check_voice parameter in model_info
2025-09-08 23:12:48 -07:00
Krish Dholakia
8c5dd753cf
Merge pull request #12651 from ocraviotto/fix-gemini-400-when-no-user-msg
...
fix: ensure Gemini calls include a user message (fixes #9733 )
2025-09-08 23:08:32 -07:00
Krish Dholakia
1beb58f85b
Merge pull request #9175 from vvidovic/propagate_metadata_to_vertexai_labels
...
Optional `labels` field in Vertex AI request
2025-09-08 19:08:32 -07:00
Krish Dholakia
a92b521ad4
Merge branch 'main' into propagate_metadata_to_vertexai_labels
2025-09-08 19:08:22 -07:00
Krish Dholakia
54c3ae15c8
Merge pull request #14312 from mubashir1osmani/main
...
fix: spend tags endpoint returns 500
2025-09-08 19:05:13 -07:00
Krish Dholakia
5ab091f1a4
Merge pull request #14335 from TeddyAmkie/custom-sso-doc-update
...
Scim docs updated with user removal behavior
2025-09-08 19:04:45 -07:00
Ishaan Jaff
87f116bded
test fix
2025-09-08 18:46:20 -07:00
Ishaan Jaff
2cc85936ed
Revert "Security fix - prevent proxy_admin_viewer from modifying other user's credentials + remove hardcoded sensitive keys from test repo" ( #14362 )
2025-09-08 18:40:54 -07:00
Ishaan Jaff
ddfbf7c36c
docs v1.76.3
2025-09-08 18:37:28 -07:00
Ishaan Jaff
a0b380a296
fix install
2025-09-08 18:30:01 -07:00
Ishaan Jaff
68d250973c
[Feature]: Support "Token" MCPAuth ( #14359 )
...
* add MCPAuth.authorization type
* test: Token Auth MCP
* fix: _get_auth_headers to handle auth_type == MCPAuth.authorization
* docs auth types with MCP on config.yaml
* test_mcp_server_works_without_config_auth_value
2025-09-08 18:25:41 -07:00
Krrish Dholakia
3dba103e2c
fix: fix typo
2025-09-08 18:13:34 -07:00
Ishaan Jaff
af751a61dd
docs fix
2025-09-08 18:07:33 -07:00
Ishaan Jaff
e71e06510c
fix test
2025-09-08 17:38:44 -07:00
Ishaan Jaff
f1699d4cbf
fix IGNORE_FUNCTIONS
2025-09-08 17:33:36 -07:00
Ishaan Jaff
e37c1069a1
fix test images gemini
2025-09-08 17:22:59 -07:00
Ishaan Jaff
6400552308
fix lic check
2025-09-08 17:18:42 -07:00
Ishaan Jaff
c7f9be6803
test_async_log_cache_hit_on_callbacks
2025-09-08 17:15:53 -07:00
Ishaan Jaff
4af67aacb6
ruff fix
2025-09-08 17:12:14 -07:00
Ishaan Jaff
0a78ff718b
bump pyproject.toml
2025-09-08 16:59:32 -07:00
Ishaan Jaff
a7c99e1841
Revert "Modify cryptography dependency to latest" ( #14358 )
2025-09-08 16:58:13 -07:00
Ishaan Jaff
ac2d349161
[Security] Ensure LiteLLM Images have 0 Critical, High, Medium vulnerabilities with CVSS ≥ 4.0 ( #14357 )
...
* updated scans
* fix scans
* fix litellm_security_tests
* fix
* fix count CVEE
* add readme
* fix Security Scans
* fix: starlette==0.47.2 # starlette fastapi dep
* bump fastapi==0.115.14
* bump 0.116.1
2025-09-08 16:49:52 -07:00
Boopesh Shanmugam
f8cb06db60
Changed the model field in the response format to open AI matching the default request ( #14354 )
2025-09-08 13:45:30 -07:00
Zhengyi Lai
8a77fb4da1
Update docker_quick_start.md ( #14322 )
2025-09-08 12:58:13 -07:00
Arseny Boykov
05741a7c82
Use executors in post-logging hooks ( #14332 )
2025-09-08 12:57:26 -07:00
Dharamendra Kumar
6c1c647338
Fix conflicts
2025-09-08 11:04:34 -07:00
berri-teddy
a09613edfd
Scim docs updated with user removal behavior
2025-09-08 09:20:00 -07:00
Dharamendra Kumar
d89af0abb9
Revert "Update poetry.lock"
...
This reverts commit fa2d3a8971
2025-09-08 09:02:34 -07:00
Fabricio Ceschin
6d7d5ed078
Updating poetry.lock
2025-09-08 11:37:24 -04:00
Fabricio Ceschin
faaae888f1
Merge conflicts
2025-09-08 11:34:45 -04:00
Toy-97
890ee1abfa
update: DeepInfra model data refresh [2025-09-08]
...
Removed models:
deepinfra/Qwen/Qwen2.5-Coder-32B-Instruct
deepinfra/deepseek-ai/DeepSeek-V3-0324-Turbo
deepinfra/meta-llama/Llama-3.2-90B-Vision-Instruct
deepinfra/meta-llama/Llama-4-Maverick-17B-128E-Instruct-Turbo
deepinfra/meta-llama/Meta-Llama-3-70B-Instruct
deepinfra/mistralai/Devstral-Small-2507
deepinfra/mistralai/Mistral-7B-Instruct-v0.3
deepinfra/mistralai/Mistral-Small-3.1-24B-Instruct-2503
Modified models:
deepinfra/deepseek-ai/DeepSeek-R1-0528:
- cache_read_input_token_cost: None → 4e-07
deepinfra/google/gemma-3-4b-it:
- input_cost_per_token: 2e-08 → 4e-08
- output_cost_per_token: 4e-08 → 8e-08
deepinfra/Qwen/QwQ-32B:
- input_cost_per_token: 7.5e-08 → 1.5e-07
- output_cost_per_token: 1.5e-07 → 4e-07
deepinfra/deepseek-ai/DeepSeek-V3-0324:
- cache_read_input_token_cost: None → 2.24e-07
deepinfra/deepseek-ai/DeepSeek-V3.1:
- input_cost_per_token: 3e-07 → 2.7e-07
- cache_read_input_token_cost: None → 2.16e-07
deepinfra/Qwen/Qwen3-Coder-480B-A35B-Instruct-Turbo:
- cache_read_input_token_cost: 1.5e-07 → 2.4e-07
deepinfra/NousResearch/Hermes-3-Llama-3.1-70B:
- supports_tool_choice: True → False
deepinfra/deepseek-ai/DeepSeek-R1-Turbo:
- max_output_tokens: 163840 → 40960
- max_input_tokens: 163840 → 40960
- max_tokens: 163840 → 40960
2025-09-08 19:17:58 +08:00
Dharamendra Kumar
5b26e78ad6
Fix linting
2025-09-07 18:04:00 -07:00
Dharamendra Kumar
92596e48fe
Merge branch 'main' into feature/aiohttp-dependency-injection
2025-09-07 17:54:55 -07:00
Dharamendra Kumar
fa2d3a8971
Update poetry.lock
2025-09-07 17:51:46 -07:00
Dharamendra Kumar
009106def0
docs for custom aiohttp session
2025-09-07 17:42:26 -07:00
mubashir1osmani
d9bbbc10a6
added tests
2025-09-07 10:17:28 -04:00
mubashir1osmani
8e4df83a32
fix: spend tags endpoint
2025-09-07 10:06:50 -04:00
Krish Dholakia
9a62b9bdb9
Merge pull request #14161 from BerriAI/litellm_dev_09_01_2025_p2
...
Security fix - prevent proxy_admin_viewer from modifying other user's credentials + remove hardcoded sensitive keys from test repo
2025-09-06 22:14:45 -07:00
