ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
34,378 Commits 9 Branches 7 Tags 935 MiB
dd183a7fcb
Commit Graph

34378 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ishaan Jaff
af7d3cd334
[Fix] Remove INFO level log from /messages endpoint (#14377) 
* fix: verbose_proxy_logger.debug

* fix: chat_completion_pass_through_endpoint
 2025-09-09 12:51:03 -07:00
Arseny Boykov
29309f767c
Use fastuuid for litellm_call_id (#14346) 
(cherry picked from commit 201806401ff12564fb6065b69cd8af347ed7c8e6)
 2025-09-09 11:21:31 -07:00
pinkgu
285b14bd69
Fix/gcp model armor (#14381) 
* chore: fix model armor always success

Signed-off-by: bjorn <bjornjee95@gmail.com>

* chore: fix sanitisation field extraction

Signed-off-by: bjorn <bjornjee95@gmail.com>

---------

Signed-off-by: bjorn <bjornjee95@gmail.com>
 2025-09-09 09:18:37 -07:00
Oleksandr Tereshchenko
4d7e918b63 restore forgotten raise keyword in front of an exception_type() call 2025-09-09 17:55:03 +03:00
Derek Worthen
59360e64f9 Fix embeddings using azure_ad_token_provider. 2025-09-09 07:01:05 -07:00
swarnabhasinha
f8ddd123d1
fix: add missing patch import in vertex_ai test 2025-09-09 16:16:59 +05:30
swarnabhasinha
4076e20b35
fix: lint 2025-09-09 16:05:04 +05:30
swarnabhasinha
7c5ec380c1
fix: remove anthropic-beta header for Vertex AI requests with prompt caching 2025-09-09 15:57:53 +05:30
Krish Dholakia
351896cd1d
Merge pull request #12414 from dotmobo/feature/fix-timestamp-granularities 
The parameter timestamp_granularities is broken for openai-like transcription
 2025-09-08 23:13:13 -07:00
Krish Dholakia
b9ce3a1587
Merge pull request #12416 from dotmobo/feature/fix-alloy 
feat: add a health_check_voice parameter in model_info
 2025-09-08 23:12:48 -07:00
Krish Dholakia
8c5dd753cf
Merge pull request #12651 from ocraviotto/fix-gemini-400-when-no-user-msg 
fix: ensure Gemini calls include a user message (fixes #9733)
 2025-09-08 23:08:32 -07:00
Krish Dholakia
1beb58f85b
Merge pull request #9175 from vvidovic/propagate_metadata_to_vertexai_labels 
Optional `labels` field in Vertex AI request
 2025-09-08 19:08:32 -07:00
Krish Dholakia
a92b521ad4
Merge branch 'main' into propagate_metadata_to_vertexai_labels 2025-09-08 19:08:22 -07:00
Krish Dholakia
54c3ae15c8
Merge pull request #14312 from mubashir1osmani/main 
fix: spend tags endpoint returns 500
 2025-09-08 19:05:13 -07:00
Krish Dholakia
5ab091f1a4
Merge pull request #14335 from TeddyAmkie/custom-sso-doc-update 
Scim docs updated with user removal behavior
 2025-09-08 19:04:45 -07:00
Ishaan Jaff
87f116bded test fix 2025-09-08 18:46:20 -07:00
Ishaan Jaff
2cc85936ed
Revert "Security fix - prevent proxy_admin_viewer from modifying other user's credentials + remove hardcoded sensitive keys from test repo" (#14362) 2025-09-08 18:40:54 -07:00
Ishaan Jaff
ddfbf7c36c docs v1.76.3 2025-09-08 18:37:28 -07:00
Ishaan Jaff
a0b380a296 fix install 2025-09-08 18:30:01 -07:00
Ishaan Jaff
68d250973c
[Feature]: Support "Token" MCPAuth (#14359) 
* add MCPAuth.authorization type

* test: Token Auth MCP

* fix: _get_auth_headers to handle auth_type == MCPAuth.authorization

* docs auth types with MCP on config.yaml

* test_mcp_server_works_without_config_auth_value
 2025-09-08 18:25:41 -07:00
Krrish Dholakia
3dba103e2c fix: fix typo 2025-09-08 18:13:34 -07:00
Ishaan Jaff
af751a61dd docs fix 2025-09-08 18:07:33 -07:00
Ishaan Jaff
e71e06510c fix test 2025-09-08 17:38:44 -07:00
Ishaan Jaff
f1699d4cbf fix IGNORE_FUNCTIONS 2025-09-08 17:33:36 -07:00
Ishaan Jaff
e37c1069a1 fix test images gemini 2025-09-08 17:22:59 -07:00
Ishaan Jaff
6400552308 fix lic check 2025-09-08 17:18:42 -07:00
Ishaan Jaff
c7f9be6803 test_async_log_cache_hit_on_callbacks 2025-09-08 17:15:53 -07:00
Ishaan Jaff
4af67aacb6 ruff fix 2025-09-08 17:12:14 -07:00
Ishaan Jaff
0a78ff718b bump pyproject.toml 2025-09-08 16:59:32 -07:00
Ishaan Jaff
a7c99e1841
Revert "Modify cryptography dependency to latest" (#14358) 2025-09-08 16:58:13 -07:00
Ishaan Jaff
ac2d349161
[Security] Ensure LiteLLM Images have 0 Critical, High, Medium vulnerabilities with CVSS ≥ 4.0 (#14357) 
* updated scans

* fix scans

* fix litellm_security_tests

* fix

* fix count CVEE

* add readme

* fix Security Scans

* fix: starlette==0.47.2 # starlette fastapi dep

* bump fastapi==0.115.14

* bump 0.116.1
 2025-09-08 16:49:52 -07:00
Boopesh Shanmugam
f8cb06db60
Changed the model field in the response format to open AI matching the default request (#14354) 2025-09-08 13:45:30 -07:00
Zhengyi Lai
8a77fb4da1
Update docker_quick_start.md (#14322) 2025-09-08 12:58:13 -07:00
Arseny Boykov
05741a7c82
Use executors in post-logging hooks (#14332) 2025-09-08 12:57:26 -07:00
Dharamendra Kumar
6c1c647338 Fix conflicts 2025-09-08 11:04:34 -07:00
berri-teddy
a09613edfd Scim docs updated with user removal behavior 2025-09-08 09:20:00 -07:00
Dharamendra Kumar
d89af0abb9 Revert "Update poetry.lock" 
This reverts commit fa2d3a8971.
 2025-09-08 09:02:34 -07:00
Fabricio Ceschin
6d7d5ed078 Updating poetry.lock 2025-09-08 11:37:24 -04:00
Fabricio Ceschin
faaae888f1 Merge conflicts 2025-09-08 11:34:45 -04:00
Toy-97
890ee1abfa
update: DeepInfra model data refresh [2025-09-08] 
Removed models:
deepinfra/Qwen/Qwen2.5-Coder-32B-Instruct
deepinfra/deepseek-ai/DeepSeek-V3-0324-Turbo
deepinfra/meta-llama/Llama-3.2-90B-Vision-Instruct
deepinfra/meta-llama/Llama-4-Maverick-17B-128E-Instruct-Turbo
deepinfra/meta-llama/Meta-Llama-3-70B-Instruct
deepinfra/mistralai/Devstral-Small-2507
deepinfra/mistralai/Mistral-7B-Instruct-v0.3
deepinfra/mistralai/Mistral-Small-3.1-24B-Instruct-2503

Modified models:
deepinfra/deepseek-ai/DeepSeek-R1-0528:
   - cache_read_input_token_cost: None → 4e-07

deepinfra/google/gemma-3-4b-it:
   - input_cost_per_token: 2e-08 → 4e-08
   - output_cost_per_token: 4e-08 → 8e-08

deepinfra/Qwen/QwQ-32B:
   - input_cost_per_token: 7.5e-08 → 1.5e-07
   - output_cost_per_token: 1.5e-07 → 4e-07

deepinfra/deepseek-ai/DeepSeek-V3-0324:
   - cache_read_input_token_cost: None → 2.24e-07

deepinfra/deepseek-ai/DeepSeek-V3.1:
   - input_cost_per_token: 3e-07 → 2.7e-07
   - cache_read_input_token_cost: None → 2.16e-07

deepinfra/Qwen/Qwen3-Coder-480B-A35B-Instruct-Turbo:
   - cache_read_input_token_cost: 1.5e-07 → 2.4e-07

deepinfra/NousResearch/Hermes-3-Llama-3.1-70B:
   - supports_tool_choice: True → False

deepinfra/deepseek-ai/DeepSeek-R1-Turbo:
   - max_output_tokens: 163840 → 40960
   - max_input_tokens: 163840 → 40960
   - max_tokens: 163840 → 40960
 2025-09-08 19:17:58 +08:00
Dharamendra Kumar
5b26e78ad6 Fix linting 2025-09-07 18:04:00 -07:00
Dharamendra Kumar
92596e48fe Merge branch 'main' into feature/aiohttp-dependency-injection 2025-09-07 17:54:55 -07:00
Dharamendra Kumar
fa2d3a8971 Update poetry.lock 2025-09-07 17:51:46 -07:00
Dharamendra Kumar
009106def0 docs for custom aiohttp session 2025-09-07 17:42:26 -07:00
mubashir1osmani
d9bbbc10a6 added tests 2025-09-07 10:17:28 -04:00
mubashir1osmani
8e4df83a32 fix: spend tags endpoint 2025-09-07 10:06:50 -04:00
Krish Dholakia
9a62b9bdb9
Merge pull request #14161 from BerriAI/litellm_dev_09_01_2025_p2 
Security fix - prevent proxy_admin_viewer from modifying other user's credentials + remove hardcoded sensitive keys from test repo
 2025-09-06 22:14:45 -07:00
Krish Dholakia
e31b2d9eba
Merge pull request #9902 from btemplep/main 
fix bedrock embedding invocations with app inference profiles
 2025-09-06 22:13:35 -07:00
Krish Dholakia
fbc0ec98b6
Merge pull request #12438 from jasonpnnl/fix-customer-update 
Fix 500 error in `/customer/update` endpoint when updating with `budget_id`
 2025-09-06 22:12:30 -07:00
Krish Dholakia
2269ea7f31
Merge pull request #12992 from tlowrimore-heroku/heroku-llms 
Heroku llms
 2025-09-06 22:11:34 -07:00