Commit Graph

34378 Commits

Author SHA1 Message Date
Sameer Kankute
d585b760c9 Add fallback endpoints support 2026-01-16 10:51:33 +05:30
Yuta Saito
4e78394b21 chore: address jaraco.context path traversal vulnerability (GHSA-58pv-8j8x-9vj2) 2026-01-16 14:20:24 +09:00
Yuta Saito
7c5292d9d4 chore: pip install force-reinstall 2026-01-16 13:39:41 +09:00
Yuta Saito
9e497de5c7 chore: pip install upgrade 2026-01-16 13:21:25 +09:00
mubashir1osmani
cbeaca071f docs: add redis initalization with kwargs 2026-01-15 23:15:54 -05:00
YutaSaito
18de9d71af
Merge pull request #19182 from BerriAI/litellm_fix_ci_test_proxy_routes
[test] handle wildcard routes in route validation test
2026-01-16 13:07:00 +09:00
Sameer Kankute
aec1990dc2 Fix : test_streaming_multiple_partial_tool_calls 2026-01-16 09:29:54 +05:30
Yuta Saito
3a55f68ea4 test: handle wildcard routes in route validation test 2026-01-16 12:53:27 +09:00
Yuta Saito
f428ce63a5 chore: move install jaraco.context 2026-01-16 12:50:06 +09:00
Yuta Saito
a43f9edcd7 chore: force jaraco.context 6.1.0 in runtime images 2026-01-16 12:26:22 +09:00
YutaSaito
f123e08b16
Merge pull request #19178 from BerriAI/litellm_fix_ci_litellm_mapped_tests_llms
[tests] skip Azure SDK init check for acreate_skill
2026-01-16 12:17:55 +09:00
Sameer Kankute
3ca79a82ae Fix : test_stream_chunk_builder_litellm_mixed_calls 2026-01-16 08:45:28 +05:30
YutaSaito
e84a8bff4d
Merge pull request #19177 from BerriAI/revert-19109-litellm_weekly_overhead_work_006
Revert "[Perf] Remove premature model.dump call on the hot path"
2026-01-16 12:13:05 +09:00
Yuta Saito
1c38847b17 tests: skip Azure SDK init check for acreate_skill 2026-01-16 12:03:38 +09:00
YutaSaito
3d80432675
Merge pull request #19175 from BerriAI/revert-19053-litellm_intern_user_usage
Revert "[Fix] /team/daily/activity Show Internal Users Their Spend Only"
2026-01-16 11:50:36 +09:00
Yuta Saito
9fa32e5d21 chore: update jaraco 2026-01-16 11:44:03 +09:00
John Greek
07b1f84ec6
fix(bedrock): strip throughput tier suffixes from model names (#19147)
Co-authored-by: Greek, John <jgreek@users.noreply.github.com>
2026-01-15 18:43:10 -08:00
Yuta Saito
94e15a92b2 chore: add zlib to allow list 2026-01-16 11:41:54 +09:00
YutaSaito
ba9ac6e255
Revert "[Perf] Remove premature model.dump call on the hot path (#19109)"
This reverts commit b352d0d4fd.
2026-01-16 11:36:40 +09:00
Guilherme Segantini
282a28db8b
Improve documentation for routing LLM calls via SAP Gen AI Hub (#19166)
* fix(sap): resolve JSON serialization error and update documentation

- Fix 'Object of type cached_property is not JSON serializable' error
- Replace @cached_property with manual caching in deployment_url
- Update documentation examples to match sap_proxy_config.yaml
- Add Anthropic model naming clarification (anthropic-- prefix)
- Improve authentication documentation with tabbed interface

Fixes critical bug preventing SAP Gen AI Hub integration from working.
Fully tested with both chat and embedding endpoints.

* docs: update SAP provider documentation

* Update SAP provider documentation with better setup instructions

Rewrote the SAP docs to make it easier for users to get started. Added a quick start section, clarified the authentication options, explained model naming differences between SDK and proxy usage, and included some troubleshooting tips.

* Revert transformation files - keep only documentation changes
2026-01-15 18:36:11 -08:00
Emerson Gomes
e8fa8c5fa1
fix gcp glm-4.7 pricing (#19172) 2026-01-15 18:35:40 -08:00
Ishaan Jaff
b5b9c39beb
[Docs Guide] Litellm claude code end user tracking (#19176)
* add to sidebar

* v1 guide

* guide claude granular cost tracking

* docs fix
2026-01-15 18:32:58 -08:00
YutaSaito
bbf9a9e6e6
Revert "[Fix] /team/daily/activity Show Internal Users Their Spend Only" 2026-01-16 11:27:59 +09:00
Yuta Saito
e5991e5222 chore: document temporary grype ignore for CVE-2026-22184 2026-01-16 11:19:10 +09:00
YutaSaito
1d16029ce7
Merge pull request #19173 from BerriAI/revert-19062-gemini-defsrefs
Revert "fix(gemini): dereference $defs/$ref in tool response content"
2026-01-16 10:58:38 +09:00
YutaSaito
9bd313dc4a
Revert "fix(gemini): dereference $defs/$ref in tool response content (#19062)"
This reverts commit 84dad952a2.
2026-01-16 10:58:26 +09:00
Ishaan Jaff
117c7dd158
[Feat] Claude Code - Add End-user tracking with Claude Code (#19171)
* add claude code customer usage tracking

* fix get end user trackign claude code

* TestGetCustomerIdFromStandardHeaders
2026-01-15 17:57:10 -08:00
YutaSaito
9de97b9724
Merge pull request #19170 from BerriAI/litellm_fix_ci_check_code_and_doc_quality
Litellm fix ci check code and doc quality
2026-01-16 10:41:51 +09:00
Yuta Saito
c03630d95e test: fix missing test 2026-01-16 10:33:53 +09:00
yuneng-jiang
e0a29cac99
Merge pull request #19164 from BerriAI/litellm_ui_model_select_comp
[Feature] UI - Reusable Model Select
2026-01-15 17:25:12 -08:00
yuneng-jiang
830f2deb0d ensuring this still works PENDING PROXY EXTRAS 2026-01-15 17:24:31 -08:00
YutaSaito
05a1d15c65
Merge pull request #19168 from BerriAI/revert-19027-litellm_add_0_budget_model_bypass
Revert "[Feat] Add support for 0 cost models"
2026-01-16 10:21:51 +09:00
Yuta Saito
5cba724654 chore: fix lint error 2026-01-16 10:19:27 +09:00
Yuta Saito
993742166d test: fix router_code_coverage test fail 2026-01-16 10:16:01 +09:00
Ishaan Jaffer
3bb6046ca0 test fix 2026-01-15 16:48:21 -08:00
Ishaan Jaffer
b21484d229 test fix 2026-01-15 16:48:21 -08:00
Ishaan Jaff
362b1a1577
[Feat] Add support for Tool Search on /messages API - Azure, Bedrock, Anthropic API (#19165)
* fix _update_headers_with_anthropic_beta

* init ANTHROPIC_BETA_HEADER_VALUES

* fix ANTHROPIC_BETA_HEADER_VALUES

* fix: _update_headers_with_anthropic_beta - anthropic API

* init _update_headers_with_anthropic_beta - azure AI support

* init VertexAIPartnerModelsAnthropicMessagesConfig

* fix _get_total_tokens_from_usage

* working TestBedrockInvokeToolSearch

* fix get_extra_headers

* TestBedrockInvokeToolSearch

* _get_tool_search_beta_header_for_bedrock

* fix mypy linting
2026-01-15 16:35:00 -08:00
YutaSaito
960bdbbd8e
Revert "[Feat] Add support for 0 cost models" 2026-01-16 09:33:38 +09:00
Alexsander Hamir
3d59f336e2
Fix Azure embeddings JSON parsing to prevent connection leaks and ensure proper router cooldown (#19167) 2026-01-15 16:22:33 -08:00
yuneng-jiang
5ff768e5e0 Merge remote-tracking branch 'origin' into litellm_deleted_keys_team 2026-01-15 15:55:18 -08:00
yuneng-jiang
6a7edd8f2b
Merge pull request #18785 from BerriAI/litellm_user_promethus_metrics
[Feature] User Metrics for Promethus
2026-01-15 15:51:02 -08:00
yuneng-jiang
e07106244e
Merge pull request #19116 from BerriAI/litellm_org_admin_escalte
[Fix] /user/new Privilege Escalation
2026-01-15 15:50:43 -08:00
yuneng-jiang
9a0f50cd5c
Merge pull request #19128 from BerriAI/litellm_ui_all_proxy_models
[Feature] UI - Allow Preventing Team Admins From Deleting Members From Teams
2026-01-15 15:50:35 -08:00
yuneng-jiang
542248adb9
Merge pull request #19114 from BerriAI/litellm_ui_header_buttons
[Feature] UI - Community Engagement Buttons
2026-01-15 15:50:02 -08:00
yuneng-jiang
08f316b26a fixing build 2 2026-01-15 15:48:25 -08:00
Emerson Gomes
f7726c8950 Fix wrong keys being used for model sticky entry 2026-01-15 17:42:29 -06:00
yuneng-jiang
4de05d1e8d fixing build 2026-01-15 15:41:35 -08:00
yuneng-jiang
812ac7e838 Reusable model select 2026-01-15 15:19:03 -08:00
Emerson Gomes
059e75ad88 fix(router): scope deployment affinity by model_map_key
- Key affinity by (user_api_key_hash, model_map_key) -> model_id
- Ignore OpenAI 'user' param for affinity
- Avoid double hashing user_api_key_hash
- Add unit tests + docs clarifications
2026-01-15 16:28:36 -06:00
choigawoon
d76f3acb80
fix: video status/content credential injection for wildcard models (#18854)
* fix: video status/content credential injection for wildcard models

When using wildcard model patterns like `vertex_ai/*`, the video status
and content endpoints failed to resolve the model_name correctly,
causing credential injection to be skipped.

Changes:
- router.py: Added `custom_llm_provider` parameter to
  `resolve_model_name_from_model_id` method
- router.py: Added Strategy 2 (provider prefix matching) and
  Strategy 4 (wildcard pattern matching)
- endpoints.py: Pass `provider_from_id` to resolver in video_status,
  video_content, and video_remix endpoints

This allows video_id like `vertex_ai:veo-3.0-generate-preview:...` to
correctly match `vertex_ai/*` wildcard pattern and inject credentials
from the model config.

Fixes: Video status returns "Your default credentials were not found"
when using Vertex AI video generation with wildcard model patterns.

* pr18845-video기능버그픽스 (vibe-kanban e43e2d2d)

pr코멘트 대응

litellm fork해서 branch만들고 작업후 pull request를 올렸는데 피드백을줬어.

이 내용 파악해서 내가 올린 pr 브랜치에 해당 작업 이어서 해야할거같아.

https://github.com/BerriAI/litellm/pull/18854#discussion\_r2677026995

여기 내용 읽고 현황 파악해서 작업하자.

테스트코드 작성해달라는데 테스트코드작성후 로컬에서 테스트명령어 한번 돌리고 커밋 푸시하려고.

litellm에서 pull request를 위한 문서가 있어.

https://docs.litellm.ai/docs/extras/contributing\_code

CRA서명은 했어. 그다음거부터 양식에 맞게 해야할듯. 지금 버그만 바로 고쳐서 pr했거든.

* fix: resolve mypy type error in resolve_model_name_from_model_id

Rename loop variable to avoid type conflict between DeploymentTypedDict
and Dict[Any, Any] from pattern_router.route() return type.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-16 03:45:25 +05:30