Commit Graph

28008 Commits

Author SHA1 Message Date
Sameer Kankute
dbf1cd591d
Merge pull request #17271 from colinlin-stripe/cherry-pick-invoke-headers
[fix] extra_headers in messages api bedrock invoke
2025-12-02 08:26:54 +05:30
Ishaan Jaff
860cdc81d3
[Fix] Fix Watsonx Audio Transcription API (#17326)
* """
add

* fix transform_audio_transcription_request

* fix tests

* test_watsonx_transcription_request_body
2025-12-01 18:26:56 -08:00
Elias
37ecb03d4f
Add support of audio transcription for OVHcloud (#17305) 2025-12-01 18:26:39 -08:00
Danny Kopping
be920d75d3
Add claude-opus-4-5 alias (#17313)
Similar to `claude-sonnet-4-5`.
2025-12-01 18:25:26 -08:00
Krish Dholakia
1eb06f8031
Revert "fix: respect guardrail mock_response during during_call to return blo…" (#17332)
This reverts commit 6de6107673.
2025-12-01 15:40:28 -08:00
Krish Dholakia
b6d6f834e0
(feat) Generic Guardrail API - allows guardrail providers to add INSTANT support for LiteLLM w/out PR to repo (#17175)
* feat(generic_guardrail_api.py): new generic api for guardrails

Allows guardrail providers to work with litellm for guardrails without needing to make a PR to LiteLLM

* docs(generic_guardrail_api.md): document new generic guardrail api

* Fix: Improve PII detection and guardrail API integration

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* feat: correctly extract raw request from guardrail api

* docs(generic_guardrail_api.md): document this is a beta feature

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-12-01 14:29:52 -08:00
Ishaan Jaff
f434ca61ec
add kimi-k2-instruct-0905 (#17328) 2025-12-01 14:14:41 -08:00
Krrish Dholakia
c9afb86994 docs(azure_ai.md): document anthropic model usage on azure ai 2025-12-01 14:06:31 -08:00
Krrish Dholakia
7a46f3a083 docs: document azure ai provider for anthropic 2025-12-01 14:05:54 -08:00
Ishaan Jaff
24f847b84c
[Feat] JWT Auth - AI Gateway, allow using regular OIDC flow with user info endpoints (#17324)
* feat: allow fetching OIDC user info

* test: use test_auth_builder_with_oidc_userinfo_enabled gets user info when enabled

* fix tool permission doc

* docs fix diagram
2025-12-01 13:59:00 -08:00
Ishaan Jaff
ce0dc0c8b9
[Feat] WatsonX - allow passing zen_api_key dynamically (#16655)
* test_watsonx_zen_api_key_from_client

* zen api key

* docs using zen api key
2025-12-01 12:55:47 -08:00
YutaSaito
a73bd751fc
doc: add images for tool permission guardrail (#17322) 2025-12-01 12:38:49 -08:00
Colin Lin
661bccbc39 fixed flaky test by sorting list 2025-12-01 14:26:14 -05:00
Colin Lin
e420b633a1 add tests 2025-12-01 14:25:37 -05:00
Colin Lin
2a5082e6cf remove logs 2025-12-01 14:25:37 -05:00
Colin Lin
c588e7854d use kwargs 2025-12-01 14:25:37 -05:00
orgersh92
7808a610f8
Fix session consistency, move Lasso API version away from source code (#17316)
* store and fetch lasso-conversation id from cache

* include gateway/v# in the baseUrl to allow simpler version migrations in the future

* add tests for cached conversation ID
2025-12-01 10:03:51 -08:00
YutaSaito
6de6107673
fix: respect guardrail mock_response during during_call to return blocked output (#17247) 2025-12-01 09:59:01 -08:00
Sameer Kankute
3347e4de11
Merge pull request #17292 from BerriAI/litellm_gemini_image_gen_handling
Add better handling in image generation for gemini models
2025-12-01 21:42:36 +05:30
Sameer Kankute
353c779c34
Merge pull request #17301 from BerriAI/litellm_claude_code_beta_fix
Remove not compatible beta header from Bedrock
2025-12-01 21:39:37 +05:30
Sameer Kankute
8d1113eac1
Merge pull request #17296 from BerriAI/litellm_video_passthrough_cost_tracking
(Feat)Add passthrough cost tracking for veo
2025-12-01 21:33:03 +05:30
Sameer Kankute
983ba7aa0f Remove not compatible beta header from claude code 2025-12-01 17:22:04 +05:30
Sameer Kankute
ae132abff4 Revert auth change 2025-12-01 14:36:30 +05:30
Sameer Kankute
7dac498efb Add passthrough cost tracking for veo 2025-12-01 14:33:03 +05:30
Sameer Kankute
02510a908f Add better handling image generation for gemini models 2025-12-01 10:42:38 +05:30
Sameer Kankute
07434092f8
Merge pull request #17290 from BerriAI/litellm_fix_create_batch_Header
Respect custom llm provider in header
2025-12-01 08:37:50 +05:30
Sameer Kankute
f7380a51de Respect custom llm provider in header 2025-12-01 08:36:29 +05:30
Alexsander Hamir
b949ec90db
Merge pull request #16739 from BerriAI/litellm_/audio/speech
[Perf] Fix `/audio/speech` performance by using `shared_sessions`
2025-11-30 17:27:44 -08:00
Alexsander Hamir
4fffd33ccf
Merge pull request #17167 from BerriAI/litellm_spend_logs_api
[Refactor] Deprecate `spend/logs` & add `spend/logs/v2`
2025-11-29 06:19:53 -08:00
Sameer Kankute
7f42b9b987
Merge pull request #17193 from BerriAI/litellm_twelvelabs_int
Added support for twelvelabs pegasus
2025-11-28 22:09:00 +05:30
hxomer
b85df0b1fb
Better handle anonymization (#17207)
* Better handle anonymization

* Fix tests
2025-11-28 08:22:19 -08:00
Sameer Kankute
9d058398df Fix pegasus response and add doc 2025-11-28 21:41:25 +05:30
Sameer Kankute
bcc35a6069
Merge pull request #17253 from BerriAI/litellm_nova_embedding_support
Add nova embedding support
2025-11-28 21:16:06 +05:30
Sameer Kankute
bb11c4fb3f
Merge pull request #17258 from BerriAI/litellm_add_tags_in_ui
Fix metadata tags and model name display in UI for Azure passthrough + Add cost tracking for responses API
2025-11-28 21:15:39 +05:30
Sameer Kankute
af8f1475bf fix PLR0915 2025-11-28 21:12:42 +05:30
Sameer Kankute
6c326ceb87
Merge pull request #17142 from BerriAI/litellm_anthropic_update_new_feat
Update new anthropic feats as reviewed
2025-11-28 21:06:34 +05:30
Sameer Kankute
eab0ec95f0 Fix async get request 2025-11-28 18:06:53 +05:30
Sameer Kankute
f0d3c96a8d Add tags and other field in UI logs and add responses api cost tracking 2025-11-28 17:23:15 +05:30
Sameer Kankute
8700c5ced6 Add nova embedding support 2025-11-28 14:56:46 +05:30
v0rtex20k
205a563b65
Allow wildcard routes for nonproxy admin (SCIM) (#17178)
* checked for wildcards in nonproxy

* ready
2025-11-27 22:10:19 -08:00
Omkar Malpure
bbea83fd93
Fix : acompletion throws error with SambaNova models (#17217)
Co-authored-by: Omkar Malpure <omkarmalpure@Omkars-MacBook-Pro.local>
2025-11-27 21:59:24 -08:00
Andy Forest
8aa4f3d476
fix(bedrock): handle cohere v4 embed response dictionary format (#17220) 2025-11-27 21:50:35 -08:00
Saar wintrov
87050c6a02
SSO: fix the generic SSO provider (#17227)
* SSO: fix the generic SSO provider

* adding tests
2025-11-27 21:27:23 -08:00
YutaSaito
334d09b3b2
feat: add regex-based tool_name/tool_type matching for tool-permission (#17164)
* feat: add regex-based tool_name/tool_type matching for tool-permission

* docs: update tool permission quick start for UI workflow
2025-11-27 21:26:27 -08:00
Wei-Chiet Ku
d43c077653
Fix/issue 16759 streaming error validation (#17242)
* Enhance error handling in OpenAIResponsesAPIConfig to coalesce null error codes into a default string, preventing validation errors and improving stability during streaming iterations.

* Add test for coalescing null error codes in streaming responses

This test ensures that when a streaming error event has error.code set to None, the system correctly transforms it to 'unknown_error' and returns an ErrorEvent instance without raising a ValidationError.

---------

Co-authored-by: Ku Wei Chiet <chietkuw@fpt.com>
2025-11-27 21:24:04 -08:00
Sameer Kankute
71f41352fa
Merge pull request #17202 from BerriAI/litellm_azure_ai_anthropic_support
(Bug)Migrate Anthropic provider to azure ai
2025-11-28 08:14:14 +05:30
yuneng-jiang
994a624d02
Merge pull request #17240 from BerriAI/litellm_remove_feature_flags
[Fix] Remove Feature Flags
2025-11-27 18:01:09 -08:00
yuneng-jiang
a33a2cb5b5 Adding timeout to flaky test 2025-11-27 17:53:09 -08:00
yuneng-jiang
0d329826f1 Fix flaky tests 2025-11-27 17:40:38 -08:00
yuneng-jiang
3cc18a6fc1
Merge pull request #17238 from BerriAI/litellm_ui_fallbacks_del_fix
[Fix] UI -  Fallbacks Immediately Deleting before API resolves
2025-11-27 17:26:27 -08:00