Commit Graph

5287 Commits

Author SHA1 Message Date
yuneng-jiang
19a69a89f0 deleted keys and teams docs 2026-01-17 13:19:48 -08:00
Ishaan Jaffer
e238cb2ca0 docs clean up 2026-01-17 12:30:26 -08:00
Ishaan Jaffer
58570e5b13 fix doc 2026-01-17 12:28:04 -08:00
Ishaan Jaffer
1115e6b8c7 docs fix 2026-01-17 12:20:09 -08:00
Ishaan Jaffer
eb26ebc926 docs ui usage 2026-01-17 12:15:37 -08:00
yuneng-jiang
b964e2a1a0 updating docker pull cmd 2026-01-17 11:54:04 -08:00
Ishaan Jaffer
e9e323bf32 png fixes 2026-01-17 10:28:41 -08:00
Ishaan Jaffer
f0569bc102 docs fix 2026-01-17 09:40:08 -08:00
Harshit Jain
0683f29671
feat(panw_prisma_airs): add custom violation message support 2026-01-17 17:52:25 +05:30
Ishaan Jaff
d2a40c8456
[Fix] - Reliability fix OOMs with image url handling (#19257)
* fix MAX_IMAGE_URL_DOWNLOAD_SIZE_MB

* test_image_exceeds_size_limit_with_content_length

* fix: _process_image_response

* add constants 50MB

* fix convert_to_anthropic_image_obj image handling

* test_gemini_image_size_limit_exceeded

* MAX_IMAGE_URL_DOWNLOAD_SIZE_MB fix

* MAX_IMAGE_URL_DOWNLOAD_SIZE_MB

* test_image_size_limit_disabled

* async_convert_url_to_base64

* docs fix

* code QA check

* fix Exception
2026-01-16 16:41:44 -08:00
mubashir1osmani
bcc23a32b8
docs: add redis initalization with kwargs
docs: add redis initalization with kwargs
2026-01-16 18:11:07 -05:00
YutaSaito
66d67ae356
Revert "Add sanititzation for anthropic messages" 2026-01-17 06:01:12 +09:00
Sameer Kankute
5782832b82
Merge pull request #19199 from BerriAI/litellm_fix_stability_issues1
[Fix] Bedrock stability model usage issues
2026-01-16 18:17:11 +05:30
Sameer Kankute
fb3b4e6b33
Merge pull request #19196 from BerriAI/litellm_sanitise_anthropic_mesages
Add sanititzation for anthropic messages
2026-01-16 17:48:55 +05:30
Sameer Kankute
c66ad4408b
Merge pull request #19215 from BerriAI/main
merge main in stability issue
2026-01-16 17:07:57 +05:30
Sameer Kankute
101230e538
Merge pull request #19213 from BerriAI/main
merge main in sanitisation
2026-01-16 17:04:01 +05:30
Sameer Kankute
e54af42774
Merge pull request #19211 from BerriAI/main
merge main in fallback PR
2026-01-16 17:01:10 +05:30
Sameer Kankute
b0c6a1b308
Merge pull request #19203 from BerriAI/main
merge main
2026-01-16 15:16:29 +05:30
Sameer Kankute
3df0d45d58 fix documentation 2026-01-16 14:47:08 +05:30
Sameer Kankute
8be3712e82 Add docs for message sanitisation 2026-01-16 12:52:13 +05:30
Sameer Kankute
d585b760c9 Add fallback endpoints support 2026-01-16 10:51:33 +05:30
mubashir1osmani
cbeaca071f docs: add redis initalization with kwargs 2026-01-15 23:15:54 -05:00
Guilherme Segantini
282a28db8b
Improve documentation for routing LLM calls via SAP Gen AI Hub (#19166)
* fix(sap): resolve JSON serialization error and update documentation

- Fix 'Object of type cached_property is not JSON serializable' error
- Replace @cached_property with manual caching in deployment_url
- Update documentation examples to match sap_proxy_config.yaml
- Add Anthropic model naming clarification (anthropic-- prefix)
- Improve authentication documentation with tabbed interface

Fixes critical bug preventing SAP Gen AI Hub integration from working.
Fully tested with both chat and embedding endpoints.

* docs: update SAP provider documentation

* Update SAP provider documentation with better setup instructions

Rewrote the SAP docs to make it easier for users to get started. Added a quick start section, clarified the authentication options, explained model naming differences between SDK and proxy usage, and included some troubleshooting tips.

* Revert transformation files - keep only documentation changes
2026-01-15 18:36:11 -08:00
Ishaan Jaff
b5b9c39beb
[Docs Guide] Litellm claude code end user tracking (#19176)
* add to sidebar

* v1 guide

* guide claude granular cost tracking

* docs fix
2026-01-15 18:32:58 -08:00
Ishaan Jaff
117c7dd158
[Feat] Claude Code - Add End-user tracking with Claude Code (#19171)
* add claude code customer usage tracking

* fix get end user trackign claude code

* TestGetCustomerIdFromStandardHeaders
2026-01-15 17:57:10 -08:00
YutaSaito
960bdbbd8e
Revert "[Feat] Add support for 0 cost models" 2026-01-16 09:33:38 +09:00
Krish Dholakia
664ee27ef5
Litellm dev 01 15 2026 p1 (#19153)
* fix: safely handle unmapped call type

* docs: cleanup links for ai coding tools

* docs(claude_non_anthropic_models.md): add tutorial showing non anthropic model connection to claude code

* docs: link to non-anthropic model tutorial for claude code
2026-01-16 00:48:41 +05:30
Vikash
c619569604
Added ability to customize logfire base url through env var (#19148)
* Added ability to customize logfire base url through env var

* Added test to check if env var is used correctly for logfire

* Document the env var

* Documented env var in config_settings.md
2026-01-16 00:10:59 +05:30
Krrish Dholakia
c7ca2dd4d8 docs(claude_mcp.md): separate claude mcp tutorial into a separate doc
easier to surface
2026-01-15 20:52:31 +05:30
Harshit Jain
8804c78cf9
docs(logging.md): add guide for mounting custom callbacks in Helm/K8s (#19136) 2026-01-15 15:58:44 +05:30
Sameer Kankute
83cdfd886a
Merge pull request #19059 from BerriAI/litellm_openrouter_image_gen
Add openrouter support for image/generation endpoints
2026-01-15 15:48:00 +05:30
YutaSaito
e3e6fc2806
Merge pull request #19122 from BerriAI/litellm_docs_mcp_troubleshooting
[doc] add MCP troubleshooting guide
2026-01-15 09:34:35 +09:00
Alexsander Hamir
f442b57848
docs: Add structured issue reporting guides for CPU and memory issues (#19117) 2026-01-14 15:28:20 -08:00
Yuta Saito
0b04145c11 doc: add MCP troubleshooting guide 2026-01-15 08:01:59 +09:00
Alexsander Hamir
45968c01bd
update troubleshoot (#19099) 2026-01-14 10:01:47 -08:00
Alexsander Hamir
0959467699
docs: Update troubleshooting guide with version tracking and error logs/metrics (#19097) 2026-01-14 09:32:28 -08:00
Alexsander Hamir
05ebb0a739
docs: Add troubleshooting guide (#19096) 2026-01-14 09:17:43 -08:00
Harshit Jain
e8c4cad885
feat(proxy): cleanup spend logs cron verification, fix, and docs (#19085) 2026-01-14 22:14:48 +05:30
Yuta Saito
16ebfb0d5c docs: add mcp faq 2026-01-14 15:08:31 +09:00
Yuta Saito
2d3c292cd8 chore: Clarify MCP OAuth token handling in UI 2026-01-14 14:31:18 +09:00
Sameer Kankute
bc8abf8b4b Add support for openrouter image generation endpoint 2026-01-14 10:15:02 +05:30
Ishaan Jaff
1b00576711
[Feat] New Model - Azure Model Router on LiteLLM AI Gateway (#19054)
* fix - azure model router integration

* fix:_check_provider_match

* fix:_get_response_model

* tests azure model router

* test_azure_ai_model_router_streaming_model_in_chunk

* fix LlmProviders.AZURE.value

* test_azure_ai_model_router_streaming_cost_with_stream_options

* def test_get_model_from_chunks_azure_model_router():

* _get_model_from_chunks

* docs azure model router

* azure model router
2026-01-13 18:31:43 -08:00
Sameer Kankute
1932d03aed Add docs on Zero-Cost Models 2026-01-13 16:44:02 +05:30
Ishaan Jaff
a1bba8c99b
[Feat] MSFT SSO - allow overriding env var attribute names (#18998)
* add MSFT SSO constants

* fix MSFT SSO env vars

* test_microsoft_sso_handler_openid_from_response_with_custom_attributes
2026-01-12 18:56:35 -08:00
Ishaan Jaff
21d611554b
[Fix] MSFT SSO - allow setting custom MSFT Base URLs (#18977)
* fix TestCustomMicrosoftSSO

* init CustomMicrosoftSSO

* use CustomMicrosoftSSO

* docs fix

* docs fix
2026-01-12 18:26:53 -08:00
Ishaan Jaffer
f5fc38dcf9 docs litellm cloud 2026-01-12 13:55:56 -08:00
Ishaan Jaffer
5c300b2414 docs fix 2026-01-12 09:50:40 -08:00
Sameer Kankute
d3dbe4ffab Add preview to v1.80.15 release note 2026-01-12 22:36:43 +05:30
Sameer Kankute
4cf4d205ba Add preview to v1.80.15 release note 2026-01-12 22:14:14 +05:30
Sameer Kankute
9a27a52424
Merge pull request #18956 from BerriAI/litellm_staging_01_12_2026
Litellm staging 01 12 2026
2026-01-12 18:27:57 +05:30
Cesar Garcia
c81cd081e9
feat(bedrock): add OpenAI-compatible service_tier parameter translation (#18091)
* feat(bedrock): add OpenAI-compatible service_tier parameter translation

Translates OpenAI's service_tier parameter (string) to Bedrock's
serviceTier format (object with type field).

* docs(bedrock): add OpenAI-compatible service_tier parameter documentation

Document the automatic translation from OpenAI-style service_tier
parameter to Bedrock's native serviceTier format.

* feat(bedrock): add service_tier to response when present

According to OpenAI's API documentation, when service_tier is sent in the
request, it should be returned in the response. This commit implements
this behavior for Bedrock Converse API to maintain compatibility with
OpenAI's API.

Changes:
- Added serviceTier field to ConverseResponseBlock type definition
- Moved ServiceTierBlock definition before ConverseResponseBlock to fix
  type reference order
- Added response transformation to map Bedrock serviceTier (object) to
  OpenAI service_tier (string format)
- Added 4 new tests for response transformation with service_tier

The service_tier is only added to the response when present in Bedrock's
response, maintaining backward compatibility.
2026-01-12 17:28:49 +05:30
Cesar Garcia
087ddee227
docs: update message content types link and add content types table (#18209)
* docs: update message content types link and add content types table

- Update "See All Message Values" link to point to main branch (line 664)
  instead of outdated commit 8600ec7 (line 392)
- Add Content Types table documenting all 6 multimodal content types:
  text, image_url, input_audio, video_url, file, document
- Link to existing docs for vision, audio, and document understanding

* docs: add type definition links for text and video_url

* docs: fix text type definition link to line 598

* docs: remove provider labels from file/document types

* docs: add examples for all content types per review feedback
2026-01-12 17:09:23 +05:30
Harshit Jain
3257cc7129
doc: updated pass_through with guided param (#18886) 2026-01-12 16:56:16 +05:30
Harshit Jain
45ac107bee
doc: update load balancing and routing with enable_pre_call_checks (#18888) 2026-01-12 16:47:25 +05:30
Harshit Jain
f9430d1cab
docs: add Redis requirement warning for high-traffic deployments (#18892) 2026-01-12 16:46:52 +05:30
Ishaan Jaffer
f768b698a9 docs fix 2026-01-11 11:57:23 -08:00
Ishaan Jaffer
1271044b06 1.80.15 2026-01-11 11:57:04 -08:00
Alexsander Hamir
624c9420b9
perf release notes (#18915) 2026-01-10 16:41:54 -08:00
yuneng-jiang
039e11cbe5 Endpoint activity writeup 2026-01-10 15:42:20 -08:00
Ishaan Jaffer
58bc308d47 docs levo ai 2026-01-10 15:07:58 -08:00
Ishaan Jaffer
451d240a41 fix 2026-01-10 15:05:38 -08:00
Ishaan Jaffer
64d029bce7 docs fix 2026-01-10 15:04:06 -08:00
Ishaan Jaffer
a4758ab532 QA release notes 2026-01-10 14:57:16 -08:00
Ishaan Jaffer
17995c5192 rc1 writeup 2026-01-10 14:51:56 -08:00
Ishaan Jaffer
9b4f3308fc docs fix 2026-01-10 14:45:55 -08:00
Ishaan Jaffer
f37ccca19c docs fix 2026-01-10 14:04:47 -08:00
Ishaan Jaffer
ff8e9aeb5c Revert "Add support for Vertex AI API keys"
This reverts commit ad501048f3.
2026-01-10 13:39:49 -08:00
Ishaan Jaff
c0cf8bc27d
[Feat] Manus FILES API - Add File upload, get, delete, list (#18904)
* add MANUS get response

* init TwoStepFileUploadRequest

* init TwoStepFileUploadConfig

* add async_create_file to handle 2 step uploads

* init ManusFilesConfig

* add add get_provider_files_config MANUS

* fix validate_environment

* test_manus_files_api_e2e_all_methods

* aws fix base

* init files API MANUS

* test_manus_responses_api_with_file_upload

* mypy lint fixes

* fix BedrockFilesConfig

* manus docs

* docs manus

* mypy lint

* add add fix resposne api utils MANUS
2026-01-10 13:27:54 -08:00
yuneng-jiang
5c46053307 Adding image 2026-01-10 13:15:23 -08:00
yuneng-jiang
ff938e7c27 v1.80.13 docs work in progress 2026-01-10 13:04:11 -08:00
Elkhan Eminov
062f5892da
update OpenRouter docs to include embedding support (#18874) 2026-01-10 11:42:02 -08:00
DominikHallab
fa2b0fb533
docs: Update header to be markdown bold by removing space (#18846) 2026-01-10 00:32:21 +05:30
Sameer Kankute
844c766c65
Merge pull request #18763 from BerriAI/litellm_staging_01_07_2026
Staging - 01/07/2026
2026-01-09 17:01:58 +05:30
Yuta Saito
022db6c9ed feat: add mcp registry 2026-01-09 15:07:39 +09:00
Sameer Kankute
d9b275e62a
Merge pull request #18806 from BerriAI/litellm_vertex_ai_api_key_support
[FEAT]: Add support for Vertex AI API keys
2026-01-09 09:44:36 +05:30
YutaSaito
e678540843
Merge pull request #18836 from drorIvry/main
feat: added qualifire eval webhook
2026-01-09 11:06:45 +09:00
Yuta Saito
c38294dc16 docs: add focus 2026-01-09 07:55:55 +09:00
YutaSaito
661f03058c
Merge pull request #18802 from BerriAI/litellm_feat_focus_backend
[feat] Focus export support
2026-01-09 07:21:04 +09:00
Dror Ivry
e6c41c8f47
docs 2026-01-09 00:08:47 +02:00
Dror Ivry
5793f8b866
docs 2026-01-09 00:08:03 +02:00
Dror Ivry
8ff4cb89e1
feat: added qualifire eval webhook 2026-01-09 00:03:26 +02:00
Cesar Garcia
7743c739a3
docs: fix PDF documentation inconsistency in Anthropic page (#18816)
Updated description to match the code example which uses `file`
content type with `file_data` field, instead of incorrectly
mentioning `image_url`.
2026-01-08 23:46:17 +05:30
Chongshun
60edf13a21
feat(tag-routing): support toggling tag matching between ANY and ALL (#18776) 2026-01-08 23:39:03 +05:30
Ishaan Jaff
cbac70a4ec
MANUS docs (#18817) 2026-01-08 18:58:10 +05:30
Sameer Kankute
ad501048f3 Add support for Vertex AI API keys 2026-01-08 15:22:14 +05:30
Yuta Saito
790c80070f docs: add FOCUS env 2026-01-08 17:24:51 +09:00
Sameer Kankute
af6883712e Add tests for kimi 2 bedrock model 2026-01-08 10:07:33 +05:30
Alexsander Hamir
98d7a428b6
Fix: Clarify database_connection_pool_limit applies per worker, not per instance (#18780) 2026-01-07 13:57:03 -08:00
Krish Dholakia
c89a4115eb
Update production proxy resource recommendations (#18771)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-01-08 00:37:12 +05:30
Ishaan Jaff
929af510fa
[Feat] New provider - Add Azure BFL FLux for image edits (#18766)
* add azure_ai/flux.2-pro

* get_flux2_image_generation_url

* azure_client_params

* docs

* add Image Editing

* add azure ai image edits

* AzureFoundryFlux2ImageEditConfig

* TestAzureAIFlux2ImageEdit
2026-01-07 23:28:39 +05:30
Ishaan Jaff
3430325919
[Feat] Add Azure BFL - Flux 2 models (#18764)
* add azure_ai/flux.2-pro

* get_flux2_image_generation_url

* azure_client_params

* docs
2026-01-07 23:28:28 +05:30
Abliteration AI
dc4ce7c5a2
feat: Add abliteration.ai provider (#18678)
* feat: Add abliteration.ai provider

* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* add team member budget duration in team/update

* Reusable Duration Select and update team member budget UI

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
2026-01-07 21:46:54 +05:30
kothamah
1b8708fccc
Litellm embeddings calltype fix for guardrail precallhook (#18740)
* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* add team member budget duration in team/update

* Reusable Duration Select and update team member budget UI

* feat: allow configuring project name for OpenTelemetry service name

* docs: sets ARIZE_PROJECT_NAME

* added valid callType for bedrock guardrail pre hook

This is to resolve the error when bedrock guardrails are enabled and invoke the embedding models.   {"error":{"message":"'embeddings' is not a valid CallTypes","type":"None","param":"None","code":"500"}}*

* updated the test case to reflect valid callType

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
Co-authored-by: Yuta Saito <uc4w6c@bma.biglobe.ne.jp>
2026-01-07 21:40:36 +05:30
Kris Xia
91b5c66cf2
fix(proxy): return json error response instead of sse format for initial streaming errors (#18757)
* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* fix(proxy): return json error response instead of sse format for initial streaming errors

when the first chunk of a streaming response contains an error,
return a standard json error response instead of sse format.
this ensures clients receive properly formatted error responses
before the stream actually begins.

- rename create_streaming_response to create_response
- add logic to detect error in first chunk and return JSONResponse
- add _extract_error_from_sse_chunk helper function
- update all call sites to use the new function name
- update tests to reflect the function rename

* test(proxy): add comprehensive tests for error extraction from sse chunks

- Add new test class TestExtractErrorFromSSEChunk with 10 test cases
- Update existing tests to verify JSONResponse returned for initial streaming errors
- Add tests for error code as string, bytes input, invalid JSON, and edge cases
- Verify correct error format extraction from SSE chunks

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
2026-01-07 21:26:47 +05:30
Krish Dholakia
80ead21c3a
Litellm improve endpoint discovery (#18762)
* docs: document all endpoints in .json and add consistency checks against docs + providers.json

* docs: add more tests + improve coverage
2026-01-07 17:35:01 +05:30
drorIvry
000913fa12
Hotfix - docs qualifire (#18724)
* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire
2026-01-07 17:23:12 +05:30
Ishaan Jaffer
3530218930 fix aupload_container_file 2026-01-07 14:19:36 +05:30
Ishaan Jaff
1f141f0dbb
[Feat] Litellm new endpoint add container file upload (#18743)
* init upload_container_file

* init upload_container_file

* _prepare_multipart_file_upload

* fix upload_container_file

* aupload_container_file, upload_container_file

* register_container_file_endpoints
2026-01-07 13:36:55 +05:30
Yuta Saito
e5be160ae0 docs: sets ARIZE_PROJECT_NAME 2026-01-07 14:27:16 +09:00
Goutham Karthi
2865b17988 adding signoz integration to observability docs 2026-01-06 15:29:44 -08:00