Commit Graph

34378 Commits

Author SHA1 Message Date
YutaSaito
9114e44b49
Merge pull request #18993 from BerriAI/litellm_fix_remove_flaky_test
[test] remove flaky azure oidc embedding test
2026-01-13 10:37:30 +09:00
yuneng-jiang
b610dad3b8 fixing build 2026-01-12 17:34:47 -08:00
Yuta Saito
a57f1e2e08 test: remove flaky azure oidc embedding test 2026-01-13 10:34:01 +09:00
yuneng-jiang
7d468bc9e3 refetch after key create 2026-01-12 17:31:37 -08:00
Yuta Saito
4daac9e332 chore: add ALLOWED_CVES 2026-01-13 10:30:34 +09:00
Yuta Saito
54b21cabf7 chore: add config option 2026-01-13 10:19:12 +09:00
Yuta Saito
a0e0026df0 chore: document temporary grype ignore for CVE-2019-1010022 2026-01-13 10:09:23 +09:00
yuneng-jiang
567f723214 Merge remote-tracking branch 'origin' into litellm_user_promethus_metrics 2026-01-12 15:59:16 -08:00
yuneng-jiang
a0a8412a7c Merge remote-tracking branch 'origin' into litellm_hakhundov_contribution 2026-01-12 15:58:12 -08:00
yuneng-jiang
9f9e5dd337
Merge pull request #18916 from BerriAI/litellm_ui_org_filters_1
[Feature] UI - Organization Table Filters
2026-01-12 15:57:37 -08:00
yuneng-jiang
c75a370619
Merge pull request #18910 from BerriAI/litellm_org_filtering_search
[Feature] /organization/list Query Params
2026-01-12 15:57:26 -08:00
yuneng-jiang
fb420a5de8
Merge pull request #18985 from BerriAI/litellm_e2e_neon_script_1
[Infra] UI - E2E Tests: Neon E2E DB Script
2026-01-12 15:56:22 -08:00
Ishaan Jaffer
f5fc38dcf9 docs litellm cloud 2026-01-12 13:55:56 -08:00
yuneng-jiang
685437c9cc Adding help scripts for neon 2026-01-12 13:51:09 -08:00
YutaSaito
cc1da800f0
Merge pull request #18983 from BerriAI/litellm_fix_helm_chart_testing
[test] helm chart testing
2026-01-13 06:47:49 +09:00
Yuta Saito
b6bb90f252 test: helm chart testing
load local Docker image for helm chart tests
2026-01-13 06:40:57 +09:00
YutaSaito
9caf685f1e
Merge pull request #18940 from BerriAI/litellm_fix_extra_headers
[fix] forward MCP extra headers case-insensitively
2026-01-13 06:03:19 +09:00
Ephrim Stanley
99cb59c2d2 Add end to end integration tests for batches 2026-01-12 13:58:47 -05:00
Ephrim Stanley
2763b91960 Add end to end integration tests for batches 2026-01-12 13:55:27 -05:00
yuneng-jiang
834b0207ed
Merge pull request #18778 from Jetemple/clear-buttons-dropdowns
fix: add allowClear to dropdown components for better UX
2026-01-12 10:38:33 -08:00
Ishaan Jaffer
5c300b2414 docs fix 2026-01-12 09:50:40 -08:00
Sameer Kankute
d3dbe4ffab Add preview to v1.80.15 release note 2026-01-12 22:36:43 +05:30
Sameer Kankute
4cf4d205ba Add preview to v1.80.15 release note 2026-01-12 22:14:14 +05:30
Sameer Kankute
c2fcc6aa92
Merge pull request #18945 from BerriAI/litellm_add_anthropic_tool_call_results
Add: missing anthropic tool results in response
2026-01-12 22:11:51 +05:30
Sameer Kankute
01e690307e Fix: litellm/tests/test_litellm/llms/anthropic/chat/test_anthropic_chat_transformation.py 2026-01-12 22:02:18 +05:30
Ishaan Jaff
f98814ba8a
fix include proxy/prisma_migration.py in non root (#18971) 2026-01-12 08:12:39 -08:00
Ephrim Stanley
3256eb21a0 Add end to end integration tests for batches 2026-01-12 10:43:09 -05:00
Ephrim Stanley
935c249c45 Add end to end integration tests for batches 2026-01-12 09:53:54 -05:00
Sameer Kankute
5618da6605
Merge pull request #18960 from BerriAI/litellm_fix_embedding_forwardable_headers
Fix: Header forwarding for embeddings endpoint
2026-01-12 18:30:55 +05:30
Sameer Kankute
4c0ca53153
Merge pull request #18962 from BerriAI/main
merge main
2026-01-12 18:30:28 +05:30
Sameer Kankute
9a27a52424
Merge pull request #18956 from BerriAI/litellm_staging_01_12_2026
Litellm staging 01 12 2026
2026-01-12 18:27:57 +05:30
Sameer Kankute
8b5e2bcf25
Merge pull request #18957 from BerriAI/litellm_respones_api_gaurdrails1
Fix: gaurdrail moderation support with responses API
2026-01-12 18:16:22 +05:30
Chesars
1aa6384249 fix: resolve mypy type error in _is_potential_model_name_in_model_cost
Add explicit str() conversion when calling _get_model_cost_key to satisfy
mypy type checking. TypedDict.values() returns object type, not str.
2026-01-12 09:46:06 -03:00
Sameer Kankute
ebf61998e0
Merge pull request #18954 from BerriAI/litellm_replicate_support
[Feat] Add all chat replicate models support
2026-01-12 18:15:46 +05:30
Sameer Kankute
c4864cba72
Merge pull request #18949 from BerriAI/litellm_update_bug_report
[Feat] Add steps-to-reproduce section in bug report
2026-01-12 18:14:39 +05:30
Sameer Kankute
f44178c18d
Merge pull request #18948 from BerriAI/litellm_gemini_imageConfig
Fix: [Bug]: Gemini Image Generation: imageConfig parameters
2026-01-12 18:14:19 +05:30
Sameer Kankute
98f1a0d0c4
Merge pull request #18946 from BerriAI/litellm_add_max_completion_tokens_with_thinking_budget
Fix: respect max_completion_tokens in thinking feat
2026-01-12 18:13:23 +05:30
Sameer Kankute
ec3e30a221
Merge branch 'main' into litellm_add_anthropic_tool_call_results 2026-01-12 18:13:06 +05:30
Sameer Kankute
db32ac217a
Merge pull request #18944 from BerriAI/litellm_fix_bedrock_passthrough_model_id
Fix : model id encoding for bedrock passthrough
2026-01-12 18:08:53 +05:30
Sameer Kankute
27b4c68662
Merge pull request #18942 from BerriAI/litellm_add_ssl_verify_bedrock2
[Bug]: Add Custom CA certificates to boto3 clients
2026-01-12 18:06:32 +05:30
Sameer Kankute
dbec9c7084 Fix: Header forwarding for embeddings endpoint 2026-01-12 18:00:48 +05:30
Cesar Garcia
a8282839e8
fix(text_completion): support token IDs (list of integers) as prompt (#18011)
* fix(text_completion): support token IDs (list of integers) as prompt

Add support for passing token IDs (list of integers) to the text_completion
endpoint for OpenAI-compatible providers (openai, azure, vllm, etc.).

Fixes #17118

* test(text_completion): replace live test with mock test for token IDs

Move token IDs test from local_testing to test_litellm with mocks
per PR review feedback.
2026-01-12 17:33:24 +05:30
Krrish Dholakia
cddee1de97 refactor: fix linting error 2026-01-12 17:31:43 +05:30
Cesar Garcia
c81cd081e9
feat(bedrock): add OpenAI-compatible service_tier parameter translation (#18091)
* feat(bedrock): add OpenAI-compatible service_tier parameter translation

Translates OpenAI's service_tier parameter (string) to Bedrock's
serviceTier format (object with type field).

* docs(bedrock): add OpenAI-compatible service_tier parameter documentation

Document the automatic translation from OpenAI-style service_tier
parameter to Bedrock's native serviceTier format.

* feat(bedrock): add service_tier to response when present

According to OpenAI's API documentation, when service_tier is sent in the
request, it should be returned in the response. This commit implements
this behavior for Bedrock Converse API to maintain compatibility with
OpenAI's API.

Changes:
- Added serviceTier field to ConverseResponseBlock type definition
- Moved ServiceTierBlock definition before ConverseResponseBlock to fix
  type reference order
- Added response transformation to map Bedrock serviceTier (object) to
  OpenAI service_tier (string format)
- Added 4 new tests for response transformation with service_tier

The service_tier is only added to the response when present in Bedrock's
response, maintaining backward compatibility.
2026-01-12 17:28:49 +05:30
Sameer Kankute
ab85eb8f43 Fix: gaurdrail moderation support with responses API 2026-01-12 17:27:13 +05:30
Cesar Garcia
9a8e781cb9
fix(anthropic): preserve web_fetch_tool_result in multi-turn conversations (#18142)
Fixes #18137

Similar to the fix for web_search_tool_result (#17746, #17798), this PR
preserves web_fetch_tool_result blocks in multi-turn conversations.

Changes:
- Add handling for web_fetch_tool_result in transformation.py (non-streaming)
- Add capture of web_fetch_tool_result in handler.py (streaming)
- Fix streaming tool arguments bug where empty input {} was prepended to
  actual arguments by using empty string instead of str({})
- Add unit tests for web_fetch_tool_result handling
2026-01-12 17:18:33 +05:30
Cesar Garcia
f7912990b7
fix(gemini): add presence_penalty support for Google AI Studio (#18154)
Fixes #14753

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2026-01-12 17:12:19 +05:30
Cesar Garcia
087ddee227
docs: update message content types link and add content types table (#18209)
* docs: update message content types link and add content types table

- Update "See All Message Values" link to point to main branch (line 664)
  instead of outdated commit 8600ec7 (line 392)
- Add Content Types table documenting all 6 multimodal content types:
  text, image_url, input_audio, video_url, file, document
- Link to existing docs for vision, audio, and document understanding

* docs: add type definition links for text and video_url

* docs: fix text type definition link to line 598

* docs: remove provider labels from file/document types

* docs: add examples for all content types per review feedback
2026-01-12 17:09:23 +05:30
Cesar Garcia
573df855d3
fix(oci): handle OpenAI-style image_url object in multimodal messages (#18272)
The OCI adapter now accepts both string and object formats for image_url:
- String: "image_url": "https://example.com/image.png"
- Object: "image_url": {"url": "https://example.com/image.png"}

This fixes compatibility with OpenAI Vision API format.
2026-01-12 17:08:32 +05:30
Cesar Garcia
46dd420833
fix: sync Helm chart versioning with production standards and Docker versions (#18868)
* fix: sync Helm chart versioning with production standards and Docker versions

- Update Chart.yaml version from 0.4.10 to 1.0.0 (SemVer 0.x is for development, 1.0+ for production)
- Update appVersion from v1.50.2 to v1.80.12 to match current Docker image version
- Update workflow defaults from 0.1.0 to 1.0.0 for new chart version scheme
- Maintain independent chart versioning per Helm best practices

This ensures:
- Helm chart follows SemVer production standards (1.x instead of 0.x)
- appVersion stays synchronized with Docker/application version
- Chart version remains independent for flexibility (can update chart without waiting for app releases)

* fix: sync Helm chart appVersion with Docker image tags in release workflow

Updates the GitHub workflow to ensure Helm chart appVersion matches the
Docker image tags that are actually published:

- For stable/rc releases: Uses the workflow input tag (e.g., v1.80.12)
- For latest/dev releases: Uses the release_type to match main-{type} tags
- Makes 'tag' input required to prevent accidental releases with wrong versions
- Simplifies fallback logic by removing git-describe dependency

This ensures the chart's appVersion correctly references Docker images
that exist, preventing deployment failures from missing image tags.

* Update ghcr_deploy.yml
2026-01-12 17:04:59 +05:30