Ishaan Jaff
a8be3ae412
[Feat] Add Cost Tracking for /ocr endpoints ( #15678 )
...
* mistral/mistral-ocr-latest
* fix: add _hidden_params to OCRResponses
* test: hidden params exists
* feat: add mistral/mistral-ocr-2505-completion
* fix test
* add ModelInfoBase fields
* fix get OCR cost
* check response cost from OCR
* add handling for OCR costs
* add mistral-document-ai-2505
* docs OCR
* ruff check fix
2025-10-17 15:54:10 -07:00
Ishaan Jaff
6c26971cd4
[Bug Fix] Tags as metadata dicts were raising exceptions ( #15625 )
...
* fix get_tags_from_request_body
* Revert "fix get_tags_from_request_body"
This reverts commit 1c044dad999500b5c11ec96f528212c248f72f61.
* fix get_tags_from_request_body
* test_get_tags_from_request_body_with_dict_tags
2025-10-17 13:20:07 -07:00
Ishaan Jaff
92bfc3e12c
Fix: Support us-gov prefix for AWS GovCloud Bedrock models ( #15626 )
...
* fix _supported_cross_region_inference_region
* test_govcloud_cross_region_inference_prefix
2025-10-17 13:19:51 -07:00
Ishaan Jaff
845c43a24e
Merge pull request #15642 from jlan-nl/litellm-gemini-flash-2.5-image-web-search
...
Fix: Gemini 2.5 Flash Image should not have supports_web_search=true
2025-10-17 13:19:08 -07:00
Ishaan Jaff
9bbf1e0c96
Merge pull request #15670 from BerriAI/litellm_fix_watsonx_pricing
...
[Fix (pricing)] - Fix pricing for watsonx model family for various models
2025-10-17 13:18:27 -07:00
Ishaan Jaff
fa1b6feccd
Merge pull request #15668 from BerriAI/litellm_fix_bedrock_gpt_oss
...
[Fix] GPT-OSS in Bedrock now supports streaming. Revert fake streaming
2025-10-17 13:16:48 -07:00
Ishaan Jaff
8f710abe05
Merge pull request #15672 from BerriAI/litellm_key_max_budget_error_fix
...
[Fix] UI - Key Max Budget Removal Error Fix
2025-10-17 12:15:20 -07:00
yuneng-jiang
4d070abbce
Key Max Budget Removal Error Fix
2025-10-17 12:04:58 -07:00
Ishaan Jaffer
3bc8f76d12
fixes for various models with incorrect pricing
2025-10-17 11:51:22 -07:00
Ishaan Jaffer
8b179f0a89
pricing: fix watsonx/openai/gpt-oss-120b
2025-10-17 11:40:34 -07:00
Ishaan Jaffer
f342ef3842
test fix
2025-10-17 11:18:29 -07:00
Ishaan Jaffer
b2aa24f938
fix: should_fake_stream
2025-10-17 11:17:42 -07:00
Ishaan Jaffer
3df0fb0b45
test fix
2025-10-17 10:46:42 -07:00
Ishaan Jaff
3b1fdb56b9
Merge pull request #15658 from BerriAI/litellm_response_mode_add_health
...
Add support for responses mode in health check
2025-10-17 09:44:34 -07:00
Ishaan Jaffer
09a2e32663
test_completion_cohere_command_r_plus_function_call
2025-10-17 09:40:14 -07:00
Ishaan Jaffer
80af02a1c3
test fix: tests.test_litellm.proxy.guardrails.guardrail_hooks.guardrails_ai.test_guardrails_ai::test_guardrails_ai_process_input
2025-10-17 09:39:32 -07:00
Sameer Kankute
282eedb72b
Add responses mode to health check
2025-10-17 22:06:29 +05:30
IQHL (Hans Jacob Landelius)
d49c5dfd18
supports_web_search=false for gemini 2.5 flash image
2025-10-17 10:58:23 +02:00
YutaSaito
bb3b77cbeb
feat: add guardrail for image generation ( #15619 )
...
* feat: add guardrail for image generation
* fix: use get_str_from_messages
2025-10-16 21:50:30 -07:00
Lucas Sugi
be8854f62e
fix: Convert object to a correct type ( #15634 )
2025-10-16 21:47:32 -07:00
Nicholas Couture
8032e73872
[Fix] Ensure guardrail memory sync after database updates ( #15633 )
...
* chore: Consistency in install-test-deps using poetry run
* feat: update in-memory guardrails after database CRUD operations
* test: add parameterized tests for guardrail CRUD with memory sync
2025-10-16 21:46:49 -07:00
Krrish Dholakia
814aeb5fad
fix(pass_through_endpoints.py): ensure passthrough endpoints are loaded in from db correctly on restarts
2025-10-16 21:39:48 -07:00
Krish Dholakia
3ff073c811
UI - add arize on ui, LLMs - clarifai refactor to openai compatible route, added azure ai/grok-4 model family
...
* added oauth mcp to docs
* added azure ai/grok-4 model family
* Revert "added oauth mcp to docs"
This reverts commit 950b7cef44f14b2db1429f6fbd32548a7c95d325.
* fix: arize ui integration
* need to remove a file
This reverts commit d6c877b73ac763464f204b77135f3786342373b7.
* fix: add arize from ui
* updated clarifai functions to openai compatible (#15615 )
* fix: npm build errors
* Snowflake provider support: added embeddings, PAT, account_id (#15372 )
* snowflake support PAT, account_id and embeddings
* format
* test embeddings
* format
* complete test
---------
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
* Revert "Snowflake provider support: added embeddings, PAT, account_id (#15372 )" (#15632 )
This reverts commit c6d58e5b4af8493c020fa519d72ec6ebc90c896b.
---------
Co-authored-by: mubashir1osmani <mubashir.osmani777@gmail.com>
Co-authored-by: Mubashir Osmani <ilikewafflesomcuh@gmail.com>
Co-authored-by: mogith-pn <143642606+mogith-pn@users.noreply.github.com>
Co-authored-by: Andrey <elkin.andr@gmail.com>
2025-10-16 20:39:15 -07:00
Ishaan Jaffer
39b0e76a33
test_completion_cohere_command_r_plus_function_call
2025-10-16 20:33:41 -07:00
Ishaan Jaffer
64876634ef
ui new build
2025-10-16 20:32:51 -07:00
Ishaan Jaffer
7a1f654da6
ui new build
2025-10-16 18:37:42 -07:00
Ishaan Jaffer
13e895b9b0
test fix
2025-10-16 18:00:46 -07:00
Ishaan Jaffer
1c21b2e285
fixes: AI/ML API
2025-10-16 17:52:37 -07:00
Ishaan Jaffer
1c53a686d5
fix e2eui
2025-10-16 17:48:27 -07:00
Ishaan Jaffer
bf20ecab80
Revert "fix get_tags_from_request_body"
...
This reverts commit 1c044dad999500b5c11ec96f528212c248f72f61.
2025-10-16 17:40:08 -07:00
Ishaan Jaffer
96449b319c
fix get_tags_from_request_body
2025-10-16 17:40:08 -07:00
Ishaan Jaff
02758ebc28
Merge pull request #15553 from BerriAI/litellm_oct_staging2
...
[Staging] Oct Staging branch 2
2025-10-16 17:38:20 -07:00
Ishaan Jaffer
ea69f4547d
Merge branch 'main' into litellm_oct_staging2
2025-10-16 17:06:29 -07:00
Ishaan Jaffer
00e6ec4985
bump: version 1.78.2 → 1.78.3
2025-10-16 16:57:04 -07:00
Ishaan Jaff
f69f7d101b
Merge pull request #15618 from BerriAI/litellm_bedrock_invoke_support
...
[Feat] Allow calling /invoke, /converse routes through AI Gateway + models on config.yaml
2025-10-16 16:56:23 -07:00
Ishaan Jaffer
a31a8108b5
fix pass thu ruff check
2025-10-16 16:45:14 -07:00
Ishaan Jaffer
0bef295b15
doc fix
2025-10-16 16:36:24 -07:00
Ishaan Jaffer
bbf9d6a57b
docs boto3 instructions
2025-10-16 16:34:56 -07:00
Ishaan Jaffer
79516563a9
docs add /invoke and /converse routes
2025-10-16 16:25:27 -07:00
Ishaan Jaffer
8c5d6891d4
docs pt
2025-10-16 16:18:13 -07:00
Ishaan Jaffer
fe5dd23a84
docs boto3 pass thoughs
2025-10-16 16:17:02 -07:00
Ishaan Jaffer
c2b69e371c
docs pass through
2025-10-16 16:13:08 -07:00
Ishaan Jaffer
f87c86806c
docs invoke
2025-10-16 16:13:01 -07:00
Ishaan Jaff
5009a43b0e
Merge pull request #15608 from BerriAI/litellm_sso_add_pkce
...
[Feat] UI SSO - Add PKCE for OKTA SSO
2025-10-16 15:48:10 -07:00
Ishaan Jaff
f27f2d4803
Merge branch 'main' into litellm_sso_add_pkce
2025-10-16 15:48:01 -07:00
Ishaan Jaffer
bcf53c6ceb
working - errors from bedrock through pass throughs
2025-10-16 15:40:42 -07:00
Krrish Dholakia
e43c3b9b88
test: add unit testing
2025-10-16 15:37:26 -07:00
Ishaan Jaffer
51f1907e98
test_bedrock_error_handling_returns_actual_error
2025-10-16 15:36:51 -07:00
Krrish Dholakia
b85aeb08ce
fix(ui_sso.py): support both 'app_roles' and 'roles' claim on jwt decode for SSO handler
2025-10-16 15:29:34 -07:00
Ishaan Jaffer
e17636d4a6
add _extract_model_from_bedrock_endpoint
2025-10-16 15:26:32 -07:00
