Duc Tran
e3d947abeb
bump orjson version to "3.11.2"
2025-08-26 23:21:53 +07:00
Andrew Doan
fc4c10afdf
Add Builds
2025-08-26 11:55:28 -04:00
manascb1344
1150b93e8f
feat(constants): expand nebius_models set with DeepSeek, Llama, Qwen, NVIDIA, ZAI, and others; normalize model IDs (remove -fast variants, add new instruct/thinking variants)
2025-08-26 18:20:29 +05:30
Mohse Morad
6c01c3a547
WIP
2025-08-26 15:25:17 +03:00
Krish Dholakia
55c3fd62ac
Add Claude Opus 4 and 4.1 via OpenRouter and Fix Claude Sonnet 4 and 3.7 via OpenRouter in Prices and Context Window Config
...
Update model prices and context window
2025-08-25 23:28:39 -07:00
Krish Dholakia
3803af5ff5
Merge pull request #13566 from kankute-sameer/fix/azure-gpt4-web-search-support
...
fix: remove incorrect web search support for azure/gpt-4.1 family
2025-08-25 23:28:15 -07:00
Krish Dholakia
ae678a6642
Merge pull request #13573 from Ivy-Interactive/feature/braintrust-span-name-metadata
...
Feature/braintrust span name metadata
2025-08-25 23:19:56 -07:00
Krish Dholakia
3ed1220f75
Merge pull request #13916 from mubashir1osmani/openai-multiple-images
...
feat: multiple images in openai images/edits endpoint
2025-08-25 23:11:13 -07:00
Krish Dholakia
22934907ba
Merge pull request #13933 from michal-otmianowski/ignore-expired-s3-cache-entries
...
Verify if cache entry has expired prior to serving it to client
2025-08-25 23:10:48 -07:00
Krish Dholakia
b1bc8e3aa2
Merge pull request #13955 from ckoehler/push-oymwkvxmkqxv
...
feat: add image headers for Copilot
2025-08-25 23:04:24 -07:00
Krish Dholakia
51b491e7a1
Merge pull request #13958 from TeddyAmkie/pricing/deepseek-v3p1
...
Add DeepSeek-v3.1 pricing for Fireworks AI provider
2025-08-25 23:03:39 -07:00
Teddy Amkie
97e9502f4a
Add DeepSeek-v3.1 pricing for Fireworks AI provider
...
- Add fireworks_ai/accounts/fireworks/models/deepseek-v3p1 model configuration
- Set context window: 128K input, 8K output tokens
- Pricing: /bin/zsh.56/1M input tokens, .68/1M output tokens
- Supports response schema and tool choice
- Based on DeepSeek API unified pricing effective Sept 2025
2025-08-25 18:41:49 -07:00
Ishaan Jaff
6ce1d82970
[Bug] Fix: Vertex Mistral not working for streaming ( #13952 )
...
* fix OpenAI like chat handler
* fix MockResponse
* test_partner_models_httpx_streaming
* test_partner_models_httpx_streaming
2025-08-25 17:39:40 -07:00
Christoph Koehler
04cca1e7f3
feat: add image headers for Copilot
...
Fixes #13696 . See issue for details.
2025-08-25 18:15:26 -06:00
Ishaan Jaff
c7b0c57b1e
[Bug Fix] Azure Passthrough request with streaming ( #13831 )
...
* fix: _update_stream_param_based_on_request_body
* test_update_stream_param_based_on_request_body
* test_pass_through_request_stream_param_override
2025-08-25 14:11:17 -07:00
Ishaan Jaff
433d1a4947
[Bug fix] - Fix /messages fallback from Anthropic API -> Bedrock API ( #13946 )
...
* use helper get_provider_specific_headers
* fix get_provider_specific_headers
* test_anthropic_messages_fallbacks
* bedrock/us.anthropic.claude-sonnet-4
* fix: get_provider_specific_headers
* TestProviderSpecificHeaderUtils
* test_anthropic_messages_fallbacks
2025-08-25 13:44:54 -07:00
Andrew Doan
df45e0e4b9
Change pkg name and authors
2025-08-25 16:37:01 -04:00
0x5751
8dd04c4eee
fix: test error
2025-08-26 01:58:04 +08:00
0x5751
d6cd50dfdb
feat: Add support for custom Anthropic-compatible API endpoints
...
This commit adds support for custom Anthropic-compatible API endpoints
that don't follow the standard /v1/messages or /v1/complete path convention.
## Changes
- Added LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX environment variable
- When set to true, prevents automatic appending of /v1/messages (for anthropic)
- When set to true, prevents automatic appending of /v1/complete (for anthropic_text)
- Added debug logging to indicate when suffix is being skipped
- Maintained full backward compatibility - existing deployments are unaffected
2025-08-26 01:22:51 +08:00
Andrew Doan
dac20702f2
Modify cryptography dependency to latest
2025-08-25 13:13:36 -04:00
Ishaan Jaff
c1ee8c26af
[UI QA] - Allow setting Team Member RPM/TPM limits when creating a team ( #13943 )
...
* allow setting team_member_rpm_limit on creating
* create_team_member_rate_limits
* docs fix
* fix img
2025-08-25 09:12:50 -07:00
Ishaan Jaff
7c5e9b666b
update release notes
2025-08-25 08:17:30 -07:00
Michal Otmianowski
3b6462236c
clean imports
2025-08-25 11:09:06 +02:00
Michal Otmianowski
c444263e7d
verify expires field prior to serving cache entry
2025-08-25 10:42:12 +02:00
Krish Dholakia
68aaeb4f4a
Merge pull request #13914 from uc4w6c/docs/fix-custom-guardrail-imports
...
Fix missing and unused imports in custom_guardrail docs example
2025-08-25 00:57:46 -07:00
Krish Dholakia
0d285c8b4c
Merge pull request #13919 from stevenmanton/fix-aws-assume-role-with-token
...
Add support for AWS assume_role with a session token
2025-08-25 00:55:02 -07:00
Krish Dholakia
a7bb5bc814
Merge pull request #13922 from ArthurRenault/patch-1
...
[BUG] Add back supervisor to non-root image
2025-08-25 00:54:18 -07:00
Oz Ben-Ami
3f57d67c85
Merge remote-tracking branch 'origin/main' into fix_vertex_expired_tokens
2025-08-24 11:04:19 -04:00
Arthur
6c97a31c9c
bug: add supervisor to non-root image
2025-08-24 15:43:57 +02:00
Steven Anton
d95578464e
Add support for AWS assume_role with a session token
2025-08-23 22:37:21 -07:00
Toy-97
f2bb1ce31e
Deepinfra Metadata Update 24082025
...
Deepseek v3.1 Price Dropped
2025-08-24 08:30:25 +08:00
Ishaan Jaff
827d1def02
UI new build
2025-08-23 17:12:09 -07:00
Ishaan Jaff
373a13f9d4
ui fix logos
2025-08-23 17:10:18 -07:00
Ishaan Jaff
65adddd91e
fix callback logos
2025-08-23 17:08:18 -07:00
Ishaan Jaff
f4de167654
[Feat] UI QA Fixes ( #13915 )
...
* fix add fallbacks page
* leftnav - allow expand / collapse
2025-08-23 17:05:25 -07:00
Ishaan Jaff
e0e356e328
test mapped test fixes
2025-08-23 17:04:23 -07:00
Yuta Saito
cca1ea1592
Fix missing and unused imports in custom_guardrail docs example
2025-08-24 08:37:17 +09:00
mubashir1osmani
2fa8f971e0
feat: multiple images in openai images/edits endpoint
2025-08-23 19:13:32 -04:00
Krrish Dholakia
66acf6dcdb
docs(index.md): initial commit with release notes
2025-08-23 15:45:06 -07:00
Krish Dholakia
242c06e691
Merge pull request #13784 from mubashir1osmani/docs-deploy
2025-08-23 15:40:34 -07:00
Ishaan Jaff
8a8b6f6b2c
ui new build
2025-08-23 14:18:38 -07:00
Ishaan Jaff
0fccd619ea
test_vertex_ai_deepseek
2025-08-23 14:13:03 -07:00
Ishaan Jaff
cf64033044
test fix
2025-08-23 14:04:41 -07:00
Ishaan Jaff
835879bc85
fix: img gen
2025-08-23 14:03:11 -07:00
Ishaan Jaff
f1c710a608
test_e2e_generate_cold_storage_object_key_not_configured
2025-08-23 13:33:33 -07:00
Ishaan Jaff
58c413d7ab
use litellm-proxy-extras==0.2.18
2025-08-23 13:27:26 -07:00
Mubashir Osmani
1a8d3cc2d5
Added FAQ under deployment docs ( #13912 )
...
* updated faq questions
* updated faq
* added faq under deployment
2025-08-23 13:22:56 -07:00
Ishaan Jaff
e637930d6d
fix Providers UI
2025-08-23 13:16:40 -07:00
Ishaan Jaff
b9132968b2
[Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS ( #13905 )
...
* [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895 )
* fix: litellm.configured_cold_storage_logger
* fix Session Management - Non-OpenAI Models docs
* ruff fix
* test fix
* create LoggingWorker
* add GLOBAL_LOGGING_WORKER for async task handling
* fix logging tests
* add conftest
* fix conftest
* test fix location of encode bedrock runtime modelid arn
* fix conftest.py
* tuning LoggingWorker
* conftest.py
* fix conftest batches/
* test_async_chat_azure
* event_loop
* test_bedrock_streaming_passthrough_test2
* fix GLOBAL_LOGGING_WORKER
* logging worker
* add flush for global logging worker
* Revert "fix GLOBAL_LOGGING_WORKER"
This reverts commit d254f508f48935652f054777652938ad71976cce.
* fix conftest clear_queue
* fix conftest clear_queue
* setup_and_teardown for llm translation
* docs AWS_REGION
* test_async_chat_azure
* change test DIR
* run ci/cd again
* use 1 job for litellm_router_unit_testing
* fix space
* fix litellm_router_unit_testing
* test_aaarouter_dynamic_cooldown_message_retry_time
* litellm_router_unit_testing
* conftest.py clearing qu
* fixes litellm_router_unit_testing
* fixes clear_queue
* fix router_unit_tests
* remove conftest
* add back conftest for router
* fix event loop test
* test fix
* fixes for LoggingWorker
* ruff fix
2025-08-23 13:13:23 -07:00
Ishaan Jaff
9750374081
[Feat] New LLM API - AI/ML API for Image Gen ( #13893 )
...
* add LlmProviders.AIML
* add AIMLChatConfig
* add aiml
* fix AimlImageGenerationConfig
* add AimlImageGenerationConfig
* add cost_calculator
* fixes for AI ML API
* add known AIML Flux image models
* add AIML Cost Calc
* add AI/ML API
* add aiml_models
2025-08-23 13:12:44 -07:00
