Commit Graph

24262 Commits

Author SHA1 Message Date
Krrish Dholakia
66acf6dcdb docs(index.md): initial commit with release notes 2025-08-23 15:45:06 -07:00
Krish Dholakia
242c06e691
Merge pull request #13784 from mubashir1osmani/docs-deploy 2025-08-23 15:40:34 -07:00
Ishaan Jaff
8a8b6f6b2c ui new build 2025-08-23 14:18:38 -07:00
Ishaan Jaff
0fccd619ea test_vertex_ai_deepseek 2025-08-23 14:13:03 -07:00
Ishaan Jaff
cf64033044 test fix 2025-08-23 14:04:41 -07:00
Ishaan Jaff
835879bc85 fix: img gen 2025-08-23 14:03:11 -07:00
Ishaan Jaff
f1c710a608 test_e2e_generate_cold_storage_object_key_not_configured 2025-08-23 13:33:33 -07:00
Ishaan Jaff
58c413d7ab use litellm-proxy-extras==0.2.18 2025-08-23 13:27:26 -07:00
Mubashir Osmani
1a8d3cc2d5
Added FAQ under deployment docs (#13912)
* updated faq questions

* updated faq

* added faq under deployment
2025-08-23 13:22:56 -07:00
Ishaan Jaff
e637930d6d fix Providers UI 2025-08-23 13:16:40 -07:00
Ishaan Jaff
b9132968b2
[Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905)
* [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895)

* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix

* create LoggingWorker

* add GLOBAL_LOGGING_WORKER for async task handling

* fix logging tests

* add conftest

* fix conftest

* test fix location of encode bedrock runtime modelid arn

* fix conftest.py

* tuning LoggingWorker

* conftest.py

* fix conftest batches/

* test_async_chat_azure

* event_loop

* test_bedrock_streaming_passthrough_test2

* fix GLOBAL_LOGGING_WORKER

* logging worker

* add flush for global logging worker

* Revert "fix GLOBAL_LOGGING_WORKER"

This reverts commit d254f508f48935652f054777652938ad71976cce.

* fix conftest clear_queue

* fix conftest clear_queue

* setup_and_teardown for llm translation

* docs AWS_REGION

* test_async_chat_azure

* change test DIR

* run ci/cd again

* use 1 job for litellm_router_unit_testing

* fix space

* fix litellm_router_unit_testing

* test_aaarouter_dynamic_cooldown_message_retry_time

* litellm_router_unit_testing

* conftest.py clearing qu

* fixes litellm_router_unit_testing

* fixes clear_queue

* fix router_unit_tests

* remove conftest

* add back conftest for router

* fix event loop test

* test fix

* fixes for LoggingWorker

* ruff fix
2025-08-23 13:13:23 -07:00
Ishaan Jaff
9750374081
[Feat] New LLM API - AI/ML API for Image Gen (#13893)
* add LlmProviders.AIML

* add AIMLChatConfig

* add aiml

* fix AimlImageGenerationConfig

* add AimlImageGenerationConfig

* add cost_calculator

* fixes for AI ML API

* add known AIML Flux image models

* add AIML Cost Calc

* add AI/ML API

* add aiml_models
2025-08-23 13:12:44 -07:00
Krrish Dholakia
511630dc7e fix: fix transformation 2025-08-23 12:50:57 -07:00
Krish Dholakia
a5b12c9ce1
Merge pull request #13830 from BerriAI/litellm_dev_08_20_2025_p1
Fix calling key with access to model alias
2025-08-23 12:10:03 -07:00
Krish Dholakia
9df6f4ef08
Merge branch 'main' into litellm_dev_08_20_2025_p1 2025-08-23 12:09:53 -07:00
Krrish Dholakia
b23e35f75e test: update tests 2025-08-23 12:09:19 -07:00
Krish Dholakia
49cb9bdbca
Merge pull request #13843 from BerriAI/litellm_dev_08_29_2025_p3
SSO - Free SSO usage for up to 5 users + remove deprecated dbrx models (dbrx-instruct, llama 3.1)
2025-08-23 12:06:01 -07:00
Krrish Dholakia
988434a49d fix: fix linting error 2025-08-23 11:49:12 -07:00
Krish Dholakia
f2c5e806b4
Merge pull request #13673 from BerriAI/litellm_dev_08_16_2025_p2
fix(openai/image_edits): Support 'mask' parameter for openai image edits
2025-08-23 11:30:57 -07:00
Krish Dholakia
ef66bb87b3
Merge branch 'main' into litellm_dev_08_16_2025_p2 2025-08-23 11:30:51 -07:00
Krrish Dholakia
385bb15219 test: skip test 2025-08-23 11:27:46 -07:00
Krish Dholakia
06a2915e9f
Merge pull request #13671 from BerriAI/litellm_dev_08_15_2025_p1
Responses API - support `allowed_openai_params` + Mistral - handle empty assistant content + support new mistral 'thinking' response block
2025-08-23 11:15:23 -07:00
Krrish Dholakia
4d7433b5ad test: reduce mistral direct tests b/c of rate limit errors 2025-08-23 11:15:03 -07:00
Krrish Dholakia
cbb161f10b test: handle internal server errors 2025-08-23 11:00:18 -07:00
Krish Dholakia
f0b0ee51e0
Merge branch 'main' into litellm_dev_08_15_2025_p1 2025-08-23 10:51:56 -07:00
Krrish Dholakia
45d32dc90f fix: fix ruff check 2025-08-23 10:51:17 -07:00
Krrish Dholakia
75d75aff39 fix: fix ruff check 2025-08-23 10:49:17 -07:00
Krrish Dholakia
3b22fb4215 test: update tests 2025-08-23 10:49:03 -07:00
Krrish Dholakia
eb7e5e3a71 Revert "build(model_prices_and_context_window.json): remove retired dbrx model"
This reverts commit 10d49d0174.
2025-08-23 10:47:44 -07:00
Krrish Dholakia
ba9f6894b7 test: update tests 2025-08-23 10:42:41 -07:00
Krrish Dholakia
7637e41019 fix: fix ruff check 2025-08-23 10:36:53 -07:00
tanjiro
a7231507dd new notifications (#13861) 2025-08-23 10:36:52 -07:00
Krrish Dholakia
f6851db0eb fix(internal_user_endpoints.py): show remaining users when free SSO users is enabled 2025-08-23 10:36:52 -07:00
Krrish Dholakia
a6380a4355 feat(ui_sso.py): initial commit adding free SSO for up to 5 users
Fixes https://github.com/BerriAI/litellm/issues/13031
2025-08-23 10:36:52 -07:00
Krrish Dholakia
10d49d0174 build(model_prices_and_context_window.json): remove retired dbrx model 2025-08-23 10:36:52 -07:00
Krrish Dholakia
c270c5a37a build(model_prices_and_context_window.json): remove deprecated model from model cost map 2025-08-23 10:36:52 -07:00
mubashir1osmani
d664860aa1 added openai models to config 2025-08-23 10:02:49 -04:00
Krish Dholakia
3e764ec268
Merge pull request #13808 from mainred/validate_api_version
feat(utils.py): accept 'api_version' as param for validate_environment
2025-08-22 23:59:38 -07:00
Krish Dholakia
33206d2fcd
Merge pull request #13848 from Ithanil/fix_non-root_migrations
fix permission access on prisma migrate in non-root image
2025-08-22 23:55:31 -07:00
Krish Dholakia
867b48a24f
Merge pull request #13866 from jinskjoy/Mistral-File-ID
[Enhancement] Add support for Mistral model file handling and update documentation
2025-08-22 23:54:17 -07:00
Krish Dholakia
28ea6cd35f
Merge pull request #13899 from TeddyAmkie/docs/team-rate-limits-update
docs: clarify prerequisites and env var for team rate limits
2025-08-22 23:50:24 -07:00
Krish Dholakia
28a11d8376
Merge pull request #13897 from kankute-sameer/litellm_openrouter_deepseek_chat_v3.1
Add openrouter deepseek/deepseek-chat-v3.1 support
2025-08-22 23:50:04 -07:00
Krish Dholakia
558c0940b2
Merge pull request #13902 from bcdonadio/litellm_ollama_tools_transforms
Fix Ollama transformations crash when tools are used with non-tool trained models
2025-08-22 23:49:31 -07:00
Ishaan Jaff
f9e9f8c25e docs AWS_REGION 2025-08-22 17:48:37 -07:00
Ishaan Jaff
825d6b08f0 test fix location of encode bedrock runtime modelid arn 2025-08-22 17:34:09 -07:00
Ishaan Jaff
56c16fc6f6
[Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895)
* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix
2025-08-22 16:17:57 -07:00
Bernardo Donadio
6384595289
Fix transformations crash when tools are being used 2025-08-22 17:28:52 -03:00
Jugal D. Bhatt
3c1dcb64cc
fix by adding init lock (#13666) 2025-08-22 11:42:43 -07:00
Teddy Amkie
08d1c96ed1 docs: clarify prerequisites and env var for team rate limits 2025-08-22 18:39:31 +00:00
Sameer Kankute
f239a0f78a Add openrouter deepseek/deepseek-chat-v3.1 support 2025-08-22 22:59:09 +05:30