Ishaan Jaff
e93e266f84
[Performance] Use O(1) Set lookups for model routing ( #13879 )
...
* o(1) lookups
* Revert "o(1) lookups"
This reverts commit 620d14246980813366b4b1f1c0ce396b528dd9df.
* o(1) lookups
* Revert "o(1) lookups"
This reverts commit 676a9f5bcc3c2b9fa31e0a9fdf00389739b3052f.
* o(1) lookups
* register_model fix
* test_aget_valid_models
* lambda ai models fix
* test_utils.py
* test fix vertex ai
2025-08-21 22:56:46 -07:00
tanjiro
bfd5ad032e
Fix e2e_ui_test ( #13881 )
...
* new notifications
* FIX TEST
2025-08-21 22:54:46 -07:00
Toy-97
8ba292f201
fix extra bracket.json
2025-08-22 13:21:41 +08:00
Toy-97
62ae6d8bbc
Update model metadata for deepinfra.json
2025-08-22 13:11:55 +08:00
Krish Dholakia
a61275f6e2
Merge pull request #13796 from 0x-fang/fix_aip_pass_through_08_20
...
Fix(Bedrock): fix application inference profile for pass-through endpoints for bedrock
2025-08-21 19:41:23 -07:00
Carson Gee
b46de0ab5c
Updated URL handling for DataRobot provider base
2025-08-21 19:42:46 -06:00
Krish Dholakia
7c2c1c11d9
Merge pull request #13783 from philipkiely-baseten/main
...
Update Baseten LiteLLM integration
2025-08-21 18:34:36 -07:00
Krrish Dholakia
6b2039f4d7
fix(utils.py): add helpful log message, directing to use of LITELLM_MIGRATION_DIR
2025-08-21 16:41:21 -07:00
Ishaan Jaff
5978f25299
add new gemini/imagen-4.0 models ( #13876 )
2025-08-21 15:32:31 -07:00
Ishaan Jaff
9e9ba6861d
[Feat] Add new VertexAI image models vertex_ai/imagen-4.0-generate-001, vertex_ai/imagen-4.0-ultra-generate-001, vertex_ai/imagen-4.0-fast-generate-001 ( #13874 )
...
* add vertex_ai/imagen-4.0-fast-generate-001
* add vertex_ai/imagen-4.0-ultra-generate-001
* add vertex_ai/imagen-4.0-generate-001
2025-08-21 15:15:44 -07:00
Jugal D. Bhatt
d63f5f99e9
Enhance database configuration: add support for optional endpointKey in values.yaml and update deployment/migrations job templates to conditionally source DATABASE_HOST from the secret if endpointKey is set. ( #13763 )
2025-08-21 14:58:50 -07:00
tanjiro
0aa1371903
Fix Filter Dropdown UX Issue - Load Initial Options ( #13858 )
...
* move the filter component to molecules
* load initial options
2025-08-21 14:56:49 -07:00
tanjiro
67621d3381
new notifications ( #13861 )
2025-08-21 14:55:21 -07:00
Ishaan Jaff
77a5de37b1
[Fix] Ensure Service Account Keys require team_id field on API Endpoints ( #13873 )
...
* fixes for generating service accounts through the API
* fixes for test_update_service_account_works_with_team_id
2025-08-21 14:55:06 -07:00
Ishaan Jaff
f498cf4901
Fix - Ensure Helm chart auto generated master keys follow sk-xxxx format ( #13871 )
...
* docs - master key
* fix - auto generate sk-xxx prefixed key
* test master key fix
* fix master key gen
2025-08-21 14:34:21 -07:00
Sameer Kankute
5ac4fb512c
Add support for voyage-context-3 embedding model
2025-08-22 00:15:12 +05:30
jinskjoy
d8a33e137d
[Enhancement] Add support for Mistral model file handling and update documentation
2025-08-21 20:35:07 +02:00
Philip Kiely
5fa4a18073
add testing and remove redundant function
2025-08-21 11:25:26 -07:00
Luiz Rennó Costa
f8711200d0
fix: fixing descriptor/response size difference when indexing descriptor
2025-08-21 13:43:23 -03:00
Ed Kim
c88a13c58b
add unit test which confirms the removal of DATABASE_URL
...
Signed-off-by: Ed Kim <edward.kim@lendi.com.au>
2025-08-21 21:08:18 +10:00
Michal Otmianowski
a6f052882b
fix test
2025-08-21 12:10:29 +02:00
Michal Otmianowski
d53dd58c4d
remove unnecessary comments
2025-08-21 11:39:08 +02:00
Michal Otmianowski
feae09da5d
minor adjustments
2025-08-21 11:33:11 +02:00
Michal Otmianowski
5dd7e00127
formatting adjustments
2025-08-21 11:27:12 +02:00
Michal Otmianowski
08c942c306
refactor tests
2025-08-21 10:38:43 +02:00
Michal Otmianowski
744dca1dc3
init asyc implementation
2025-08-21 10:22:54 +02:00
edward kim
418b70b38e
fixes
...
Signed-off-by: edward kim <edward.kim@lendi.com.au>
2025-08-21 17:44:54 +10:00
edward kim
2bd3daa742
fixes the mounting of this only when deployStandalone is true
...
Signed-off-by: edward kim <edward.kim@lendi.com.au>
2025-08-21 17:39:31 +10:00
Jan Kessler
3eecff44c6
fix permission access on prisma migrate in non-root image
2025-08-21 09:00:55 +02:00
Krish Dholakia
0e6e8af1c3
Merge pull request #13795 from TomeHirata/feat/predict/mlflow
...
Include predicted output in MLflow tracing
2025-08-20 22:40:33 -07:00
Krish Dholakia
1f84451925
Merge pull request #13803 from UlookEE/fix_bedrock_epc_acompletion
...
fix : Synchronize cache behavior between acompletion and completion
2025-08-20 22:38:30 -07:00
Krish Dholakia
ff267ab68e
Merge pull request #13820 from kankute-sameer/litellm_rerank_deepinfra_endpoint
...
Add rerank endpoint support for deepinfra
2025-08-20 22:33:25 -07:00
Krish Dholakia
609679ded4
Merge pull request #13835 from 0x-fang/fix_api_key_guardrail_proxy
...
Fix(bedrock): fix the api key support for bedrock guardrail in proxy
2025-08-20 22:31:17 -07:00
Krrish Dholakia
dba78046b9
fix(internal_user_endpoints.py): show remaining users when free SSO users is enabled
2025-08-20 22:26:01 -07:00
Krrish Dholakia
046a7ae906
feat(ui_sso.py): initial commit adding free SSO for up to 5 users
...
Fixes https://github.com/BerriAI/litellm/issues/13031
2025-08-20 21:46:34 -07:00
Ishaan Jaff
07f6235730
[Performance] Improve LiteLLM Python SDK RPS by +200 RPS ( #13839 )
...
* fix _proxy_from_env +100 RPS
* fix: global_braintrust_http_handler
* test_braintrust_logging
2025-08-20 21:46:33 -07:00
Krrish Dholakia
ebab77e7ce
build(model_prices_and_context_window.json): remove retired dbrx model
2025-08-20 21:27:06 -07:00
Krrish Dholakia
ea39094658
build(model_prices_and_context_window.json): remove deprecated model from model cost map
2025-08-20 21:24:18 -07:00
Krish Dholakia
b9621c760d
Merge pull request #13836 from BerriAI/litellm_dev_08_16_2025_p1
...
Add OTEL tracing for actual LLM API call
2025-08-20 19:10:10 -07:00
Fang Gong
91040b6b56
fix the api key support for bedrock guardrail in proxy
2025-08-20 18:46:00 -07:00
Krrish Dholakia
34ad646101
fix(auth_checks.py): handle both flows + add unit tests
2025-08-20 16:42:08 -07:00
Krrish Dholakia
e5c3e006c2
fix(proxy_server.py): fix merge config + db router settings logic
2025-08-20 16:33:31 -07:00
Krrish Dholakia
52cbedf044
fix(auth_checks.py): ensure if key has access to aliased model, it still works
2025-08-20 15:36:32 -07:00
Krrish Dholakia
b0c98efd14
fix(__init__.py): remove redundant value
2025-08-20 15:10:58 -07:00
Krrish Dholakia
5c1b27af99
docs(quick_start.md): add back to navbar
...
useful for showing setup via cli
2025-08-20 15:09:19 -07:00
Krrish Dholakia
fb5b2d8d47
docs: remove old doc
...
prevent showing up on searches
2025-08-20 15:01:32 -07:00
Ishaan Jaff
55dcaded72
[Feat] Add VertexAI qwen API Service ( #13828 )
...
* add support for vertex AI QWEN API
* streaming QWEN API support
* test_partner_models_httpx
* test_partner_models_httpx_streaming
* add cost tracking for vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maa
* docs qwen models vertexAI
2025-08-20 15:00:33 -07:00
tanjiro
5299e9ad4a
fix key edit settings after regenerating key ( #13815 )
2025-08-20 14:34:38 -07:00
tanjiro
f7a3af5cde
new notifications ( #13813 )
2025-08-20 14:32:04 -07:00
Ishaan Jaff
6f6fd0de0d
add fireworks_ai/accounts/fireworks/models/deepseek-v3-0324 ( #13821 )
2025-08-20 14:31:24 -07:00
