ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
34,378 Commits 9 Branches 7 Tags 935 MiB
dd183a7fcb
Commit Graph

34378 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yuneng-jiang
ff90585bfe
Break e2e_ui_testing into build, unit, and e2e steps (#16783) 2025-11-18 17:40:32 -08:00
Ishaan Jaff
c3c6cef6d8
[Fix] Fixes Swagger UI resolver errors for chat completion endpoints caused by Pydantic v2 $defs not being properly exposed in the OpenAPI schema. (#16784) 
* fix add_request_body_to_paths

* test_move_defs_to_components
 2025-11-18 17:39:28 -08:00
Ishaan Jaff
2880cb45a2
[Fix] AI Gateway Auth - Ensure Team Tags works when using JWT Auth (#16797) 
* fix setting team_metadata

* test_team_metadata_with_tags_flows_through_jwt_auth
 2025-11-18 17:36:38 -08:00
Krish Dholakia
70e1e83102
feat(managed_files.py): support /delete for files + feat(managed_batches): support /cancel for batches (#16387) 
* feat(managed_files.py): initial commit fixing managed file delete on litellm

* fix(managed_files.py): fix file delete

* feat(batches_endpoints/endpoints.py): fix cancelling a batch

ensures managed batches works

---------

Co-authored-by: Ishaan Jaffer <ishaanjaffer0324@gmail.com>
 2025-11-18 17:36:26 -08:00
Ishaan Jaff
35ab0e109c
[Docs] SSO - Manage User Roles via Azure App Roles (#16796) 
* add img 2

* add app roles

* docs
 2025-11-18 16:00:36 -08:00
yuneng-jiang
8a4fefc565 Expose new model provider map endpoint and use in add model workflow 2025-11-18 15:45:35 -08:00
Ishaan Jaff
e2fc225201
[Feat] SSO - Ensure role from SSO provider is used when a user is inserted onto LiteLLM (#16794) 
* test_apply_user_info_values_sso_role_takes_precedence

* fix SSO
 2025-11-18 15:35:38 -08:00
dependabot[bot]
97bb899f52
Bump js-yaml in /tests/proxy_admin_ui_tests/ui_unit_tests (#16755) 
Bumps [js-yaml](https://github.com/nodeca/js-yaml) from 3.14.1 to 3.14.2.
- [Changelog](https://github.com/nodeca/js-yaml/blob/master/CHANGELOG.md)
- [Commits](https://github.com/nodeca/js-yaml/compare/3.14.1...3.14.2)

---
updated-dependencies:
- dependency-name: js-yaml
  dependency-version: 3.14.2
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-11-18 11:38:54 -08:00
Sameer Kankute
f3344a0d07
Fix videos tagging (#16770) 2025-11-18 11:37:05 -08:00
Cesar Garcia
0908208076
chore: cleanup repo and improve AI docs (#16775) 
* chore: remove development setup files from repository

Removes VERTEX_ENV_SETUP.md and setup_vertex_env.sh from the
repository as they are not referenced in documentation or tests.

These files were added in PR #15824 alongside the VertexAI Search
feature. The setup information is already well-documented in the
official docs at:
docs/my-website/docs/pass_through/vertex_ai_search_datastores.md

* docs: add poetry run python usage to CLAUDE.md and AGENTS.md
 2025-11-18 11:36:27 -08:00
CatBraaain
9ec31bdd5b
fix: correct wrong system message handling for gemma (#16767) 2025-11-18 11:35:56 -08:00
Marty Sullivan
a032b077db
update veo 3 pricing and add prod models (#16781) 2025-11-18 11:29:45 -08:00
yuneng-jiang
f9ec353b80
[Feature] UI - Allow setting base_url in API reference docs (#16674) 
* Allow setting base_url in API reference docs

* Add logic to change base url for test key page
 2025-11-18 11:27:28 -08:00
Sameer Kankute
acf206bec6
Add Day 0 gemini-3-pro-preview support (#16719) 
* Add thinking signature support for gemini

* Add docs related to thinking signature

* remove double base64 import

* fix mypy errors

* fix litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py mypy

* Add new gemini 3 model and features

* Add docs related to gemini 3

* Update gemini 3 pricing

* fix llm translation tests

* fix mapped tests
 2025-11-18 09:44:45 -08:00
AlexsanderHamir
b4e25a68a4 fix: remove test files 2025-11-18 09:40:26 -08:00
yuneng-jiang
98365205ac Deduplicate /tag/daily/activity metadata 2025-11-17 23:00:53 -08:00
Andrey
4dbbec233c
Snowflake provider support: added embeddings, PAT, account_id (#15727) 
* added oauth mcp to docs

* added azure ai/grok-4 model family

* Revert "added oauth mcp to docs"

This reverts commit 950b7cef44f14b2db1429f6fbd32548a7c95d325.

* fix: arize ui integration

* need to remove a file

This reverts commit d6c877b73ac763464f204b77135f3786342373b7.

* snowflake support PAT, account_id and embeddings

* format

* test embeddings

* format

* complete test

* fix: add arize from ui

* updated clarifai functions to openai compatible (#15615)

* fix: npm build errors

* update tests

* SnowflakeBaseConfig moved to utils

* rename pat_key => api_ke

* key_type=PAT => 'pat/key'

* fix if api_key is None

* doc update

* doc update

---------

Co-authored-by: mubashir1osmani <mubashir.osmani777@gmail.com>
Co-authored-by: Mubashir Osmani <ilikewafflesomcuh@gmail.com>
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
Co-authored-by: mogith-pn <143642606+mogith-pn@users.noreply.github.com>
 2025-11-17 20:27:46 -08:00
BenjaminLevy
070db16f87
this yaml actually works (#16757) 2025-11-17 20:09:44 -08:00
YutaSaito
86ada061ec
fix: prompt injection not working (#16701) 2025-11-17 20:04:57 -08:00
superpoussin22
775740275c
Correct ui build (#16702) 
* Remove unused import of darkStyles

* Fix typo in onAutoRotationChange prop
 2025-11-17 20:04:38 -08:00
pnookala-godaddy
52337961dc
fix(openai-video): inherit BaseVideoConfig to enable async content response (#16708) 2025-11-17 20:04:10 -08:00
John Lathouwers
d93e13be36
OCI Provider - Add oci_endpoint_id Parameter for OCI Dedicated Endpoints #16723 2025-11-17 19:59:34 -08:00
Bradley
d0c880e555
Add support for strict parameter in Anthropic tool schemas (#16725) 
* support anthropic strict tools

* correct comment from copy-paste
 2025-11-17 19:57:13 -08:00
Lucas Sugi
57fa6bda5a
fix: Get custom_llm_provider from query param (#16731) 2025-11-17 19:56:41 -08:00
mmandic-coatue
355eff8723
fix haiku-4-5 bedrock configs (#16732) 2025-11-17 19:52:01 -08:00
Cesar Garcia
88b71863ae
docs(openai): Add gpt-5.1-codex and gpt-5.1-codex-mini models to documentation (#16735) 
- Add gpt-5.1, gpt-5.1-codex, and gpt-5.1-codex-mini to OpenAI Chat Completion Models table
- Add gpt-5.1-codex and gpt-5.1-codex-mini to reasoning_effort supported models table
- Clarify that GPT-5-Codex models (gpt-5-codex, gpt-5.1-codex, gpt-5.1-codex-mini) do NOT support verbosity parameter
- Update verbosity section to exclude Codex variants from supported models list

Note: Model configurations already exist in model_prices_and_context_window.json
 2025-11-17 19:50:58 -08:00
yuneng-jiang
25d97f50c7
Fallbacks icon button tooltips and delete with friction (#16737) 
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
 2025-11-17 19:50:41 -08:00
yuneng-jiang
11f009a5a4
Teams table empty state (#16738) 2025-11-17 19:49:33 -08:00
Ishaan Jaff
bdb1e16dcf
[Feat] AI Gateway Auth - Allow using JWTs for signing in with Proxy CLI (#16756) 
* fix auth

* get_cli_jwt_auth_token

* fix linting

* test fixes

* docs

* test fixes

* fix refactor
 2025-11-17 19:47:29 -08:00
yuneng-jiang
54425eb57b
Fix flaky tests due to antd Notification Manager (#16740) 2025-11-17 19:47:20 -08:00
Cesar Garcia
5ae99e2761
docs: respect system color scheme preference in Docusaurus (#16748) 
Configure Docusaurus to automatically detect and respect the user's
system/browser color scheme preference (prefers-color-scheme).

This improves UX by matching the documentation theme to the user's
OS-level dark/light mode setting, while still allowing manual override
via the theme switcher.

Changes:
- Add colorMode configuration to docusaurus.config.js
- Enable respectPrefersColorScheme option
 2025-11-17 19:46:56 -08:00
Krrish Dholakia
e156c66575 fix: fix linting error 2025-11-17 19:46:39 -08:00
Krrish Dholakia
f2314bab34 docs: improve dev docs 2025-11-17 19:46:39 -08:00
yuneng-jiang
f1c5ed19aa
Delete user and mcp server modal and mcp table tooltips (#16751) 2025-11-17 19:45:24 -08:00
Alexsander Hamir
6b7035e32f
fix: add None check for litellm_params (#16754) 
We currently cover the first case where the `litellm_params` may not be there, but not when it could be None
 2025-11-17 19:44:29 -08:00
Sameer Kankute
b9bc903536
remove deprecated embedding model (#16724) 2025-11-17 18:46:20 -08:00
Sameer Kankute
7cebc151b0
Add managed files support for responses API (#16733) 
* Fix responses api with managed files

* fix litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py mypy

* fix litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py mypy

* fix mypy errors
 2025-11-17 18:41:26 -08:00
Sameer Kankute
20ba3fce70
Add deepseek-v3p1-terminus and kimi-k2-instruct in model map for fireworks ai (#16720) 2025-11-17 18:30:32 -08:00
Ishaan Jaff
83ea037bc9
[Feat] AI Gateway - Allow admins to disable, dynamic callback controls (#16750) 
* add flag to allow_dynamic_callback_disabling

* fix EnterpriseCallbackControls

* test controls

* add docs on dynamic logging
 2025-11-17 18:29:07 -08:00
Krrish Dholakia
fdb5df1f27 docs(managed_batches.md): update docs 2025-11-17 18:00:08 -08:00
Krrish Dholakia
e73ac28178 docs(ui_logs.md): link to spec showing what gets logged 2025-11-17 17:56:24 -08:00
Krrish Dholakia
1cdd4065a6 docs: fix docs 2025-11-17 17:54:26 -08:00
YutaSaito
6444bf366c
[Docs] mcp oauth flow details (#16742) 
* docs: mcp oauth flow details

* fix: Exception (AsyncHTTPHandler.__init__() got an unexpected keyword argument 'follow_redirects')
 2025-11-17 17:45:03 -08:00
Ishaan Jaff
08e115ecff
[Feat] Add SSML Support for Azure Text-to-Speech (AVA) (#16747) 
* detect SSML in input

* transform_text_to_speech_request

* test_litellm_speech_with_ssml_passthrough

* add Passing Raw SSML

* fix is_ssml_input
 2025-11-17 15:41:22 -08:00
AlexsanderHamir
7241b4e9b5 add: comment above optimization 
For anybody that would change this value for whatever reason, the comment makes the tradeoff clear.
 2025-11-17 12:59:48 -08:00
AlexsanderHamir
f1895265e6 fix: increase chunk_size to 8 KB for optimal latency 2025-11-17 12:55:58 -08:00
AlexsanderHamir
697cb09060 fix: shared_sessions not being used 2025-11-17 10:58:43 -08:00
AlexsanderHamir
c8c1229859 fix: call_type mistake & remove repetitive .lower() calls 2025-11-17 10:58:43 -08:00
AlexsanderHamir
4614e528dc fix: remove deadcode 
The optimizations related to `select_data_generator` had no effect because its output which is the generator wasn't being used.
 2025-11-17 10:57:37 -08:00
Krrish Dholakia
88f5110e11 docs: improve docs 2025-11-17 09:54:13 -08:00