Harshit Jain
b920be3ee7
fix: server rooth path ( #19790 )
2026-01-26 09:48:06 -08:00
Harshit Jain
6df0406cf6
fix: args issue & refactor into helper function to reduce bloat for both( #19441 )
2026-01-25 10:21:20 +05:30
yuneng-jiang
47810f1523
Model and Team filtering
2026-01-24 14:45:14 -08:00
Ishaan Jaffer
1a7274aa4e
fix: _apply_search_filter_to_models mypy linting
2026-01-24 09:24:50 -08:00
yuneng-jiang
f88a32de05
Merge pull request #19622 from BerriAI/litellm_ui_model_backend
...
[Feature] UI - Models Page: Model Search
2026-01-24 09:09:03 -08:00
yuneng-jiang
b44ac6c682
Fixing ruff check
2026-01-24 09:08:29 -08:00
Ishaan Jaff
fc19085230
[Feat] Guardrail Policy Management - Allow using UI to manage guardrail policies ( #19668 )
...
* init UI
* init schema.prisma
* fix: policy_crud_router
* UI fixes
* update gitignore
* working v0 for policy mgmt
* fix: endpoints to resolve guardrails
* fix code QA checks
* ui build issues
* schema fixes
* fix checks
2026-01-23 12:44:22 -08:00
Sameer Kankute
12463809bd
Merge pull request #19638 from BerriAI/main
...
merge main in stagin 1 22 26
2026-01-23 14:54:17 +05:30
yuneng-jiang
3ee7aab5f2
All Models Backend Search
2026-01-22 22:00:22 -08:00
Ishaan Jaff
c23e4b87dc
[Feat] New LiteLLM Policy engine - create policies to manage guardrails, conditions - permissions per Key, Team ( #19612 )
...
* init PolicyMatcher
* TestPolicyMatcherGetMatchingPolicies
* TestPolicyMatcherGetMatchingPolicies
* feat: init PolicyResolver
* init resolver types
* init policy from config
* inint PolicyValidator
* validate policy
* init Architecture Diagram
* test_add_guardrails_from_policy_engine
* init _init_policy_engine
* test updates
* test fixws
* new attachment config
* simplify types
* TestPolicyResolverInheritance
* fix policy resolver
* fix policies
* fix applied policy
* docs fix
* docs fix
* fix linting + QA checks
* fix linting + QA fixes
* test fixes
2026-01-22 19:49:53 -08:00
Sameer Kankute
ad1edd38d5
Merge branch 'main' into litellm_staging_01_21_2026
2026-01-22 17:56:40 +05:30
Harshit Jain
73d49f8d63
fix: UI 404 error when SERVER_ROOT_PATH is set ( #19467 )
2026-01-21 20:19:48 -08:00
yuneng-jiang
6723b30d03
Adding scope to /models
2026-01-21 16:40:31 -08:00
yuneng-jiang
3075b0e5a2
fixing mypy linting
2026-01-21 11:22:20 -08:00
yuneng-jiang
d0e35751a1
Fixing tests and linting
2026-01-21 11:02:39 -08:00
yuneng-jiang
b5a7d2ab34
Paginating model/info endpoint
2026-01-21 10:44:18 -08:00
Sameer Kankute
22158f8f03
Fix litellm_staging_01_20_2026 mypy issues
2026-01-21 17:35:28 +05:30
Harshit Jain
76433f9f04
fix: add better error handling for misconfig on health check ( #19441 )
2026-01-20 19:24:28 -08:00
Harshit Jain
3c3148789a
fix: resolve Read-only file system error in non-root images ( #19449 )
2026-01-20 19:00:52 -08:00
Harshit Jain
1c8bf19f1e
fix(proxy_server): pass search_tools to Router during DB-triggered initialization ( #19388 )
2026-01-20 09:55:09 -08:00
Ishaan Jaff
a82467d679
[Feat] - Add self hosted Claude Code Plugin Marketplace ( #19378 )
...
* init schema
* init endpoints
* fix: claude_code_marketplace_router
* refactor
* fix: claude_code_marketplace_router
* claude_code_marketplace_router
2026-01-19 14:05:47 -08:00
Sameer Kankute
e54af42774
Merge pull request #19211 from BerriAI/main
...
merge main in fallback PR
2026-01-16 17:01:10 +05:30
Sameer Kankute
b0c6a1b308
Merge pull request #19203 from BerriAI/main
...
merge main
2026-01-16 15:16:29 +05:30
Sameer Kankute
d585b760c9
Add fallback endpoints support
2026-01-16 10:51:33 +05:30
Harshit Jain
e8c4cad885
feat(proxy): cleanup spend logs cron verification, fix, and docs ( #19085 )
2026-01-14 22:14:48 +05:30
Sameer Kankute
d03548b064
Fix all 130126 tests
2026-01-14 17:42:52 +05:30
Sameer Kankute
ff467c797d
Merge pull request #19079 from BerriAI/main
...
merge main
2026-01-14 16:44:31 +05:30
Sameer Kankute
11cc8dc9d2
Merge pull request #19037 from Jetemple/json-log-fix
...
fix: enable JSON logging via configuration and add regression test
2026-01-14 13:51:36 +05:30
Raghav Jhavar
272a48d880
[bug fix] do not fallback to token counter if disable_token_counter is enabled ( #19041 )
...
* do not fallback to token counter if disable_token_counter is enabled, and return errors instead
* add exceptions and exception utils to map the same as /v1/chat/completions
* use safe_json_loads
2026-01-13 16:53:38 -08:00
Alexsander Hamir
a1dd3ead4d
[Perf] Remove bottleneck causing high CPU usage & overhead under heavy load ( #19049 )
2026-01-13 15:22:09 -08:00
xiaofan
f8836cb2a7
Fix Swagger UI path with server_root_path in OpenAPI schema ( #18947 )
...
Adds 'servers' field to OpenAPI schema when server_root_path is set, ensuring correct Swagger UI execute path for reverse proxies and subpath deployments. Includes tests to verify correct server URL handling for various root path formats.
2026-01-14 03:48:43 +05:30
Jack Temple
9e08c2207f
fix: enable JSON logging via configuration and add regression test
2026-01-13 09:38:19 -07:00
Yuta Saito
73f66b101c
fix: prevent duplicate MCP reload scheduler registration
2026-01-12 07:10:22 +09:00
YutaSaito
07db8fe656
Merge pull request #18855 from BerriAI/litellm_fix_mcp-error-in-multiple-server
...
[fix] mcp error in multiple servers
2026-01-10 07:26:16 +09:00
Sameer Kankute
bb9347207b
Merge pull request #18833 from BerriAI/litellm_staging_01_08_2026
...
Litellm staging 01 08 2026
2026-01-09 17:04:29 +05:30
Sameer Kankute
844c766c65
Merge pull request #18763 from BerriAI/litellm_staging_01_07_2026
...
Staging - 01/07/2026
2026-01-09 17:01:58 +05:30
Yuta Saito
8b90e5f4dd
refactor: expose MCP registry reload helper
2026-01-09 17:16:38 +09:00
Yuta Saito
8c11ddfc5b
fix: periodically refresh MCP registry across instances via scheduler job
2026-01-09 17:12:17 +09:00
YutaSaito
661f03058c
Merge pull request #18802 from BerriAI/litellm_feat_focus_backend
...
[feat] Focus export support
2026-01-09 07:21:04 +09:00
yuneng-jiang
1b9c7deec6
Merge remote-tracking branch 'origin' into litellm_key_team_routing_3
2026-01-08 10:39:12 -08:00
Harshit Jain
516e4f8b96
fix: proactive RDS IAM token refresh to prevent 15-min connection failed ( #18795 )
...
* fix: proactive RDS IAM token refresh to prevent 15-min connection failures (#16220 )
* fix: add noqa for PLR0915 in proxy_startup_event
2026-01-08 23:53:36 +05:30
Yuta Saito
fb00b38fcd
chore: lint
2026-01-08 16:56:51 +09:00
Yuta Saito
c00d83fea2
feat: add support focus export
2026-01-08 16:48:06 +09:00
yuneng-jiang
51759424a6
Key and Team Routing Setting
2026-01-07 17:17:30 -08:00
yuneng-jiang
1c84af8ae4
normalize proxy config callbacks
2026-01-07 12:22:57 -08:00
Kris Xia
91b5c66cf2
fix(proxy): return json error response instead of sse format for initial streaming errors ( #18757 )
...
* adding signoz integration to observability docs
* Fixing build
* Adding timeout for flaky test
* Fixing e2e
* fix(proxy): return json error response instead of sse format for initial streaming errors
when the first chunk of a streaming response contains an error,
return a standard json error response instead of sse format.
this ensures clients receive properly formatted error responses
before the stream actually begins.
- rename create_streaming_response to create_response
- add logic to detect error in first chunk and return JSONResponse
- add _extract_error_from_sse_chunk helper function
- update all call sites to use the new function name
- update tests to reflect the function rename
* test(proxy): add comprehensive tests for error extraction from sse chunks
- Add new test class TestExtractErrorFromSSEChunk with 10 test cases
- Update existing tests to verify JSONResponse returned for initial streaming errors
- Add tests for error code as string, bytes input, invalid JSON, and edge cases
- Verify correct error format extraction from SSE chunks
---------
Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
2026-01-07 21:26:47 +05:30
Alexsander Hamir
2983b556d3
Lazy load 9 heavy imports in litellm/utils.py ( #18595 )
2026-01-02 14:54:09 -08:00
Alex Gertz
3bd309f808
fix: return empty data array instead of 500 when no models configured ( #18556 )
...
- /v2/model/info now returns {"data": []} when llm_router is None or model_list is empty
- /model_group/info now returns {"data": []} when llm_model_list is None or empty
- Fixes UI crash on fresh installs with STORE_MODEL_IN_DB=True
- Added 4 unit tests for empty model list scenarios
2026-01-02 23:36:05 +05:30
yuneng-jiang
564b2b51cc
Fix for dev env
2025-12-23 16:09:17 -08:00
yuneng-jiang
05dd247ff5
Fix UI disappearing for development instances
2025-12-23 15:24:07 -08:00
