Commit Graph

30881 Commits

Author SHA1 Message Date
Achintya Rajan
715c4999a2 global feature flag state for app 2025-10-06 12:57:16 -07:00
Krrish Dholakia
6f2b753a5d feat(llm_passthrough_endpoints.py): add router model support on azure passthrough 2025-10-06 12:51:41 -07:00
Gal Bloch
27c64c90dc
feat: Add 25 new Watson X foundation models (#15219)
Added comprehensive Watson X model support including:
- IBM Granite models (granite-4-h-small, granite-3-3-8b-instruct, granite-guardian variants, granite-vision, granite-ttm time series models)
- Meta Llama models (llama-3-2-1b/3b/11b-vision/90b-vision, llama-3-3-70b, llama-4-maverick-17b, llama-guard-3-11b-vision)
- Mistral models (mistral-medium-2505, mistral-small-2503, pixtral-12b-2409)
- Additional models (BigScience mt0-xxl-13b, Google flan-t5-xl-3b, OpenAI gpt-oss-120b, SDAIA allam-1-13b-instruct, Core42 jais-13b-chat)

All models include proper pricing, token limits, and capability flags (function calling, vision support, etc.) based on IBM Watson X documentation.
2025-10-06 12:33:05 -07:00
=
53ee3e2634 refactoredUI feature flag 2025-10-06 10:43:42 -07:00
=
3f53d6b7ad Moved KeyInfoView to refactored folder, added deprecation notice 2025-10-06 10:43:34 -07:00
Achintya Rajan
03804cb1d2 preliminary virtual-keys refactor
simplifies handleCreate function for CreateKeyModal

moved hooks, components, files where I want them

moved virtual-key page to (console) for common layout

added layout for refactored console file structure, sidebar

wired teams to refactored components

fixing type issue

wired new top level hook useAuthorized

Adds routing to unrefactored pages

Update leftnav.tsx

Update useAuthorized.ts

useAuthorized in virtual-keys/page and deprecation notices

prelim VirtualKeyViewPage, removed old comment

Delete page.tsx
2025-10-06 10:43:26 -07:00
Alexsander Hamir
ddb90c9ad7
[Fix] - Router: add model_name index for O(1) deployment lookups (#15113)
* perf(router): add model_name index for O(1) deployment lookups

Add model_name_to_deployment_indices mapping to optimize _get_all_deployments()
from O(n) to O(1) + O(k) lookups.

- Add model_name_to_deployment_indices: Dict[str, List[int]]
- Add _build_model_name_index() to build/maintain the index
- Update _add_model_to_list_and_index_map() to maintain both indices
- Refactor to use idx = len(self.model_list) before append (cleaner)
- Optimize _get_all_deployments() to use index instead of linear scan

* test(router): add test coverage for _build_model_name_index

Add single comprehensive test for _build_model_name_index() function to fix
code coverage CI failure.

The test verifies:
- Index correctly maps model_name to deployment indices
- Handles multiple deployments per model_name
- Clears and rebuilds index correctly

Fixes: CI code coverage error for _build_model_name_index
2025-10-06 08:14:11 -07:00
Otavio Brito
b2a734c1f8 fix ttl tests 2025-10-06 09:30:23 -03:00
Krish Dholakia
9383ffccd6
Merge pull request #15221 from jatorre/feat/snowflake-tools-clean
feat(snowflake): add function calling support for Snowflake Cortex REST API
2025-10-05 22:20:44 -07:00
Krish Dholakia
30d24fa44c
Merge pull request #15215 from ARajan1084/prettier-support
Added prettier to autoformat frontend
2025-10-05 22:02:37 -07:00
Otavio Brito
251d56ba5e update docs 2025-10-05 23:47:24 -03:00
Otavio Brito
80edf70206 fix import 2025-10-05 20:59:51 -03:00
Otavio Brito
acf8ec5b3c add context caching support for vertex ai 2025-10-05 20:55:18 -03:00
Javier de la Torre
df232a71f1 feat(snowflake): add function calling support for Snowflake Cortex REST API
Add support for function calling (tools) with Snowflake Cortex models that support it (e.g., Claude 3.5 Sonnet).

Changes:
- Add 'tools' and 'tool_choice' to supported OpenAI parameters
- Implement request transformation: OpenAI function format → Snowflake tool_spec format
- Implement response transformation: Snowflake content_list with tool_use → OpenAI tool_calls
- Add tool_choice transformation: OpenAI nested format → Snowflake array format

Request transformation:
- Transform tools from nested {"type": "function", "function": {...}} to Snowflake's {"tool_spec": {"type": "generic", "name": "...", "input_schema": {...}}}
- Transform tool_choice from {"type": "function", "function": {"name": "..."}} to {"type": "tool", "name": ["..."]}

Response transformation:
- Parse Snowflake's content_list array containing tool_use objects
- Extract tool calls with tool_use_id, name, and input
- Convert to OpenAI's tool_calls format with proper JSON serialization

Testing:
- Add 7 unit tests covering request/response transformations
- Add integration test for Responses API with tool calling
- All tests passing

Fixes issue #15218

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-05 13:08:33 +02:00
kowyo
d9851d2598 fix comment 2025-10-05 12:17:08 +08:00
kowyo
619ab42c93 fix: only use think level for gpt-oss model 2025-10-05 12:16:00 +08:00
Kowyo
765252d7db
Merge branch 'BerriAI:main' into kowyo/fix-ollama-think 2025-10-05 10:45:28 +08:00
Ishaan Jaffer
b348a26bdc docs fix 2025-10-04 18:32:45 -07:00
Ishaan Jaffer
b2dd50dd3e docs key rotations 2025-10-04 18:29:01 -07:00
=
5197268a58 added and ran prettier autoformatter 2025-10-04 18:19:48 -07:00
Ishaan Jaffer
e58c2c5c3e docs fix 2025-10-04 18:13:08 -07:00
Ishaan Jaffer
163416c683 docs fix 2025-10-04 18:12:47 -07:00
Ishaan Jaffer
6cf1806d3b docs fix 2025-10-04 18:12:20 -07:00
Ishaan Jaffer
bd2559e65e docs fix 2025-10-04 18:11:58 -07:00
Ishaan Jaffer
525b86687c fix 1.77.7 stable 2025-10-04 18:11:01 -07:00
Ishaan Jaffer
4e88e21266 docs fix 2025-10-04 18:04:11 -07:00
Ishaan Jaffer
93022361e6 docs fix 2025-10-04 18:03:04 -07:00
Ishaan Jaffer
d12da2e56e docs fix 2025-10-04 18:02:04 -07:00
Alexsander Hamir
9d6c06dc7a
doc: perf update (#15211) 2025-10-04 17:59:08 -07:00
Ishaan Jaffer
02cb7a4c3b docs fix 2025-10-04 17:29:06 -07:00
Yuta Saito
ba0dcfc001 feat: add Global Cross-Region Sonnet 4 2025-10-05 09:25:39 +09:00
Ishaan Jaffer
8c495590b1 doc improvement 2025-10-04 17:21:41 -07:00
Ishaan Jaffer
553801c7b4 docs 2025-10-04 17:21:00 -07:00
Yuta Saito
9a1c0145da feat: add Global Cross-Region Inference 2025-10-05 09:20:17 +09:00
Krrish Dholakia
b7ca138a8d docs(prometheus.md): fix 2025-10-04 16:23:54 -07:00
Krrish Dholakia
98d709d351 fix(key_management_endpoints.py): retain error check when non proxy admin is trying to update key belonging to a different user 2025-10-04 16:22:35 -07:00
Ishaan Jaffer
97e00f694c fix azure assistants test 2025-10-04 16:18:14 -07:00
Ishaan Jaffer
a1e5c9426f bump to migrations to 0.2.25 2025-10-04 16:16:34 -07:00
Ishaan Jaffer
e9e91a4b28 fix remove dup migration 2025-10-04 16:13:33 -07:00
Krrish Dholakia
63cb2764fe test: fix raise 2025-10-04 16:11:22 -07:00
Krrish Dholakia
8dc53c0438 docs: document updates 2025-10-04 16:06:18 -07:00
=
1ce21d1f58 Update key_management_endpoints.py 2025-10-04 16:02:15 -07:00
Krish Dholakia
a7152f3bd8
Merge pull request #15185 from BerriAI/litellm_dev_10_03_2025_p1
(MCP - feat) UI - show health status of MCP servers, allow setting extra headers on the UI, allow editing allowed tools on the UI
2025-10-04 15:46:02 -07:00
Krrish Dholakia
171b6b13b2 fix(litellm_pre_call_utils.py): fix return statement 2025-10-04 15:43:56 -07:00
Krrish Dholakia
2d1000c461 test: update tests 2025-10-04 15:31:25 -07:00
Krrish Dholakia
6500a4a822 fix: fix minor issues 2025-10-04 15:30:46 -07:00
Krish Dholakia
a9037ab61f
Merge branch 'main' into litellm_dev_10_03_2025_p1 2025-10-04 15:23:31 -07:00
Krish Dholakia
85c4dd1283
Merge pull request #15154 from BerriAI/litellm_dev_10_02_2025_p2
fix(proxy_server.py): handle decrypting model list from db, when lite…
2025-10-04 15:23:11 -07:00
Krish Dholakia
75e3f4e10d
Merge pull request #15120 from BerriAI/litellm_dev_10_01_2025_p2
(feat) Support 'guaranteed_throughput' when setting limits on keys belonging to a team
2025-10-04 15:22:47 -07:00
Krrish Dholakia
691a1fa6fe fix(key_management_endpoints.py): fix check 2025-10-04 15:22:08 -07:00