Commit Graph

23804 Commits

Author SHA1 Message Date
Ishaan Jaff
ec205fec35
[UI] - Add ability to set model alias per key/team (#13276)
* update model alias on keys

* team model aliases

* fix model aliases

* fixes for teams
2025-08-04 21:47:39 -07:00
Jugal D. Bhatt
efd34966dc
[LLM Translation] Support /v1/models/{model_id} retrieval (#13268)
* added model id endpoint

* fix test

* add route to internal users

* make the functions reusable

* fixed mypy
2025-08-04 18:03:59 -07:00
Jugal D. Bhatt
de7108b5f8
input cost per token higher than 1 test (#13270) 2025-08-04 18:02:03 -07:00
Ishaan Jaff
ad26cba8b6 add litellm-enterprise==0.1.17 2025-08-04 17:26:50 -07:00
Ishaan Jaff
8314227a60 bump: version 1.75.0 → 1.75.1 2025-08-04 17:24:40 -07:00
Ishaan Jaff
d948b47dba bump: version 1.74.15 → 1.75.0 2025-08-04 17:23:55 -07:00
Ishaan Jaff
ba1882fdd5
[Bug Fix] Prometheus - fix for litellm_input_tokens_metric, litellm_output_tokens_metric - Note this updates the metric name (#13271)
* fixes for litellm_tokens_metric

* test_prometheus_token_metrics_with_prometheus_config
2025-08-04 17:22:21 -07:00
Krrish Dholakia
37cb443010 refactor(oci/chat/transformation.py): lazy load package imports 2025-08-04 17:12:36 -07:00
Jugal D. Bhatt
368c9b75b9
add correct pricing (#13269) 2025-08-04 17:00:16 -07:00
Perling
1c6be9bdad
Fix: Langfuse reporting "client closed" error due to httpx client TTL (#13045)
* Fix: Langfuse reporting "client closed" error due to httpx client TTL

* remove log
2025-08-04 16:12:51 -07:00
Pascal Bro
a17d483c89
Add GCS bucket caching support (#13122) 2025-08-04 16:09:33 -07:00
breno-aumo
056b60a9fa
Support OCI provider (#13206)
* create OCI required files

* request and response conversion for non-streaming chat

* support tool calling with OCI generic API without streaming

* adaptation of api call for generic and cohere format

* include tool calls and responses in generic api and dropping support for cohere

* fix invalid content-length error

* support streaming for generic api

* fix auth error when using acompletion with streaming

* refactor: use base_llm_http_handler and include API type definitions

* update types and add type safety in different methods

* fix OCIFunction format

* create custom stream wrapper for decoding OCI stream

* remove unused files

* create unit tests for OCI

* lint the code

* remove manual test

* docs: update the docs to include OCI
2025-08-04 15:59:25 -07:00
Ishaan Jaff
849f5e0ba0
[Bug Fix] Fix Server root path regression on UI when using "Login" (#13267)
* bug fix serve_login_page

* test_serve_login_page_server_root_path
2025-08-04 15:58:28 -07:00
Benjamin Bartels
779579a604
Update model_prices_and_context_window.json (#13244) 2025-08-04 15:56:36 -07:00
Krrish Dholakia
747467c819 docs(user_keys.md): add litellm python sdk tab 2025-08-04 15:14:13 -07:00
Krrish Dholakia
bfecab2cc5 docs(index.md): cleanup tag 2025-08-04 14:18:04 -07:00
Ishaan Jaff
f3749709b8
Bug Fix - Responses API raises error with Gemini Tool Calls in input (#13260)
* add _transform_responses_api_function_call_to_chat_completion_message

* test_responses_api_with_tool_calls

* TestFunctionCallTransformation

* fixes for responses API testing google ai studio

* TestGoogleAIStudioResponsesAPITest

* test_responses_api_with_tool_calls

* test_responses_api_with_tool_calls

* test_basic_openai_responses_streaming_delete_endpoint
2025-08-04 12:01:33 -07:00
Ishaan Jaff
dae72003a7
[Bug Fix] OpenAI / Azure Responses API - Add service_tier , safety_identifier supported params (#13258)
* test_aresponses_service_tier_and_safety_identifier

* add service_tier + safety_identifier

* fix get_supported_openai_params

* add safety_identifier + service_tier for responses()
2025-08-04 10:51:53 -07:00
Jugal D. Bhatt
b318f55faa
[UI] Add team deletion check for teams with keys (#12953)
* added check option

* Add underline

* make less verbosE
2025-08-04 08:42:06 -07:00
Jugal D. Bhatt
36229dc69f
[LLM Translation] Fix Model Usage not having text tokens (#13234)
* fix + test

* remove test comments

* fix mypy

* fix mypy

* fix tests
2025-08-04 21:06:49 +05:30
Krrish Dholakia
98102e2804 docs(index.md): cleanup 2025-08-02 23:06:46 -07:00
Krrish Dholakia
2ee8513763 fix(key_management_endpoints.py): fix check 2025-08-02 23:03:57 -07:00
Krrish Dholakia
271fce9f39 build: update poetry 2025-08-02 23:01:46 -07:00
Jugal D. Bhatt
9aeca96c16
fix openshift (#13239) 2025-08-02 22:37:02 -07:00
Krish Dholakia
3119064e94
Prompt Management - add prompts on UI (#13240)
* fix(create_key_button.tsx): add prompts on UI

* feat(key_management_endpoints.py): support adding prompt to key via `/key/update`

* fix(key_info_view.tsx): show existing prompts on key in key_info_view.tsx

* fix(key_edit_view.tsx): UX - disable premium feature for non-premium users

prevent accidental clicking

* fix(create_key_button.tsx): disable premium features behind flag, prevent errors

* feat(prompts.tsx): add new ui component to view created prompts

enables viewing prompts created on config

* feat(prompt_info.tsx): add component for viewing the prompt information

* feat(prompt_endpoints.py): support converting dotprompt to json structure + accept json structure in promptmanager

allows prompt manager to work with api endpoints

* test(test_prompt_manager.py): add unit tests for json data input

* feat(dotprompt/__init__.py): add prompt data to dotpromptmanager

* fix(prompt_endpoints.py): working crud endpoints for prompt management

* feat(prompts/): support `prompt_file` for dotprompt

allows to precisely point to the prompt file a prompt should use

* feat(proxy/utils.py): resolve prompt id correctly

resolves user sent prompt id with internal prompt id

* feat(schema.prisma): initial pr with db schema for prompt management table

allows post endpoints to work with backend

* feat(prompt_endpoints.py): use db in patch_prompt endpoint

* feat(prompt_endpoints.py): use db for update_prompt endpoint

* feat(prompt_endpoints.py): use db on prompt delete endpoint

* build(schema.prisma): add prompt tale to schema.prisma in litellm-proxy-extras

* build(migration.sql): add new sql migration file

* fix(init_prompts.py): fix init

* feat(prompt_info_view.tsx): show the raw prompt template on ui

allows developer to know the prompt template they'll be calling

* feat(add_prompt_form.tsx): working ui add prompt flow

allows user to add prompts to litellm via ui

* build(ui/): styling fixes

* build(ui/): prompts.tsx

styling improvements

* fix(add_prompt_form.tsx): styling improvements

* build(prompts.tsx): styling improvements

* build(ui/): styling improvements

* build(ui/): fix ui error

* fix: fix ruff check

* docs: document new api params

* test: update tests
2025-08-02 22:33:37 -07:00
Krish Dholakia
e47b30a76d
Prompt Management - Add table + prompt info page to UI (#13232)
* fix(create_key_button.tsx): add prompts on UI

* feat(key_management_endpoints.py): support adding prompt to key via `/key/update`

* fix(key_info_view.tsx): show existing prompts on key in key_info_view.tsx

* fix(key_edit_view.tsx): UX - disable premium feature for non-premium users

prevent accidental clicking

* fix(create_key_button.tsx): disable premium features behind flag, prevent errors

* feat(prompts.tsx): add new ui component to view created prompts

enables viewing prompts created on config

* feat(prompt_info.tsx): add component for viewing the prompt information
2025-08-02 19:34:18 -07:00
Krish Dholakia
b79f55eec0
UI - Add giving keys prompt access (#13233)
* fix(create_key_button.tsx): add prompts on UI

* feat(key_management_endpoints.py): support adding prompt to key via `/key/update`

* fix(key_info_view.tsx): show existing prompts on key in key_info_view.tsx

* fix(key_edit_view.tsx): UX - disable premium feature for non-premium users

prevent accidental clicking

* fix(create_key_button.tsx): disable premium features behind flag, prevent errors

* fix(key_management_endpoints.py): fix key update logic \

* fix: fix check

* docs: document new params
2025-08-02 19:33:17 -07:00
Ishaan Jaff
4c217c66f5 docs User Agent Activity Tracking 2025-08-02 17:26:40 -07:00
Ishaan Jaff
2ee4e84406 docs fix 2025-08-02 16:47:44 -07:00
Ishaan Jaff
06856b4d37 docs fix 2025-08-02 15:47:09 -07:00
Ishaan Jaff
0f9f5f7a6c docs fix 2025-08-02 15:44:59 -07:00
Ishaan Jaff
69a360429c agent 4.png 2025-08-02 15:34:14 -07:00
Ishaan Jaff
e32169dc37 docs cost tracking coding 2025-08-02 15:29:44 -07:00
Ishaan Jaff
340b64a46a docs - Track Usage for Coding Tools 2025-08-02 15:18:04 -07:00
Ishaan Jaff
9b029c35be docs RC 2025-08-02 15:06:12 -07:00
Ishaan Jaff
8d6b333909 docs computer use 2025-08-02 15:00:48 -07:00
Ishaan Jaff
e306fb6eee
[docs release notes] (#13237)
* docs release notes

* docs release notes

* docs rnotes

* docs api version

* fixes docs

* docs rn
2025-08-02 14:15:10 -07:00
Ishaan Jaff
5dfc88473f fixes MCP gateway docs 2025-08-02 13:30:51 -07:00
Ishaan Jaff
6929767be2 docs release notes 2025-08-02 12:56:00 -07:00
Ishaan Jaff
ccbc81af8d ruff fix 2025-08-02 12:43:01 -07:00
Ishaan Jaff
c378e20573 bump: version 1.74.14 → 1.74.15 2025-08-02 12:38:00 -07:00
Ishaan Jaff
c663befc27 ui new build 2025-08-02 12:37:45 -07:00
Ishaan Jaff
39cb56566f doc fix - missing "prompts" in /key endpoint swagger 2025-08-02 12:34:30 -07:00
Ishaan Jaff
b279ba8a91 fixes - ui login with SSO 2025-08-02 12:28:46 -07:00
Ishaan Jaff
2dd9361cd9 Revert "Revert "Fix SSO Logout | Create Unified Login Page with SSO and Username/Password Options (#12703)""
This reverts commit 5fe37b6f72060add859a22ddda0665cd1635f98f.
2025-08-02 12:25:22 -07:00
Ishaan Jaff
af9031ba41 Revert "Fix SSO Logout | Create Unified Login Page with SSO and Username/Password Options (#12703)"
This reverts commit a752d7acc9.
2025-08-02 12:25:22 -07:00
Ishaan Jaff
b297dffba5
[UI QA Fixes] Stable release (#13231)
* qa - user agent view

* fixes for usage time selector
2025-08-02 12:22:23 -07:00
Ishaan Jaff
cd9c388a3f truncateUserAgent 2025-08-02 11:54:54 -07:00
Krish Dholakia
363c30320f
Prompt Management (2/2) - New /prompt/list endpoint + key-based access to prompt templates (#13218)
* feat: initial commit with prompt management support on pre-call hooks

allows prompt templates to work before assigning specific models

* feat: initial logic for independent prompt management settings

* feat(proxy_server.py): working logic for loading in the prompt templates from config yaml

allows creating an independent 'prompts' section in the config yaml

* feat(prompt_registry.py): working e2e custom prompt templates with guardrails and models

* refactor(prompts/): move folder inside proxy folder

easier management for prompt endpoints

* feat(prompt_endpoints.py): working `/prompt/list` endpoint

returns all available prompts on proxy

* feat(key_management_endpoints.py): support storing 'prompts' in key metadata

allows giving keys access to specific prompts

* feat(prompt_endpoints.py): enable key-based access to /prompts/list

ensures key can only see prompts it has access to

* fix(init_prompts.py): fix linting error

* fix: fix ruff check

* fix(proxy/_types.py): add 'prompts' to newteamrequest

* fix(litellm_logging.py): update logged message with scrubbed value
2025-08-02 10:36:38 -07:00
Krrish Dholakia
4cb42f81b6 fix(proxy_setting_endpoints.py): don't block startup if team doesn't exist in default team member budget 2025-08-02 10:34:37 -07:00