Commit Graph

23817 Commits

Author SHA1 Message Date
Jugal D. Bhatt
32501c85f5
fix unsupported operand type(s) for +=: 'NoneType' and 'str' on clientside auth creds for responses (#13293) 2025-08-05 13:16:16 -07:00
tanjiro
fd92f3eaf1
team req for service acc (#13302) 2025-08-05 13:01:54 -07:00
Ishaan Jaff
2eef77d960
add fireworks gpt-oss-20b (#13303) 2025-08-05 12:30:09 -07:00
Ishaan Jaff
0db13acdc7
New models - add fireworks_ai/glm-4p5 model family (#13297)
* add fireworks_ai/glm-4p5

* fix max output tokens
2025-08-05 12:08:42 -07:00
Ishaan Jaff
cc5c7aba03
[New model] add bedrock/us.anthropic.claude-opus-4-1-20250805-v1:0 (#13295)
* add us.anthropic.claude-opus-4-1-20250805-v1:0 bedrock model

* fix BEDROCK_CONVERSE_MODELS
2025-08-05 11:56:47 -07:00
Jugal D. Bhatt
1b9dd9daee
claude opus 4.1 support for anthropic provider (#13296) 2025-08-05 11:56:10 -07:00
Jugal D. Bhatt
609fa9f5ca
[LLM Translation + Coding tools] Added litellm claude code count tokens support (#13261)
* Added litellm claude code count tokens support

* fix mypy

* create helper

* Revert construct

* revert construct

* fix return

* Add reutrn none

* change to factory approach

* refactor to BaseModelInfo

* enum fix
2025-08-05 10:57:24 -07:00
Jugal D. Bhatt
29a8c583c2
added redis iam auth (#13275) 2025-08-05 10:56:34 -07:00
Ishaan Jaff
7c42659a98
Revert "Fix: Langfuse reporting "client closed" error due to httpx client TTL…" (#13291)
This reverts commit 1c6be9bdad.
2025-08-05 09:58:57 -07:00
Ishaan Jaff
5a02eb473b test_function_calling_with_tool_response 2025-08-05 09:55:47 -07:00
Krish Dholakia
416da066eb
fix(main.py): handle tool being a pydantic object (#13274)
* fix(main.py): handle tool being a pydantic object

Fixes https://github.com/BerriAI/litellm/issues/13064

* fix(prompt_templates/common_utils.py): fix unpack defs deepcopy issue

Fixes https://github.com/BerriAI/litellm/issues/13151

* fix(utils.py): handle tools is none
2025-08-04 23:44:02 -07:00
Krish Dholakia
eb49f987de
Ensure disable_llm_api_endpoints works + Add wildcard model support for 'team-byok' model (#13278)
* fix(route_checks.py): ensure disable llm api endpoints is correctly set

* fix(route_checks.py): raise httpexception

raise expected exceptions

* fix(router.py): handle team only wildcard models

fixes issue where team only wildcard models were not considered during auth checks

* fix(router.py): handle team only wildcard models

fixes issue where team only wildcard models were not considered during auth checks
2025-08-04 23:19:51 -07:00
Krish Dholakia
af67c3576f
fix OCI linting errors (#13279)
* fix(types/llms/oci.py): fix linting errors

* fix(oci.py): fix linting error

* fix(oci.py): fix linting errors

* fix: fix linting error

* fix: fix linting error
2025-08-04 23:10:46 -07:00
Ishaan Jaff
ec205fec35
[UI] - Add ability to set model alias per key/team (#13276)
* update model alias on keys

* team model aliases

* fix model aliases

* fixes for teams
2025-08-04 21:47:39 -07:00
Jugal D. Bhatt
efd34966dc
[LLM Translation] Support /v1/models/{model_id} retrieval (#13268)
* added model id endpoint

* fix test

* add route to internal users

* make the functions reusable

* fixed mypy
2025-08-04 18:03:59 -07:00
Jugal D. Bhatt
de7108b5f8
input cost per token higher than 1 test (#13270) 2025-08-04 18:02:03 -07:00
Ishaan Jaff
ad26cba8b6 add litellm-enterprise==0.1.17 2025-08-04 17:26:50 -07:00
Ishaan Jaff
8314227a60 bump: version 1.75.0 → 1.75.1 2025-08-04 17:24:40 -07:00
Ishaan Jaff
d948b47dba bump: version 1.74.15 → 1.75.0 2025-08-04 17:23:55 -07:00
Ishaan Jaff
ba1882fdd5
[Bug Fix] Prometheus - fix for litellm_input_tokens_metric, litellm_output_tokens_metric - Note this updates the metric name (#13271)
* fixes for litellm_tokens_metric

* test_prometheus_token_metrics_with_prometheus_config
2025-08-04 17:22:21 -07:00
Krrish Dholakia
37cb443010 refactor(oci/chat/transformation.py): lazy load package imports 2025-08-04 17:12:36 -07:00
Jugal D. Bhatt
368c9b75b9
add correct pricing (#13269) 2025-08-04 17:00:16 -07:00
Perling
1c6be9bdad
Fix: Langfuse reporting "client closed" error due to httpx client TTL (#13045)
* Fix: Langfuse reporting "client closed" error due to httpx client TTL

* remove log
2025-08-04 16:12:51 -07:00
Pascal Bro
a17d483c89
Add GCS bucket caching support (#13122) 2025-08-04 16:09:33 -07:00
breno-aumo
056b60a9fa
Support OCI provider (#13206)
* create OCI required files

* request and response conversion for non-streaming chat

* support tool calling with OCI generic API without streaming

* adaptation of api call for generic and cohere format

* include tool calls and responses in generic api and dropping support for cohere

* fix invalid content-length error

* support streaming for generic api

* fix auth error when using acompletion with streaming

* refactor: use base_llm_http_handler and include API type definitions

* update types and add type safety in different methods

* fix OCIFunction format

* create custom stream wrapper for decoding OCI stream

* remove unused files

* create unit tests for OCI

* lint the code

* remove manual test

* docs: update the docs to include OCI
2025-08-04 15:59:25 -07:00
Ishaan Jaff
849f5e0ba0
[Bug Fix] Fix Server root path regression on UI when using "Login" (#13267)
* bug fix serve_login_page

* test_serve_login_page_server_root_path
2025-08-04 15:58:28 -07:00
Benjamin Bartels
779579a604
Update model_prices_and_context_window.json (#13244) 2025-08-04 15:56:36 -07:00
Krrish Dholakia
747467c819 docs(user_keys.md): add litellm python sdk tab 2025-08-04 15:14:13 -07:00
Krrish Dholakia
bfecab2cc5 docs(index.md): cleanup tag 2025-08-04 14:18:04 -07:00
Ishaan Jaff
f3749709b8
Bug Fix - Responses API raises error with Gemini Tool Calls in input (#13260)
* add _transform_responses_api_function_call_to_chat_completion_message

* test_responses_api_with_tool_calls

* TestFunctionCallTransformation

* fixes for responses API testing google ai studio

* TestGoogleAIStudioResponsesAPITest

* test_responses_api_with_tool_calls

* test_responses_api_with_tool_calls

* test_basic_openai_responses_streaming_delete_endpoint
2025-08-04 12:01:33 -07:00
Ishaan Jaff
dae72003a7
[Bug Fix] OpenAI / Azure Responses API - Add service_tier , safety_identifier supported params (#13258)
* test_aresponses_service_tier_and_safety_identifier

* add service_tier + safety_identifier

* fix get_supported_openai_params

* add safety_identifier + service_tier for responses()
2025-08-04 10:51:53 -07:00
Jugal D. Bhatt
b318f55faa
[UI] Add team deletion check for teams with keys (#12953)
* added check option

* Add underline

* make less verbosE
2025-08-04 08:42:06 -07:00
Jugal D. Bhatt
36229dc69f
[LLM Translation] Fix Model Usage not having text tokens (#13234)
* fix + test

* remove test comments

* fix mypy

* fix mypy

* fix tests
2025-08-04 21:06:49 +05:30
Krrish Dholakia
98102e2804 docs(index.md): cleanup 2025-08-02 23:06:46 -07:00
Krrish Dholakia
2ee8513763 fix(key_management_endpoints.py): fix check 2025-08-02 23:03:57 -07:00
Krrish Dholakia
271fce9f39 build: update poetry 2025-08-02 23:01:46 -07:00
Jugal D. Bhatt
9aeca96c16
fix openshift (#13239) 2025-08-02 22:37:02 -07:00
Krish Dholakia
3119064e94
Prompt Management - add prompts on UI (#13240)
* fix(create_key_button.tsx): add prompts on UI

* feat(key_management_endpoints.py): support adding prompt to key via `/key/update`

* fix(key_info_view.tsx): show existing prompts on key in key_info_view.tsx

* fix(key_edit_view.tsx): UX - disable premium feature for non-premium users

prevent accidental clicking

* fix(create_key_button.tsx): disable premium features behind flag, prevent errors

* feat(prompts.tsx): add new ui component to view created prompts

enables viewing prompts created on config

* feat(prompt_info.tsx): add component for viewing the prompt information

* feat(prompt_endpoints.py): support converting dotprompt to json structure + accept json structure in promptmanager

allows prompt manager to work with api endpoints

* test(test_prompt_manager.py): add unit tests for json data input

* feat(dotprompt/__init__.py): add prompt data to dotpromptmanager

* fix(prompt_endpoints.py): working crud endpoints for prompt management

* feat(prompts/): support `prompt_file` for dotprompt

allows to precisely point to the prompt file a prompt should use

* feat(proxy/utils.py): resolve prompt id correctly

resolves user sent prompt id with internal prompt id

* feat(schema.prisma): initial pr with db schema for prompt management table

allows post endpoints to work with backend

* feat(prompt_endpoints.py): use db in patch_prompt endpoint

* feat(prompt_endpoints.py): use db for update_prompt endpoint

* feat(prompt_endpoints.py): use db on prompt delete endpoint

* build(schema.prisma): add prompt tale to schema.prisma in litellm-proxy-extras

* build(migration.sql): add new sql migration file

* fix(init_prompts.py): fix init

* feat(prompt_info_view.tsx): show the raw prompt template on ui

allows developer to know the prompt template they'll be calling

* feat(add_prompt_form.tsx): working ui add prompt flow

allows user to add prompts to litellm via ui

* build(ui/): styling fixes

* build(ui/): prompts.tsx

styling improvements

* fix(add_prompt_form.tsx): styling improvements

* build(prompts.tsx): styling improvements

* build(ui/): styling improvements

* build(ui/): fix ui error

* fix: fix ruff check

* docs: document new api params

* test: update tests
2025-08-02 22:33:37 -07:00
Krish Dholakia
e47b30a76d
Prompt Management - Add table + prompt info page to UI (#13232)
* fix(create_key_button.tsx): add prompts on UI

* feat(key_management_endpoints.py): support adding prompt to key via `/key/update`

* fix(key_info_view.tsx): show existing prompts on key in key_info_view.tsx

* fix(key_edit_view.tsx): UX - disable premium feature for non-premium users

prevent accidental clicking

* fix(create_key_button.tsx): disable premium features behind flag, prevent errors

* feat(prompts.tsx): add new ui component to view created prompts

enables viewing prompts created on config

* feat(prompt_info.tsx): add component for viewing the prompt information
2025-08-02 19:34:18 -07:00
Krish Dholakia
b79f55eec0
UI - Add giving keys prompt access (#13233)
* fix(create_key_button.tsx): add prompts on UI

* feat(key_management_endpoints.py): support adding prompt to key via `/key/update`

* fix(key_info_view.tsx): show existing prompts on key in key_info_view.tsx

* fix(key_edit_view.tsx): UX - disable premium feature for non-premium users

prevent accidental clicking

* fix(create_key_button.tsx): disable premium features behind flag, prevent errors

* fix(key_management_endpoints.py): fix key update logic \

* fix: fix check

* docs: document new params
2025-08-02 19:33:17 -07:00
Ishaan Jaff
4c217c66f5 docs User Agent Activity Tracking 2025-08-02 17:26:40 -07:00
Ishaan Jaff
2ee4e84406 docs fix 2025-08-02 16:47:44 -07:00
Ishaan Jaff
06856b4d37 docs fix 2025-08-02 15:47:09 -07:00
Ishaan Jaff
0f9f5f7a6c docs fix 2025-08-02 15:44:59 -07:00
Ishaan Jaff
69a360429c agent 4.png 2025-08-02 15:34:14 -07:00
Ishaan Jaff
e32169dc37 docs cost tracking coding 2025-08-02 15:29:44 -07:00
Ishaan Jaff
340b64a46a docs - Track Usage for Coding Tools 2025-08-02 15:18:04 -07:00
Ishaan Jaff
9b029c35be docs RC 2025-08-02 15:06:12 -07:00
Ishaan Jaff
8d6b333909 docs computer use 2025-08-02 15:00:48 -07:00
Ishaan Jaff
e306fb6eee
[docs release notes] (#13237)
* docs release notes

* docs release notes

* docs rnotes

* docs api version

* fixes docs

* docs rn
2025-08-02 14:15:10 -07:00