Commit Graph

30881 Commits

Author SHA1 Message Date
Ishaan Jaffer
bf934c0799 test_anthropic_api_prompt_caching_basic_with_cache_creation 2025-11-01 09:21:42 -07:00
Ishaan Jaffer
9632b96df7 mypy lint fix 2025-11-01 09:21:25 -07:00
Ishaan Jaffer
14543324af test_team_budget_metrics 2025-11-01 09:21:17 -07:00
Ishaan Jaffer
4f47680cbe fix test fixes 2025-10-31 21:00:31 -07:00
Ishaan Jaffer
f2b5a5f832 test google endpoints 2025-10-31 20:50:31 -07:00
Ishaan Jaffer
cd379c1321 test_anthropic_websearch 2025-10-31 20:43:07 -07:00
Ishaan Jaffer
b18cef300a undo test_anthropic_websearch change 2025-10-31 20:39:24 -07:00
Ishaan Jaffer
290e608818 get_computer_tool_beta_header 2025-10-31 20:38:37 -07:00
Ishaan Jaffer
a401055975 get_computer_tool_beta_header 2025-10-31 20:38:30 -07:00
Ishaan Jaffer
5e4da65664 fail ai test fix 2025-10-31 20:32:44 -07:00
Ishaan Jaffer
014362cace fix ocr test 2025-10-31 20:32:03 -07:00
Ishaan Jaffer
8388319863 fix _extract_usage_for_ocr_call 2025-10-31 20:31:53 -07:00
Ishaan Jaffer
a964e7f24c test_stream_token_counting_anthropic_with_include_usage 2025-10-31 20:24:58 -07:00
Ishaan Jaffer
2f1e947c44 test_anthropic_api_prompt_caching_basic 2025-10-31 19:32:46 -07:00
Ishaan Jaffer
27a98de600 test_health_and_chat_completion 2025-10-31 19:28:59 -07:00
Ishaan Jaffer
cd9cf2e6bd test fix 2025-10-31 19:23:08 -07:00
Ishaan Jaffer
af73879659 db_migration_disable_update_check 2025-10-31 19:23:08 -07:00
Ishaan Jaffer
c918dafb32 test_router_fallbacks_with_custom_model_costs 2025-10-31 19:23:08 -07:00
RoniGurvichCycode
eeda5ab84e
requirements update (#16054)
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-10-31 19:18:03 -07:00
Ishaan Jaffer
6be9b97d15 test_stream_token_counting_anthropic_with_include_usage 2025-10-31 19:15:07 -07:00
dependabot[bot]
1bc88b5fc9
build(deps): bump starlette from 0.47.2 to 0.49.1 (#16027)
Bumps [starlette](https://github.com/Kludex/starlette) from 0.47.2 to 0.49.1.
- [Release notes](https://github.com/Kludex/starlette/releases)
- [Changelog](https://github.com/Kludex/starlette/blob/main/docs/release-notes.md)
- [Commits](https://github.com/Kludex/starlette/compare/0.47.2...0.49.1)

---
updated-dependencies:
- dependency-name: starlette
  dependency-version: 0.49.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-31 19:13:11 -07:00
Ishaan Jaffer
6e46824939 test_streaming_response 2025-10-31 19:10:38 -07:00
Ishaan Jaffer
515ae9680e test_anthropic_tool_use 2025-10-31 19:08:32 -07:00
Ishaan Jaffer
f173cb0f54 test_anthropic_text_editor 2025-10-31 19:07:46 -07:00
Ishaan Jaffer
928fddb3be test_anthropic_structured_output 2025-10-31 19:06:45 -07:00
Ishaan Jaffer
7f79abb552 test_aastreaming_tool_calls_valid_json_str 2025-10-31 19:05:31 -07:00
Ishaan Jaffer
2cd57540a4 fix test fixes 2025-10-31 18:31:00 -07:00
Ishaan Jaffer
e6c9df230f fix linting 2025-10-31 18:26:22 -07:00
Ishaan Jaffer
22eb2f8033 Revert "Python entry-point for CustomLLM subclasses (#15881)"
This reverts commit 559ae96e38.
2025-10-31 18:24:39 -07:00
Ishaan Jaffer
94c2c28f3d claude-sonnet-4-5-20250929 fix 2025-10-31 18:20:52 -07:00
Ishaan Jaffer
bd52cb2983 bump proxy extras 2025-10-31 18:19:28 -07:00
Ishaan Jaffer
98af05fb43 add LiteLLM_SSOConfig 2025-10-31 18:15:37 -07:00
Ishaan Jaffer
159db27d5c fix test claude-sonnet-4-5-20250929 2025-10-31 18:13:29 -07:00
Ishaan Jaffer
d90f1696c3 UI new build 2025-10-31 18:11:41 -07:00
Ishaan Jaffer
16a1b57dd5 TestTavilySearch 2025-10-31 18:06:01 -07:00
Ishaan Jaffer
51349cdc99 fix _strip_base64_from_messages 2025-10-31 17:59:13 -07:00
Ishaan Jaffer
2fe2704a21 fixes code QA check 2025-10-31 17:55:49 -07:00
Ishaan Jaffer
73f745ee09 fix claude-sonnet-4-5-20250929 2025-10-31 17:48:49 -07:00
Ishaan Jaffer
09e18ea0ac fix get_guardrail_info 2025-10-31 17:45:38 -07:00
Ishaan Jaff
c59a0c9681
[Feat] UI - Allow setting cache settings on UI (#16143)
* add LiteLLM_CacheConfig

* add CacheSettingsField

* add UI cache saver

* feat add cache_settings_router

* fix schema

* fix ssl_check_hostname

* refactor into utils

* add groups for field names

* add test_connection in base cache

* add test_connection inredis and redis cluster

* feat _decrypt_db_variables

* add cache settings endpoints

* test_test_cache_connection_calls_cache_test_connection_with_params

* fix: add switch_on_llm_response_caching

* feat use CacheSettingsManager

* feat use CacheSettingsManager

* TestCacheSettingsManager

* fix update_config

* Cache Field test
2025-10-31 17:43:59 -07:00
yuneng-jiang
725671395a
[Feature] UI - Config Guardrails should not be editable and guardrail info fix (#16142)
* UI Config Guardrails should not be editable and guardrails info definition location fix

* Remove unused import

* Added literals for guardrail definition location
2025-10-31 16:29:24 -07:00
yuneng-jiang
cf0d84c789
[Feature] UI - Add Tags to update model (#16140)
* Add Tags to update model

* Test Key Page Tag Selector
2025-10-31 16:28:46 -07:00
yuneng-jiang
dd053e1d12
[Feature] UI - Add tags in model creation (#16138)
* Add tags in model creation

* Removing unused import in test
2025-10-31 16:26:30 -07:00
Ishaan Jaff
b6312e68f0
[Feat] UI + Management - Allow setting all routing strategies, tag filtering on UI (#16139)
* add ROUTER_SETTINGS_FIELDS

* feat: add router_settings_router on proxy

* add RouterSettingsField

* update RouterSettingsResponse

* add ROUTER_SETTINGS_FIELDS

* add getRouterSettingsCall

* add UI friendly name

* fix router settings

* fix get descriptions

* fix toggles /refator

* fix refactor

* fix refactor

* fix ROUTING_STRATEGY_DESCRIPTIONS

* fix fields
2025-10-31 11:29:37 -07:00
Raghav Jhavar
1f10e8e49c
make debug log debug (#16137) 2025-10-31 11:17:24 -07:00
1stprinciple
2824388c30
Don't add "accounts/fireworks/models" prefix for Fireworks Provider (#15938)
* init

* if not model.startswith("accounts/") and "#" not in model:
2025-10-30 20:36:42 -07:00
Sameer Kankute
689b210c18
Add Xai websearch cost (#16001)
* Add xai websearch cost

* Add test for websearch cost in xai

* remove not required changes
2025-10-30 20:35:34 -07:00
Boxuan Li
297c2a0bf4
prompt_caching.md: Fix wrong prompt_tokens definition (#16044) 2025-10-30 20:13:13 -07:00
Nicholas Couture
f747a4a38a
fix: Handle multiple rate limit types per descriptor and prevent IndexError (#16039)
* improve descriptor_key handling for multiple and missing rate limit descriptors in parallel request limiter v3

* Add tests for parallel request limiter v3 in proxy hooks
2025-10-30 20:12:54 -07:00
Sameer Kankute
c1369a07ba
Add Add per model group header forwarding for Bedrock Invoke API (#16042) 2025-10-30 20:10:17 -07:00