Ishaan Jaff
37d885e46a
[Fix] LiteLLM does not support new web_search tool (Responses API) ( #14083 )
...
* test_basic_openai_responses_with_websearch
* fix: ResponsesAPIResponse
* fix: StandardBuiltInToolCostTracking
2025-08-29 18:33:52 -07:00
Ishaan Jaff
d9ca0f9300
security: fix next js version ( #14084 )
2025-08-29 18:09:11 -07:00
Ishaan Jaff
be86861eb8
feat: add gpt-realtime models - gpt-realtime ( #14082 )
...
* feat: add gpt-realtime models
* add input_cost_per_image
2025-08-29 17:49:47 -07:00
WilsonSunBritten
6d81d75948
docs: Add documentation for MAX_STRING_LENGTH_PROMPT_IN_DB environment variable ( #14079 )
...
Added documentation for the new MAX_STRING_LENGTH_PROMPT_IN_DB environment variable to the config settings guide. This variable controls the maximum length of strings in spend logs when sanitizing request bodies, with a default value of 1000 characters.
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-authored-by: Claude <noreply@anthropic.com>
2025-08-29 17:38:50 -07:00
Ishaan Jaff
5ee7a675f2
[Bug]: grok-4 does not support frequency_penalty, litellm should drop this param for grok-4 ( #14078 )
...
* fix: _supports_frequency_penalty
* _supports_frequency_penalty
* test_xai_grok_4_frequency_penalty_not_supported
2025-08-29 17:31:48 -07:00
Mubashir Osmani
38df2500b6
docs: usaged-based routing perf warnings ( #14080 )
2025-08-29 17:31:12 -07:00
Krrish Dholakia
86c5de17bc
fix(handle_jwt.py): document the raw received jwt token
2025-08-29 14:53:07 -07:00
Ishaan Jaff
607f425cc6
[Bug]: Fix Can't set reasoning_effort for DeepSeek-V3.1 on DeepInfra by default ( #14053 )
...
* fix DeepInfraConfig
* track supports reasoning
* fix: get_supported_openai_params
* test_deepseek_supported_openai_params
2025-08-29 13:15:43 -07:00
Carson Gee
e74f1b6b62
Added DataRobot provider to sidebar ( #14074 )
2025-08-29 13:15:33 -07:00
Ishaan Jaff
6edc5c18de
fix: RPS don't print the request params by default ( #14015 )
2025-08-29 12:06:54 -07:00
Teddy Amkie
7f5c92ddeb
Update docs for stream_timeout and timeout ( #14073 )
2025-08-29 09:59:07 -07:00
Krish Dholakia
bcd38dde2e
Merge pull request #14036 from gotsysdba/main
...
OCI Provider: add oci_key_file as an optional_parameter
2025-08-29 06:27:09 -07:00
Krish Dholakia
7513bec0e9
Merge pull request #14037 from NoWall57/feature/force-anthropic-custom-api-base-readme
...
docs: add documentation for LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX envi…
2025-08-29 06:26:11 -07:00
Krish Dholakia
f73b9da2cd
Merge pull request #14040 from dmvieira/main
...
Fix error saving latency as timedelta on Redis
2025-08-29 06:25:43 -07:00
Krish Dholakia
c4f60f1a06
Merge pull request #14038 from datarobot-forks/carsongee/add_docs
...
📖 Add DataRobot to the provider documentation.
2025-08-29 06:25:13 -07:00
Krish Dholakia
38a7c8a560
Merge pull request #14041 from Const-antine/litellm_helm_custom_configmap
...
[Helm charts] Enhance proxy_config configuration: add support for existing configmap
2025-08-29 06:24:57 -07:00
Krish Dholakia
fffccc0675
Merge pull request #14042 from WilsonSunBritten/10988-set-truncation-threshold
...
Allow configuration to set threshold before request entry in spend log gets truncated
2025-08-29 06:24:28 -07:00
Krish Dholakia
dd33e3f928
Merge pull request #14050 from lmwang9527/fix/logging-worker-graceful-shutdown
...
Fix LoggingWorker graceful shutdown to prevent CancelledError warnings
2025-08-29 06:23:53 -07:00
Carson Gee
f90072b226
Apply suggestions from code review
...
Co-authored-by: Nate Goudreault <50588929+nate-goudreault@users.noreply.github.com>
2025-08-28 23:00:09 -06:00
Carson Gee
bf55bf5072
Update datarobot.md
2025-08-28 23:00:09 -06:00
mjnitz02
5c73b17387
Add initial docs
2025-08-28 23:00:09 -06:00
Ishaan Jaff
81db36c06c
add xai/grok-code-fast ( #14054 )
2025-08-28 18:10:04 -07:00
Ishaan Jaff
3fe05b300a
fix - use import fastuuid as uuid ( #14016 )
2025-08-28 17:57:46 -07:00
WilsonSunBritten
b3edff02e8
fix mock tests
2025-08-28 17:40:16 -06:00
WilsonSunBritten
8bf2fe2991
attempt to fix unrelated lint error
2025-08-28 17:21:17 -06:00
WilsonSunBritten
e6ba9b4c91
lint fix
2025-08-28 17:12:48 -06:00
WilsonSunBritten
4ea92d96cb
lint fix
2025-08-28 17:11:50 -06:00
WilsonSunBritten
0721345703
Switch to string constant based truncation
2025-08-28 16:28:36 -06:00
Ishaan Jaff
f3338bef9f
[MCP] Bug fix - adding SSE MCP tools - fix connection test when adding MCPs ( #14048 )
...
* fix: _execute_with_mcp_client
* add warning for SSE MCP
* docs - MCP videos / guides
2025-08-28 15:16:34 -07:00
Ishaan Jaff
37a599932d
[Bug Fix] Virtual keys with llm_api type cause Internal Server Error when using /anthropic/* and other llm passthrough routes ( #14046 )
...
* fix route checks passthrough_routes_wildcard
* refactor check_route_access
* test_virtual_key_llm_api_route_includes_passthrough_prefix
2025-08-28 15:14:09 -07:00
WilsonSunBritten
026480358b
Revert "Allow configuration to on what threshold to try truncating request content in db"
...
This reverts commit 771052d67d
2025-08-28 16:12:42 -06:00
lmwang
6760a6aaa1
Fix LoggingWorker graceful shutdown to prevent CancelledError warnings
...
- Change exception logging to debug level during shutdown cancellation
- Add clear_queue() call to process remaining coroutines during shutdown
- Prevents 'RuntimeWarning: coroutine was never awaited' messages
- Add comprehensive tests for graceful shutdown behavior
Fixes #13970
2025-08-28 14:15:17 -07:00
Const-antine
f8d1e03450
rework tests
2025-08-28 13:39:09 -04:00
Const-antine
1350336515
fix tests
2025-08-28 13:30:11 -04:00
Const-antine
d3b526041f
better formatting
2025-08-28 13:18:36 -04:00
Const-antine
730e9c90a2
fix formatting
2025-08-28 13:18:33 -04:00
Const-antine
5d973ea06e
update readme
2025-08-28 13:18:26 -04:00
Const-antine
409429ddd6
add new tests
2025-08-28 13:18:23 -04:00
Const-antine
ff4040bbe1
add functionality to mount existing configmap if needed
2025-08-28 13:18:05 -04:00
Wilson Britten
771052d67d
Allow configuration to on what threshold to try truncating request content in db
2025-08-28 09:48:50 -06:00
Diogo Munaro Vieira
d2ffca24bb
fix: timedelta as cache serializable error
2025-08-28 11:42:25 -03:00
0x5751
323fe8aeac
docs: add documentation for LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX environment variable
...
Added comprehensive documentation for the new LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX configuration option that allows users to disable automatic URL suffix appending when using custom Anthropic API endpoints. This is useful for proxy servers or custom endpoints that don't follow Anthropic's standard URL structure.
Changes:
- Added environment variable to Anthropic provider docs with examples
- Created "Custom API Base" section explaining usage scenarios
- Added entry to environment variables reference table in config settings
2025-08-28 22:21:41 +08:00
gotsysdba
15f1d82536
Fix tests
2025-08-28 14:54:38 +01:00
gotsysdba
87abfc3c11
Adding oci_key_file support for oci provider
2025-08-28 14:37:53 +01:00
Krish Dholakia
e638c5490d
Merge pull request #13945 from NoWall57/feature/force-anthropic-custom-api-base
...
feat: Add support for custom Anthropic-compatible API endpoints
2025-08-27 22:28:55 -07:00
Krish Dholakia
74c9663189
Merge pull request #12797 from ericgtkb/fix-vertex-ai-anyof
...
Fix additional anyOf corner cases for Vertex AI Gemini tool calls - issue #11164
2025-08-27 22:26:13 -07:00
Krish Dholakia
68f4847659
Merge pull request #12865 from aholmberg/holmberg/default-reasoning
...
fix: make gemini and openai responses return reasoning by default
2025-08-27 22:25:30 -07:00
Krish Dholakia
fc738c5822
Merge branch 'main' into holmberg/default-reasoning
2025-08-27 22:25:22 -07:00
Krish Dholakia
df39320889
Merge pull request #12885 from xywei/main
...
Remove vector store methods from global scope
2025-08-27 22:22:59 -07:00
Krish Dholakia
67d432a6d7
Merge pull request #13243 from nagyv-team/main
...
Ensure that `function_call_prompt` extends system messages following its current schema
2025-08-27 22:16:53 -07:00
