ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
34,378 Commits 9 Branches 7 Tags 935 MiB
dd183a7fcb
Commit Graph

34378 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Teddy Amkie
7f5c92ddeb
Update docs for stream_timeout and timeout (#14073) 2025-08-29 09:59:07 -07:00
tanjiro
14d19a4d72 adjust padding on the screen 2025-08-30 01:45:42 +09:00
tanjiro
9682f76474 move the menu button to top nav+ change the icon size 2025-08-30 01:34:30 +09:00
Krish Dholakia
bcd38dde2e
Merge pull request #14036 from gotsysdba/main 
OCI Provider: add oci_key_file as an optional_parameter
 2025-08-29 06:27:09 -07:00
Krish Dholakia
7513bec0e9
Merge pull request #14037 from NoWall57/feature/force-anthropic-custom-api-base-readme 
docs: add documentation for LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX envi…
 2025-08-29 06:26:11 -07:00
Krish Dholakia
f73b9da2cd
Merge pull request #14040 from dmvieira/main 
Fix error saving latency as timedelta on Redis
 2025-08-29 06:25:43 -07:00
Krish Dholakia
c4f60f1a06
Merge pull request #14038 from datarobot-forks/carsongee/add_docs 
📖 Add DataRobot to the provider documentation.
 2025-08-29 06:25:13 -07:00
Krish Dholakia
38a7c8a560
Merge pull request #14041 from Const-antine/litellm_helm_custom_configmap 
[Helm charts] Enhance proxy_config configuration: add support for existing configmap
 2025-08-29 06:24:57 -07:00
Krish Dholakia
fffccc0675
Merge pull request #14042 from WilsonSunBritten/10988-set-truncation-threshold 
Allow configuration to set threshold before request entry in spend log gets truncated
 2025-08-29 06:24:28 -07:00
Krish Dholakia
dd33e3f928
Merge pull request #14050 from lmwang9527/fix/logging-worker-graceful-shutdown 
Fix LoggingWorker graceful shutdown to prevent CancelledError warnings
 2025-08-29 06:23:53 -07:00
Carson Gee
f90072b226
Apply suggestions from code review 
Co-authored-by: Nate Goudreault <50588929+nate-goudreault@users.noreply.github.com>
 2025-08-28 23:00:09 -06:00
Carson Gee
bf55bf5072
Update datarobot.md 2025-08-28 23:00:09 -06:00
mjnitz02
5c73b17387
Add initial docs 2025-08-28 23:00:09 -06:00
Ishaan Jaff
81db36c06c
add xai/grok-code-fast (#14054) 2025-08-28 18:10:04 -07:00
Ishaan Jaff
3fe05b300a
fix - use import fastuuid as uuid (#14016) 2025-08-28 17:57:46 -07:00
WilsonSunBritten
b3edff02e8 fix mock tests 2025-08-28 17:40:16 -06:00
WilsonSunBritten
8bf2fe2991 attempt to fix unrelated lint error 2025-08-28 17:21:17 -06:00
WilsonSunBritten
e6ba9b4c91 lint fix 2025-08-28 17:12:48 -06:00
WilsonSunBritten
4ea92d96cb lint fix 2025-08-28 17:11:50 -06:00
WilsonSunBritten
0721345703 Switch to string constant based truncation 2025-08-28 16:28:36 -06:00
Ishaan Jaff
f3338bef9f
[MCP] Bug fix - adding SSE MCP tools - fix connection test when adding MCPs (#14048) 
* fix: _execute_with_mcp_client

* add warning for SSE MCP

* docs - MCP videos / guides
 2025-08-28 15:16:34 -07:00
Ishaan Jaff
37a599932d
[Bug Fix] Virtual keys with llm_api type cause Internal Server Error when using /anthropic/* and other llm passthrough routes (#14046) 
* fix route checks passthrough_routes_wildcard

* refactor check_route_access

* test_virtual_key_llm_api_route_includes_passthrough_prefix
 2025-08-28 15:14:09 -07:00
WilsonSunBritten
026480358b Revert "Allow configuration to on what threshold to try truncating request content in db" 
This reverts commit 771052d67d.
 2025-08-28 16:12:42 -06:00
lmwang
6760a6aaa1 Fix LoggingWorker graceful shutdown to prevent CancelledError warnings 
- Change exception logging to debug level during shutdown cancellation
- Add clear_queue() call to process remaining coroutines during shutdown
- Prevents 'RuntimeWarning: coroutine was never awaited' messages
- Add comprehensive tests for graceful shutdown behavior

Fixes #13970
 2025-08-28 14:15:17 -07:00
Const-antine
f8d1e03450 rework tests 2025-08-28 13:39:09 -04:00
Const-antine
1350336515 fix tests 2025-08-28 13:30:11 -04:00
Const-antine
d3b526041f better formatting 2025-08-28 13:18:36 -04:00
Const-antine
730e9c90a2 fix formatting 2025-08-28 13:18:33 -04:00
Const-antine
5d973ea06e update readme 2025-08-28 13:18:26 -04:00
Const-antine
409429ddd6 add new tests 2025-08-28 13:18:23 -04:00
Const-antine
ff4040bbe1 add functionality to mount existing configmap if needed 2025-08-28 13:18:05 -04:00
Wilson Britten
771052d67d Allow configuration to on what threshold to try truncating request content in db 2025-08-28 09:48:50 -06:00
Andrew Doan
3f215fcf8f
Merge branch 'main' into cryptography_upgrade 2025-08-28 10:59:51 -04:00
Andrew Doan
530cc75223 Re-generate poetry.lock file 2025-08-28 10:57:46 -04:00
Diogo Munaro Vieira
d2ffca24bb fix: timedelta as cache serializable error 2025-08-28 11:42:25 -03:00
0x5751
323fe8aeac docs: add documentation for LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX environment variable 
Added comprehensive documentation for the new LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX configuration option that allows users to disable automatic URL suffix appending when using custom Anthropic API endpoints. This is useful for proxy servers or custom endpoints that don't follow Anthropic's standard URL structure.

Changes:
- Added environment variable to Anthropic provider docs with examples
- Created "Custom API Base" section explaining usage scenarios
- Added entry to environment variables reference table in config settings
 2025-08-28 22:21:41 +08:00
gotsysdba
15f1d82536
Fix tests 2025-08-28 14:54:38 +01:00
gotsysdba
87abfc3c11
Adding oci_key_file support for oci provider 2025-08-28 14:37:53 +01:00
TomuHirata
38a1dbd13a fix(databricks): include citations in reasoning content type 2025-08-28 22:30:27 +09:00
TomuHirata
7333060fb0 feat(databricks): add anthropic citation support 2025-08-28 18:43:43 +09:00
Mohse Morad
d217c400df Remove redundent 2025-08-28 12:26:18 +03:00
Mohse Morad
8cce5e6307 Added tests 2025-08-28 12:21:35 +03:00
onlylhf
b9ff636763 Optimize import statements and remove any unused type prompts 2025-08-28 15:51:22 +08:00
李海峰
2d0a57a719 Add Volcengine embedding module with handler and transformation logic 
- Implemented VolcEngineEmbeddingHandler for synchronous and asynchronous embedding requests.
- Created VolcEngineEmbeddingConfig for transforming requests and responses to/from Volcengine format.
- Added integration tests for embedding functionality, covering various scenarios including error handling and parameter validation.
- Established test structure for Volcengine embedding, ensuring compliance with LiteLLM testing patterns.
- Included comprehensive tests for parameter mapping, request transformation, and response handling.
 2025-08-28 15:05:11 +08:00
Tomu Hirata
11228e946b add supported text field to anthropic citation response 2025-08-28 14:39:00 +09:00
Krish Dholakia
e638c5490d
Merge pull request #13945 from NoWall57/feature/force-anthropic-custom-api-base 
feat: Add support for custom Anthropic-compatible API endpoints
 2025-08-27 22:28:55 -07:00
Krish Dholakia
74c9663189
Merge pull request #12797 from ericgtkb/fix-vertex-ai-anyof 
Fix additional anyOf corner cases for Vertex AI Gemini tool calls - issue #11164
 2025-08-27 22:26:13 -07:00
Krish Dholakia
68f4847659
Merge pull request #12865 from aholmberg/holmberg/default-reasoning 
fix: make gemini and openai responses return reasoning by default
 2025-08-27 22:25:30 -07:00
Krish Dholakia
fc738c5822
Merge branch 'main' into holmberg/default-reasoning 2025-08-27 22:25:22 -07:00
Krish Dholakia
df39320889
Merge pull request #12885 from xywei/main 
Remove vector store methods from global scope
 2025-08-27 22:22:59 -07:00