ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
34,378 Commits 9 Branches 7 Tags 935 MiB
dd183a7fcb
Commit Graph

34378 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Krish Dholakia
95f972ee9f
Merge pull request #4388 from BerriAI/litellm_custom_model_info 
Support custom model info for router logic (e.g. `max_input_tokens`)
 2024-06-24 19:31:37 -07:00
Krrish Dholakia
8e6e5a6d37 fix(vertex_httpx.py): Return empty model response for content filter violations 2024-06-24 19:22:20 -07:00
Krrish Dholakia
1ff0129a94 fix(vertex_httpx.py): cover gemini content violation (on prompt) 2024-06-24 19:13:56 -07:00
Ishaan Jaff
02ffed2545 feat - refactor /spend/calculate 2024-06-24 19:05:34 -07:00
Krrish Dholakia
a4bea47a2d fix(router.py): log rejected router requests to langfuse 
Fixes issue where rejected requests weren't being logged
 2024-06-24 17:52:01 -07:00
Ishaan Jaff
5309be2456 example config with public routes 2024-06-24 17:46:38 -07:00
Ishaan Jaff
2f90759db5 feat - allow user to define public routes 2024-06-24 17:45:13 -07:00
Ishaan Jaff
6091c7798e use cache tools as dep 2024-06-24 17:31:59 -07:00
Ishaan Jaff
d0b1d3e9cc fix python3.8 with cachetools 2024-06-24 17:30:48 -07:00
Krrish Dholakia
341c7857c1 test(test_router.py): add testing 2024-06-24 17:28:12 -07:00
Ishaan Jaff
effc7579ac fix install on python 3.8 2024-06-24 17:27:14 -07:00
Krrish Dholakia
f5fbdf0fee fix(router.py): use user-defined model_input_tokens for pre-call filter checks 2024-06-24 17:25:26 -07:00
Ishaan Jaff
b13a93d9bc cleanup InMemoryCache 2024-06-24 17:24:59 -07:00
Ishaan Jaff
4053c7aeb3 use lru cache 2024-06-24 17:15:53 -07:00
Ishaan Jaff
2e3119e75f fix testing env 2024-06-24 17:12:11 -07:00
Ishaan Jaff
5bbbb5a7ee fix router.py 2024-06-24 17:10:34 -07:00
Ishaan Jaff
e5ab0d4ecd fix InMemoryCache 2024-06-24 17:08:30 -07:00
Ishaan Jaff
974d92ff45 fix use caching lib 2024-06-24 17:03:23 -07:00
Krrish Dholakia
123477b55a fix(utils.py): fix exception_mapping check for errors 
If exception already mapped - don't attach traceback to it
 2024-06-24 16:55:19 -07:00
Krrish Dholakia
bab4a6c5df feat(internal_user_endpoints.py): expose /user/delete endpoint 2024-06-24 13:29:26 -07:00
Ishaan Jaff
70a605b3cc docs - update telemetry 2024-06-24 13:21:16 -07:00
Ishaan Jaff
dd048cf342
Merge pull request #4382 from BerriAI/litellm_ui_fix_login_bug 
[Fix] - Admin UI login bug
 2024-06-24 08:19:37 -07:00
Ishaan Jaff
bd160745f9
Merge pull request #4379 from 7HR4IZ3/main 
fix: Lunary integration
 2024-06-24 08:11:19 -07:00
Ishaan Jaff
acbcfef5af fix ui login bug 2024-06-24 07:54:08 -07:00
7HR4IZ3
515dc9acc7
fix: Lunary integration 
Fixes the bug of litellm not logging system messages to lunary
 2024-06-24 14:09:40 +01:00
Islam Nofl
e2af13550a
Rename ollama prompt 'Function' word to 'Name' 2024-06-24 08:01:15 +03:00
corrm
b8a8b0847c Added improved function name handling in ollama_async_streaming 2024-06-24 05:56:56 +03:00
corrm
423a60c8bc chore: Improved OllamaConfig get_required_params and ollama_acompletion and ollama_async_streaming functions 2024-06-24 05:55:22 +03:00
corrm
b2c1a3ad79 chore: Improved prompt generation in ollama_pt function 2024-06-24 05:54:58 +03:00
Brian Schultheiss
5a6588342c added test for change 2024-06-23 15:19:54 -07:00
Brian Schultheiss
3fbb25f903 Updated more references to AWS session token 2024-06-23 13:37:38 -07:00
Brian Schultheiss
7f91e53548 updated documentation to reference boto3.client credential extraction, and update boto3.client creation to support session_token. 2024-06-23 13:15:04 -07:00
Brian Schultheiss
8ad1ae73e5 Support aws_session_token for bedrock client. https://github.com/BerriAI/litellm/issues/4346 2024-06-23 12:51:25 -07:00
Krrish Dholakia
769c60e4f6 test: skip unstable tests 2024-06-23 00:30:45 -07:00
Krrish Dholakia
3d09a196a4 test(test_completion.py): handle replicate api error 2024-06-23 00:06:15 -07:00
Krrish Dholakia
9cff2b03f3 test(test_proxy_server_langfuse.py): cleanup tests causing OOM issues. 2024-06-22 23:53:18 -07:00
Krrish Dholakia
d857d82b0e fix(redact_messages.py): fix pr 2024-06-22 23:27:13 -07:00
Krrish Dholakia
9450d2cf77 fix(test_dynamic_rate_limit_handler.py): cleanup 2024-06-22 22:43:56 -07:00
Krrish Dholakia
dc43ffb771 fix(redact_messages.py): fix get 2024-06-22 21:57:54 -07:00
Krrish Dholakia
4d9a0d45b2 docs(team_budgets.md): cleanup docs 2024-06-22 21:38:01 -07:00
Krrish Dholakia
bf12536fdb bump: version 1.40.24 → 1.40.25 2024-06-22 21:34:55 -07:00
Krish Dholakia
9bffa9a48e
Merge pull request #4352 from msabramo/msabramo/turn-on-message-logging-via-request-header 
Disable message redaction in logs via request header
 2024-06-22 21:30:41 -07:00
Krish Dholakia
5e11702677
Merge pull request #4365 from BerriAI/litellm_azure_content_filter_fallbacks 
fix(router.py): Content Policy Fallbacks for Azure 'content_filter' responses
 2024-06-22 21:28:36 -07:00
Krish Dholakia
0454c0781a
Merge branch 'main' into litellm_azure_content_filter_fallbacks 2024-06-22 21:28:29 -07:00
Krrish Dholakia
cea630022e fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions 
Fixes https://github.com/BerriAI/litellm/issues/4338
 2024-06-22 21:26:15 -07:00
Krrish Dholakia
0fd9033502 fix(vertex_httpx.py): flush remaining chunks from stream 2024-06-22 20:33:54 -07:00
Krrish Dholakia
73254987da fix(vertex_httpx.py): ignore vertex finish reason - wait for stream to end 
Fixes https://github.com/BerriAI/litellm/issues/4339
 2024-06-22 20:21:01 -07:00
Ishaan Jaff
8a66e074ce fix in mem cache tests 2024-06-22 19:52:18 -07:00
Ishaan Jaff
fbef5013a1
Merge branch 'main' into litellm_fix_in_mem_usage 2024-06-22 19:23:37 -07:00
Ishaan Jaff
0418db3044 fix caching clear in memory cache mem util 2024-06-22 19:21:37 -07:00