ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
13,654 Commits 9 Branches 7 Tags 935 MiB
438f65666b
Commit Graph

13654 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Krrish Dholakia
438f65666b fix(utils.py): catch 422-status errors 2024-06-27 20:20:29 -07:00
Krrish Dholakia
82c6f31095 test(test_router.py): add testing 2024-06-27 20:20:29 -07:00
Krrish Dholakia
2e588c0685 fix(router.py): use user-defined model_input_tokens for pre-call filter checks 2024-06-27 20:20:29 -07:00
Krrish Dholakia
247d71db7a fix(utils.py): fix exception_mapping check for errors 
If exception already mapped - don't attach traceback to it
 2024-06-27 20:20:29 -07:00
Ishaan Jaff
6ac0f20099 docs - update telemetry 2024-06-27 20:20:29 -07:00
Ishaan Jaff
b2302bf224 fix ui login bug 2024-06-27 20:20:29 -07:00
7HR4IZ3
4e84147593 fix: Lunary integration 
Fixes the bug of litellm not logging system messages to lunary
 2024-06-27 20:20:29 -07:00
Krrish Dholakia
af21695f2b test: skip unstable tests 2024-06-27 20:20:29 -07:00
Krrish Dholakia
d2fe2b30a9 test(test_completion.py): handle replicate api error 2024-06-27 20:20:29 -07:00
Krrish Dholakia
b577f65798 test(test_proxy_server_langfuse.py): cleanup tests causing OOM issues. 2024-06-27 20:20:29 -07:00
Krrish Dholakia
c450dee681 fix(redact_messages.py): fix pr 2024-06-27 20:20:29 -07:00
Krrish Dholakia
3c92467ae8 fix(test_dynamic_rate_limit_handler.py): cleanup 2024-06-27 20:20:29 -07:00
Krrish Dholakia
2834a6395a fix(redact_messages.py): fix get 2024-06-27 20:20:29 -07:00
Krrish Dholakia
0971219470 docs(team_budgets.md): cleanup docs 2024-06-27 20:20:29 -07:00
Krrish Dholakia
544338bdf4 bump: version 1.40.24 → 1.40.25 2024-06-27 20:20:29 -07:00
Marc Abramowitz
379b834480 Document feature 2024-06-27 20:20:29 -07:00
Marc Abramowitz
d14138dbd9 Rename request header 2024-06-27 20:20:29 -07:00
Marc Abramowitz
efae9fa991 Turn on message logging via request header 2024-06-27 20:20:29 -07:00
Krrish Dholakia
7f54c90459 fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions 
Fixes https://github.com/BerriAI/litellm/issues/4338
 2024-06-27 20:20:29 -07:00
Krrish Dholakia
e20e8c2e74 fix(vertex_httpx.py): flush remaining chunks from stream 2024-06-27 20:20:18 -07:00
Krrish Dholakia
b23181779f fix(vertex_httpx.py): ignore vertex finish reason - wait for stream to end 
Fixes https://github.com/BerriAI/litellm/issues/4339
 2024-06-27 20:20:18 -07:00
Krrish Dholakia
f479cd549f fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback 
Exception maps azure content filter response exceptions
 2024-06-27 20:20:18 -07:00
Ishaan Jaff
e899359427 ci/cd add debugging for cache eviction 2024-06-25 08:14:09 -07:00
Ishaan Jaff
05fe43f495 fix default ttl for InMemoryCache 2024-06-24 21:21:38 -07:00
Ishaan Jaff
b900200c58 fix deps 2024-06-24 20:29:33 -07:00
Ishaan Jaff
60bd5cb6b1 fix config.yaml 2024-06-24 20:28:58 -07:00
Ishaan Jaff
fa57d2e823 feat use custom eviction policy 2024-06-24 20:28:03 -07:00
Ishaan Jaff
6091c7798e use cache tools as dep 2024-06-24 17:31:59 -07:00
Ishaan Jaff
d0b1d3e9cc fix python3.8 with cachetools 2024-06-24 17:30:48 -07:00
Ishaan Jaff
effc7579ac fix install on python 3.8 2024-06-24 17:27:14 -07:00
Ishaan Jaff
b13a93d9bc cleanup InMemoryCache 2024-06-24 17:24:59 -07:00
Ishaan Jaff
4053c7aeb3 use lru cache 2024-06-24 17:15:53 -07:00
Ishaan Jaff
2e3119e75f fix testing env 2024-06-24 17:12:11 -07:00
Ishaan Jaff
5bbbb5a7ee fix router.py 2024-06-24 17:10:34 -07:00
Ishaan Jaff
e5ab0d4ecd fix InMemoryCache 2024-06-24 17:08:30 -07:00
Ishaan Jaff
974d92ff45 fix use caching lib 2024-06-24 17:03:23 -07:00
Ishaan Jaff
8a66e074ce fix in mem cache tests 2024-06-22 19:52:18 -07:00
Ishaan Jaff
fbef5013a1
Merge branch 'main' into litellm_fix_in_mem_usage 2024-06-22 19:23:37 -07:00
Ishaan Jaff
0418db3044 fix caching clear in memory cache mem util 2024-06-22 19:21:37 -07:00
Krish Dholakia
eaad36a2cb
Merge pull request #4349 from BerriAI/litellm_dynamic_tpm_limits 
feat(dynamic_rate_limiter.py): Dynamic tpm quota (multiple projects)
 2024-06-22 19:15:05 -07:00
Krish Dholakia
961e7ac95d
Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Ishaan Jaff
fa554ae218 fix - clean up in memory cache 2024-06-22 18:46:30 -07:00
Ishaan Jaff
4fc8efd640 bump: version 1.40.23 → 1.40.24 2024-06-22 18:00:40 -07:00
Krrish Dholakia
c4b1540ce0 fix(utils.py): support streamingchoices in 'get_response_string 2024-06-22 15:45:52 -07:00
Krrish Dholakia
bae7377128 docs(team_budgets.md): fix script 
/
 2024-06-22 15:42:05 -07:00
Krrish Dholakia
fc4e900a23 docs(team_budgets.md): update docs with script for testing dynamic rate limiting 2024-06-22 15:26:58 -07:00
Krrish Dholakia
a31a05d45d feat(dynamic_rate_limiter.py): working e2e 2024-06-22 14:41:22 -07:00
Ishaan Jaff
cb828a464a fix langfuse tests in_memory_langfuse_clients 2024-06-22 13:59:36 -07:00
Ishaan Jaff
ebbe97910c
Merge pull request #4360 from BerriAI/litellm_fix_access_audio_endpoint 
fix[ - Can't access /v1/audio/speech with some user key
 2024-06-22 13:46:50 -07:00
Ishaan Jaff
ab38a90be0 fix /audio/speech 2024-06-22 13:45:34 -07:00