Krrish Dholakia
|
0971219470
|
docs(team_budgets.md): cleanup docs
|
2024-06-27 20:20:29 -07:00 |
|
Krrish Dholakia
|
544338bdf4
|
bump: version 1.40.24 → 1.40.25
|
2024-06-27 20:20:29 -07:00 |
|
Marc Abramowitz
|
379b834480
|
Document feature
|
2024-06-27 20:20:29 -07:00 |
|
Marc Abramowitz
|
d14138dbd9
|
Rename request header
|
2024-06-27 20:20:29 -07:00 |
|
Marc Abramowitz
|
efae9fa991
|
Turn on message logging via request header
|
2024-06-27 20:20:29 -07:00 |
|
Krrish Dholakia
|
7f54c90459
|
fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
Fixes https://github.com/BerriAI/litellm/issues/4338
|
2024-06-27 20:20:29 -07:00 |
|
Krrish Dholakia
|
e20e8c2e74
|
fix(vertex_httpx.py): flush remaining chunks from stream
|
2024-06-27 20:20:18 -07:00 |
|
Krrish Dholakia
|
b23181779f
|
fix(vertex_httpx.py): ignore vertex finish reason - wait for stream to end
Fixes https://github.com/BerriAI/litellm/issues/4339
|
2024-06-27 20:20:18 -07:00 |
|
Krrish Dholakia
|
f479cd549f
|
fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback
Exception maps azure content filter response exceptions
|
2024-06-27 20:20:18 -07:00 |
|
Ishaan Jaff
|
e899359427
|
ci/cd add debugging for cache eviction
|
2024-06-25 08:14:09 -07:00 |
|
Ishaan Jaff
|
05fe43f495
|
fix default ttl for InMemoryCache
|
2024-06-24 21:21:38 -07:00 |
|
Ishaan Jaff
|
b900200c58
|
fix deps
|
2024-06-24 20:29:33 -07:00 |
|
Ishaan Jaff
|
60bd5cb6b1
|
fix config.yaml
|
2024-06-24 20:28:58 -07:00 |
|
Ishaan Jaff
|
fa57d2e823
|
feat use custom eviction policy
|
2024-06-24 20:28:03 -07:00 |
|
Ishaan Jaff
|
6091c7798e
|
use cache tools as dep
|
2024-06-24 17:31:59 -07:00 |
|
Ishaan Jaff
|
d0b1d3e9cc
|
fix python3.8 with cachetools
|
2024-06-24 17:30:48 -07:00 |
|
Ishaan Jaff
|
effc7579ac
|
fix install on python 3.8
|
2024-06-24 17:27:14 -07:00 |
|
Ishaan Jaff
|
b13a93d9bc
|
cleanup InMemoryCache
|
2024-06-24 17:24:59 -07:00 |
|
Ishaan Jaff
|
4053c7aeb3
|
use lru cache
|
2024-06-24 17:15:53 -07:00 |
|
Ishaan Jaff
|
2e3119e75f
|
fix testing env
|
2024-06-24 17:12:11 -07:00 |
|
Ishaan Jaff
|
5bbbb5a7ee
|
fix router.py
|
2024-06-24 17:10:34 -07:00 |
|
Ishaan Jaff
|
e5ab0d4ecd
|
fix InMemoryCache
|
2024-06-24 17:08:30 -07:00 |
|
Ishaan Jaff
|
974d92ff45
|
fix use caching lib
|
2024-06-24 17:03:23 -07:00 |
|
Ishaan Jaff
|
8a66e074ce
|
fix in mem cache tests
|
2024-06-22 19:52:18 -07:00 |
|
Ishaan Jaff
|
fbef5013a1
|
Merge branch 'main' into litellm_fix_in_mem_usage
|
2024-06-22 19:23:37 -07:00 |
|
Ishaan Jaff
|
0418db3044
|
fix caching clear in memory cache mem util
|
2024-06-22 19:21:37 -07:00 |
|
Krish Dholakia
|
eaad36a2cb
|
Merge pull request #4349 from BerriAI/litellm_dynamic_tpm_limits
feat(dynamic_rate_limiter.py): Dynamic tpm quota (multiple projects)
|
2024-06-22 19:15:05 -07:00 |
|
Krish Dholakia
|
961e7ac95d
|
Merge branch 'main' into litellm_dynamic_tpm_limits
|
2024-06-22 19:14:59 -07:00 |
|
Ishaan Jaff
|
fa554ae218
|
fix - clean up in memory cache
|
2024-06-22 18:46:30 -07:00 |
|
Ishaan Jaff
|
4fc8efd640
|
bump: version 1.40.23 → 1.40.24
|
2024-06-22 18:00:40 -07:00 |
|
Krrish Dholakia
|
c4b1540ce0
|
fix(utils.py): support streamingchoices in 'get_response_string
|
2024-06-22 15:45:52 -07:00 |
|
Krrish Dholakia
|
bae7377128
|
docs(team_budgets.md): fix script
/
|
2024-06-22 15:42:05 -07:00 |
|
Krrish Dholakia
|
fc4e900a23
|
docs(team_budgets.md): update docs with script for testing dynamic rate limiting
|
2024-06-22 15:26:58 -07:00 |
|
Krrish Dholakia
|
a31a05d45d
|
feat(dynamic_rate_limiter.py): working e2e
|
2024-06-22 14:41:22 -07:00 |
|
Ishaan Jaff
|
cb828a464a
|
fix langfuse tests in_memory_langfuse_clients
|
2024-06-22 13:59:36 -07:00 |
|
Ishaan Jaff
|
ebbe97910c
|
Merge pull request #4360 from BerriAI/litellm_fix_access_audio_endpoint
fix[ - Can't access /v1/audio/speech with some user key
|
2024-06-22 13:46:50 -07:00 |
|
Ishaan Jaff
|
ab38a90be0
|
fix /audio/speech
|
2024-06-22 13:45:34 -07:00 |
|
Ishaan Jaff
|
c44e5a3d93
|
testing - use in memory langfuse client cache
|
2024-06-22 13:40:34 -07:00 |
|
Ishaan Jaff
|
b201402b0b
|
fix testing - we had two files running the exact same langfuse test
|
2024-06-22 13:32:28 -07:00 |
|
Ishaan Jaff
|
c4f6b903b3
|
ui - new build
|
2024-06-22 09:13:34 -07:00 |
|
Ishaan Jaff
|
1a4ddf9a8e
|
Merge pull request #4356 from BerriAI/litellm_test_routes_on_proxy
[Test] Test routes on LiteLLM Proxy always includes OpenAI Routes
|
2024-06-22 09:12:30 -07:00 |
|
Ishaan Jaff
|
d32b8d589b
|
Merge pull request #4357 from BerriAI/litellm_use_jwt_in_cookies
[Security Fix - Proxy Server ADMIN UI] - Store credentials in cookies + use strong JWT signing secret
|
2024-06-22 09:12:17 -07:00 |
|
Krrish Dholakia
|
f814f24d9d
|
fix(litellm_logging.py): Fix gemini google ai studio system prompt logging
Fixes https://github.com/BerriAI/litellm/issues/2963
|
2024-06-22 09:11:23 -07:00 |
|
Ishaan Jaff
|
066ed01d0f
|
read token from cookie
|
2024-06-22 09:05:06 -07:00 |
|
Ishaan Jaff
|
c86efa55a5
|
use hash of master key encode the jwt
|
2024-06-22 08:58:31 -07:00 |
|
Ishaan Jaff
|
03d1d9229d
|
ui - use cookies to return JWTs
|
2024-06-22 08:50:26 -07:00 |
|
Ishaan Jaff
|
204f7725ee
|
ui - read jwts from cookie
|
2024-06-22 08:47:43 -07:00 |
|
Ishaan Jaff
|
b2a1cadf8c
|
test test_routes_on_litellm_proxy
|
2024-06-22 08:19:17 -07:00 |
|
Krrish Dholakia
|
709bd9678c
|
bump: version 1.40.22 → 1.40.23
|
2024-06-22 00:40:11 -07:00 |
|
Krrish Dholakia
|
532f24bfb7
|
refactor: instrument 'dynamic_rate_limiting' callback on proxy
|
2024-06-22 00:32:29 -07:00 |
|