Commit Graph

6925 Commits

Author SHA1 Message Date
Krish Dholakia
f70bbc7b2e
Merge branch 'main' into litellm_vertex_ai_streaming_fix 2024-02-06 14:33:54 -08:00
Krish Dholakia
284a256ccf
Merge pull request #1856 from BerriAI/litellm_fix_proxy_health_readiness
fix(proxy_server.py): do a health check on db before returning if proxy ready (if db connected)
2024-02-06 14:32:15 -08:00
Krish Dholakia
4fe4d0c1f3
Merge branch 'main' into litellm_fix_proxy_health_readiness 2024-02-06 14:31:57 -08:00
Krrish Dholakia
191eef06de build(requirements.txt): fix dependency 2024-02-06 14:10:56 -08:00
ishaan-jaff
223cc88f0c (ci/cd) run again 2024-02-06 14:00:27 -08:00
ishaan-jaff
7f870ebced (feat) redis-semantic cache on proxy 2024-02-06 13:58:20 -08:00
ishaan-jaff
3fa5bba4ea (fix) add redisvl==0.0.7 2024-02-06 13:58:20 -08:00
Krrish Dholakia
c46aca7951 refactor(main.py): trigger deploy
n
2024-02-06 13:58:20 -08:00
ishaan-jaff
2b9a48eb6c (fix) redisvl requirements.txt issue 2024-02-06 13:58:20 -08:00
ishaan-jaff
3a5923cffa (fix) langfuse show semantic-similarity in tags 2024-02-06 13:58:20 -08:00
ishaan-jaff
8bce6d4fb2 (fix) dockerfile requirements.txt 2024-02-06 13:58:20 -08:00
ishaan-jaff
d9f407b4c2 (feat) show semantic-cache on health/readiness 2024-02-06 13:58:20 -08:00
ishaan-jaff
3d1d447db9 (feat) redis-semantic cache on proxy 2024-02-06 13:58:20 -08:00
ishaan-jaff
ff7d05aaef (fix) add redisvl==0.0.7 2024-02-06 13:58:20 -08:00
ishaan-jaff
d05984ef13 (feat) working semantic cache on proxy 2024-02-06 13:58:13 -08:00
Krrish Dholakia
d1549cb2f3 refactor(main.py): trigger deploy
n
2024-02-06 13:55:51 -08:00
ishaan-jaff
4233e2b850 (fix) redisvl requirements.txt issue 2024-02-06 13:52:32 -08:00
ishaan-jaff
a6afba8cf2 (fix) langfuse show semantic-similarity in tags 2024-02-06 13:41:22 -08:00
ishaan-jaff
f19b2becac (fix) dockerfile requirements.txt 2024-02-06 13:36:35 -08:00
ishaan-jaff
3d0ece828a (feat) show semantic-cache on health/readiness 2024-02-06 13:35:34 -08:00
Krrish Dholakia
8ed9573931 test(test_completion.py): fix test 2024-02-06 13:30:59 -08:00
ishaan-jaff
54a86b192d (ci/cd) run again 2024-02-06 13:30:59 -08:00
ishaan-jaff
4d9eb840f9 (fix) mark semantic caching as beta test 2024-02-06 13:30:59 -08:00
ishaan-jaff
d54428f1c5 (fix) semantic caching 2024-02-06 13:30:59 -08:00
ishaan-jaff
35a02dafdd (docs) litellm semantic caching 2024-02-06 13:30:59 -08:00
ishaan-jaff
4b798624dc (docs) redis cache 2024-02-06 13:30:59 -08:00
ishaan-jaff
f71f34e680 (fix) test-semantic caching 2024-02-06 13:30:59 -08:00
ishaan-jaff
4265c7affb (feat) redis-semantic cache on proxy 2024-02-06 13:30:59 -08:00
ishaan-jaff
698cee89fa (docs) using semantic caching on proxy 2024-02-06 13:30:59 -08:00
ishaan-jaff
76e479542e (fix) use semantic cache on proxy 2024-02-06 13:30:59 -08:00
ishaan-jaff
bf74359287 allow setting redis_semantic cache_embedding model 2024-02-06 13:30:59 -08:00
ishaan-jaff
666a553fca (feat) log semantic_sim to langfuse 2024-02-06 13:30:59 -08:00
ishaan-jaff
32fedf029c (fix) add redisvl==0.0.7 2024-02-06 13:30:59 -08:00
ishaan-jaff
e9d00a92ed (feat) working semantic cache on proxy 2024-02-06 13:30:59 -08:00
ishaan-jaff
ef32a5da1b (feat) redis-semantic cache 2024-02-06 13:30:55 -08:00
ishaan-jaff
0c488a7cc7 (feat) working semantic-cache on litellm proxy 2024-02-06 13:30:55 -08:00
ishaan-jaff
ca5f83d5fe (test) async semantic cache 2024-02-06 13:30:55 -08:00
ishaan-jaff
97fbfc07b4 (feat) RedisSemanticCache - async 2024-02-06 13:30:55 -08:00
ishaan-jaff
05d64acdd3 (fix) semantic cache 2024-02-06 13:30:55 -08:00
ishaan-jaff
5d6af6b7d6 (test) semantic caching 2024-02-06 13:30:55 -08:00
ishaan-jaff
b8a1cc4e42 (test) semantic cache 2024-02-06 13:30:55 -08:00
ishaan-jaff
bc22fda64e (feat) working - sync semantic caching 2024-02-06 13:30:55 -08:00
ishaan-jaff
fa1681fe7a (feat )add semantic cache 2024-02-06 13:30:55 -08:00
ishaan-jaff
e6e340cd46 (feat) show langfuse logging tags better through proxy 2024-02-06 13:30:55 -08:00
Krrish Dholakia
cde96b8ba0 test(test_completion.py): fix test 2024-02-06 13:30:31 -08:00
ishaan-jaff
667e006dbf (ci/cd) run again 2024-02-06 13:30:31 -08:00
ishaan-jaff
548d56ac42 (fix) mark semantic caching as beta test 2024-02-06 13:30:31 -08:00
ishaan-jaff
ca26ecc4dc (fix) semantic caching 2024-02-06 13:30:31 -08:00
ishaan-jaff
4d1b437d0a (docs) litellm semantic caching 2024-02-06 13:30:31 -08:00
ishaan-jaff
06ac218d9f (docs) redis cache 2024-02-06 13:30:31 -08:00