ishaan-jaff
|
f0e632ebc8
|
(ci/cd) run again
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
d2a44de4c9
|
(fix) mark semantic caching as beta test
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
ba4ca4d02a
|
(fix) semantic caching
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
bf6e3f807b
|
(docs) litellm semantic caching
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
f244e56893
|
(docs) redis cache
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
9f7ec4c9f9
|
(fix) test-semantic caching
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
755f44613d
|
(feat) redis-semantic cache on proxy
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
c1e9041506
|
(docs) using semantic caching on proxy
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
e74363b480
|
(fix) use semantic cache on proxy
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
48fa97125d
|
allow setting redis_semantic cache_embedding model
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
80af1c9a58
|
(feat) log semantic_sim to langfuse
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
6edf675e41
|
(fix) add redisvl==0.0.7
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
2881e7b111
|
(feat) working semantic cache on proxy
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
5f2877e699
|
(feat) redis-semantic cache
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
f1dea5571a
|
(feat) working semantic-cache on litellm proxy
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
8a75cbd3ad
|
(test) async semantic cache
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
f66b6f5cd7
|
(feat) RedisSemanticCache - async
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
58c4a29fbc
|
(fix) semantic cache
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
28676b2e0b
|
(test) semantic caching
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
5d345b5b57
|
(test) semantic cache
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
8436c0489c
|
(feat) working - sync semantic caching
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
6a5e96ac1b
|
(feat )add semantic cache
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
dc9cb13e10
|
(feat) show langfuse logging tags better through proxy
|
2024-02-06 13:31:58 -08:00 |
|
Krrish Dholakia
|
0bd2734520
|
bump: version 1.22.8 → 1.22.9
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
420d2754d7
|
fix(utils.py): round max tokens to be int always
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
bc6d29f879
|
(ci/cd) run again
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
1bcd2eafd2
|
(ci/cd) run again
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
86c84d72e5
|
(ci/cd) fix test_config_no_auth
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
0f6a9242ec
|
(fix) test_normal_router_tpm_limit
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
f8491feebd
|
(fix) parallel_request_limiter debug
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
43cb836c4f
|
(ci/cd) run again
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
a1883a1161
|
(ci/cd) run pytest without -s
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
b1b5daf73d
|
(fix) proxy_startup test
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
ec5b812989
|
(fix) rename proxy startup test
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
249482b3f7
|
(ci/cd) run in verbose mode
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
bf35619b96
|
bump: version 1.22.7 → 1.22.8
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
4d76af89f3
|
fix(ollama.py): support format for ollama
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
7b5543b993
|
build(requirements.txt): update the proxy requirements.txt
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
26d0f895ff
|
bump: version 1.22.6 → 1.22.7
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
f9b5e9ea62
|
fix(ollama_chat.py): explicitly state if ollama call is streaming or not
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
34fcb3c984
|
fix(utils.py): use print_verbose for statements, so debug can be seen when running sdk
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
3409ac7690
|
fix(ollama_chat.py): fix ollama chat completion token counting
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
f2070d025e
|
(fix) test_normal_router_tpm_limit
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
6ea17be098
|
(ci/cd) print debug info for test_proxy_gunicorn_startup_config_dict
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
a24041b624
|
(fix) proxy startup test
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
1ef8b459ce
|
(feat) proxy - upperbound params /key/generate
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
2ce4153ace
|
(test) test_upperbound_key_params
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
0871327ff0
|
(feat) upperbound_key_generate_params
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
d09aa560f3
|
(docs) upperbound_key_generate_params
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
f8380c638f
|
fix(langfuse.py): support logging failed llm api calls to langfuse
|
2024-02-06 13:17:57 -08:00 |
|