ishaan-jaff
|
48fa97125d
|
allow setting redis_semantic cache_embedding model
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
80af1c9a58
|
(feat) log semantic_sim to langfuse
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
6edf675e41
|
(fix) add redisvl==0.0.7
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
2881e7b111
|
(feat) working semantic cache on proxy
|
2024-02-06 13:32:03 -08:00 |
|
ishaan-jaff
|
5f2877e699
|
(feat) redis-semantic cache
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
f1dea5571a
|
(feat) working semantic-cache on litellm proxy
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
8a75cbd3ad
|
(test) async semantic cache
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
f66b6f5cd7
|
(feat) RedisSemanticCache - async
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
58c4a29fbc
|
(fix) semantic cache
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
28676b2e0b
|
(test) semantic caching
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
5d345b5b57
|
(test) semantic cache
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
8436c0489c
|
(feat) working - sync semantic caching
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
6a5e96ac1b
|
(feat )add semantic cache
|
2024-02-06 13:31:58 -08:00 |
|
ishaan-jaff
|
dc9cb13e10
|
(feat) show langfuse logging tags better through proxy
|
2024-02-06 13:31:58 -08:00 |
|
Krrish Dholakia
|
0bd2734520
|
bump: version 1.22.8 → 1.22.9
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
420d2754d7
|
fix(utils.py): round max tokens to be int always
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
bc6d29f879
|
(ci/cd) run again
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
1bcd2eafd2
|
(ci/cd) run again
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
86c84d72e5
|
(ci/cd) fix test_config_no_auth
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
0f6a9242ec
|
(fix) test_normal_router_tpm_limit
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
f8491feebd
|
(fix) parallel_request_limiter debug
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
43cb836c4f
|
(ci/cd) run again
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
a1883a1161
|
(ci/cd) run pytest without -s
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
b1b5daf73d
|
(fix) proxy_startup test
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
ec5b812989
|
(fix) rename proxy startup test
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
249482b3f7
|
(ci/cd) run in verbose mode
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
bf35619b96
|
bump: version 1.22.7 → 1.22.8
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
4d76af89f3
|
fix(ollama.py): support format for ollama
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
7b5543b993
|
build(requirements.txt): update the proxy requirements.txt
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
26d0f895ff
|
bump: version 1.22.6 → 1.22.7
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
f9b5e9ea62
|
fix(ollama_chat.py): explicitly state if ollama call is streaming or not
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
34fcb3c984
|
fix(utils.py): use print_verbose for statements, so debug can be seen when running sdk
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
3409ac7690
|
fix(ollama_chat.py): fix ollama chat completion token counting
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
f2070d025e
|
(fix) test_normal_router_tpm_limit
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
6ea17be098
|
(ci/cd) print debug info for test_proxy_gunicorn_startup_config_dict
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
a24041b624
|
(fix) proxy startup test
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
1ef8b459ce
|
(feat) proxy - upperbound params /key/generate
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
2ce4153ace
|
(test) test_upperbound_key_params
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
0871327ff0
|
(feat) upperbound_key_generate_params
|
2024-02-06 13:17:57 -08:00 |
|
ishaan-jaff
|
d09aa560f3
|
(docs) upperbound_key_generate_params
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
f8380c638f
|
fix(langfuse.py): support logging failed llm api calls to langfuse
|
2024-02-06 13:17:57 -08:00 |
|
John HU
|
ada14b06e0
|
Fix admin UI title and description
|
2024-02-06 13:17:57 -08:00 |
|
Krish Dholakia
|
7aa4075b05
|
Update model_prices_and_context_window.json
|
2024-02-06 13:17:57 -08:00 |
|
Krrish Dholakia
|
a9a4f4cf0f
|
test(test_key_generate_dynamodb.py): fix test
|
2024-02-05 21:43:17 -08:00 |
|
Krrish Dholakia
|
f2a7e2ee98
|
feat(ui): enable admin to view all valid keys created on the proxy
|
2024-02-05 19:28:57 -08:00 |
|
Krrish Dholakia
|
cdbbedec36
|
bump: version 1.22.5 → 1.22.6
|
2024-02-05 16:26:30 -08:00 |
|
Krrish Dholakia
|
3b9ada07e0
|
fix(main.py): raise better error message for health check models without mode
|
2024-02-05 16:26:25 -08:00 |
|
ishaan-jaff
|
1f7c8e86a7
|
(fix) make sure route is str
|
2024-02-05 16:22:36 -08:00 |
|
Ishaan Jaff
|
5ebb1b4447
|
Merge pull request #1836 from BerriAI/litellm_fix_litellm_dashboard_keys
[Fix] UI - Security - Litellm UI Keys meant for litellm-dashboard shouldn't be allowed to make non-management related requests
|
2024-02-05 16:20:33 -08:00 |
|
ishaan-jaff
|
2b588a8786
|
(test) litellm-dashboard never allowed to /chat/completions
|
2024-02-05 16:11:33 -08:00 |
|