Commit Graph

11316 Commits

Author SHA1 Message Date
Krrish Dholakia
944833b04a build(requirements.txt): update the proxy requirements.txt 2024-02-06 15:17:35 -08:00
Krrish Dholakia
7b286f38ce bump: version 1.22.6 → 1.22.7 2024-02-06 15:17:35 -08:00
Krrish Dholakia
80eb8d0eae fix(ollama_chat.py): explicitly state if ollama call is streaming or not 2024-02-06 15:17:35 -08:00
Krrish Dholakia
3db9830d4b fix(utils.py): use print_verbose for statements, so debug can be seen when running sdk 2024-02-06 15:17:35 -08:00
Krrish Dholakia
d189e95045 fix(ollama_chat.py): fix ollama chat completion token counting 2024-02-06 15:17:35 -08:00
ishaan-jaff
3b977679f8 (fix) test_normal_router_tpm_limit 2024-02-06 15:17:35 -08:00
ishaan-jaff
7ccb7c00d8 (ci/cd) print debug info for test_proxy_gunicorn_startup_config_dict 2024-02-06 15:17:35 -08:00
ishaan-jaff
ca029d13ee (fix) proxy startup test 2024-02-06 15:17:35 -08:00
ishaan-jaff
732ac6df49 (feat) proxy - upperbound params /key/generate 2024-02-06 15:17:35 -08:00
ishaan-jaff
e21f906463 (test) test_upperbound_key_params 2024-02-06 15:17:35 -08:00
ishaan-jaff
8d0c235004 (feat) upperbound_key_generate_params 2024-02-06 15:17:35 -08:00
ishaan-jaff
0996ea3f36 (docs) upperbound_key_generate_params 2024-02-06 15:17:35 -08:00
Krrish Dholakia
f363f0f5ba fix(langfuse.py): support logging failed llm api calls to langfuse 2024-02-06 15:17:35 -08:00
John HU
f48c92e817 Fix admin UI title and description 2024-02-06 15:17:35 -08:00
Krish Dholakia
2dab09cde1 Update model_prices_and_context_window.json 2024-02-06 15:17:35 -08:00
ishaan-jaff
4e3f048967 (feat) max_user_budget 2024-02-06 15:16:20 -08:00
ishaan-jaff
047b2f9b1a (Feat) support max_user_budget 2024-02-06 15:13:59 -08:00
Krrish Dholakia
0609968853 test(test_key_generate_dynamodb.py): fix test 2024-02-06 14:36:24 -08:00
Krish Dholakia
e36566a212
Merge branch 'main' into litellm_admin_ui_view_all_keys 2024-02-06 14:34:57 -08:00
Krish Dholakia
db68b837e2
Merge pull request #1847 from BerriAI/litellm_vertex_ai_streaming_fix
fix(utils.py): return finish reason for last vertex ai chunk
2024-02-06 14:34:09 -08:00
Krish Dholakia
f70bbc7b2e
Merge branch 'main' into litellm_vertex_ai_streaming_fix 2024-02-06 14:33:54 -08:00
Krish Dholakia
284a256ccf
Merge pull request #1856 from BerriAI/litellm_fix_proxy_health_readiness
fix(proxy_server.py): do a health check on db before returning if proxy ready (if db connected)
2024-02-06 14:32:15 -08:00
Krish Dholakia
4fe4d0c1f3
Merge branch 'main' into litellm_fix_proxy_health_readiness 2024-02-06 14:31:57 -08:00
Krrish Dholakia
191eef06de build(requirements.txt): fix dependency 2024-02-06 14:10:56 -08:00
ishaan-jaff
223cc88f0c (ci/cd) run again 2024-02-06 14:00:27 -08:00
ishaan-jaff
7f870ebced (feat) redis-semantic cache on proxy 2024-02-06 13:58:20 -08:00
ishaan-jaff
3fa5bba4ea (fix) add redisvl==0.0.7 2024-02-06 13:58:20 -08:00
Krrish Dholakia
c46aca7951 refactor(main.py): trigger deploy
n
2024-02-06 13:58:20 -08:00
ishaan-jaff
2b9a48eb6c (fix) redisvl requirements.txt issue 2024-02-06 13:58:20 -08:00
ishaan-jaff
3a5923cffa (fix) langfuse show semantic-similarity in tags 2024-02-06 13:58:20 -08:00
ishaan-jaff
8bce6d4fb2 (fix) dockerfile requirements.txt 2024-02-06 13:58:20 -08:00
ishaan-jaff
d9f407b4c2 (feat) show semantic-cache on health/readiness 2024-02-06 13:58:20 -08:00
ishaan-jaff
3d1d447db9 (feat) redis-semantic cache on proxy 2024-02-06 13:58:20 -08:00
ishaan-jaff
ff7d05aaef (fix) add redisvl==0.0.7 2024-02-06 13:58:20 -08:00
ishaan-jaff
d05984ef13 (feat) working semantic cache on proxy 2024-02-06 13:58:13 -08:00
Krrish Dholakia
d1549cb2f3 refactor(main.py): trigger deploy
n
2024-02-06 13:55:51 -08:00
ishaan-jaff
4233e2b850 (fix) redisvl requirements.txt issue 2024-02-06 13:52:32 -08:00
ishaan-jaff
a6afba8cf2 (fix) langfuse show semantic-similarity in tags 2024-02-06 13:41:22 -08:00
ishaan-jaff
f19b2becac (fix) dockerfile requirements.txt 2024-02-06 13:36:35 -08:00
ishaan-jaff
3d0ece828a (feat) show semantic-cache on health/readiness 2024-02-06 13:35:34 -08:00
Krrish Dholakia
f0d4b62b6b test(test_completion.py): fix test 2024-02-06 13:32:03 -08:00
ishaan-jaff
f0e632ebc8 (ci/cd) run again 2024-02-06 13:32:03 -08:00
ishaan-jaff
d2a44de4c9 (fix) mark semantic caching as beta test 2024-02-06 13:32:03 -08:00
ishaan-jaff
ba4ca4d02a (fix) semantic caching 2024-02-06 13:32:03 -08:00
ishaan-jaff
bf6e3f807b (docs) litellm semantic caching 2024-02-06 13:32:03 -08:00
ishaan-jaff
f244e56893 (docs) redis cache 2024-02-06 13:32:03 -08:00
ishaan-jaff
9f7ec4c9f9 (fix) test-semantic caching 2024-02-06 13:32:03 -08:00
ishaan-jaff
755f44613d (feat) redis-semantic cache on proxy 2024-02-06 13:32:03 -08:00
ishaan-jaff
c1e9041506 (docs) using semantic caching on proxy 2024-02-06 13:32:03 -08:00
ishaan-jaff
e74363b480 (fix) use semantic cache on proxy 2024-02-06 13:32:03 -08:00