Krrish Dholakia
|
52b1538b2e
|
fix(router.py): support context window fallbacks for pre-call checks
|
2024-04-01 10:51:54 -07:00 |
|
Krrish Dholakia
|
f46a9d09a5
|
fix(router.py): fix check for context window fallbacks
fallback if list is not none
|
2024-04-01 10:41:12 -07:00 |
|
Krrish Dholakia
|
c9e6b05cfb
|
test(test_max_tpm_rpm_limiter.py): add unit testing for redis namespaces working for tpm/rpm limits
|
2024-04-01 10:39:03 -07:00 |
|
Ishaan Jaff
|
f58436d6a0
|
Merge pull request #2782 from phact/patch-1
support cohere_chat in get_api_key
|
2024-04-01 10:33:43 -07:00 |
|
Sebastián Estévez
|
e50e76bbd5
|
support cohere_chat in get_api_key
|
2024-04-01 13:24:03 -04:00 |
|
Ishaan Jaff
|
53d7b95364
|
(fix) load testing key used
|
2024-04-01 08:28:19 -07:00 |
|
Ishaan Jaff
|
bbfd850e12
|
Merge pull request #2774 from BerriAI/litellm_async_perf
(fix) improve async perf by 100ms
|
2024-04-01 08:12:34 -07:00 |
|
Krrish Dholakia
|
f3e47323b9
|
test(test_max_tpm_rpm_limiter.py): unit tests for key + team based tpm rpm limits on proxy
|
2024-04-01 08:11:30 -07:00 |
|
Krrish Dholakia
|
19fc120081
|
fix(proxy/utils.py): uncomment max parallel request limit check
|
2024-04-01 08:11:30 -07:00 |
|
Krrish Dholakia
|
1bb4f3ad6d
|
fix(utils.py): set redis_usage_cache to none by default
|
2024-04-01 08:11:30 -07:00 |
|
Krrish Dholakia
|
2dd5f2bc8c
|
fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams
allows tpm/rpm checks to work across instances
https://github.com/BerriAI/litellm/issues/2730
|
2024-04-01 08:11:30 -07:00 |
|
Krrish Dholakia
|
383f12bbd3
|
test(test_max_tpm_rpm_limiter.py): unit tests for key + team based tpm rpm limits on proxy
|
2024-04-01 08:00:01 -07:00 |
|
Ishaan Jaff
|
ddb35facc0
|
ci/cd run again
|
2024-04-01 07:40:05 -07:00 |
|
DaxServer
|
3f25049dc8
|
fix(docs): Correct Docker pull command in deploy.md
Corrected the Docker pull command in deploy.md to remove duplicated 'docker pull' command.
|
2024-04-01 07:29:56 -07:00 |
|
DaxServer
|
a2c7455c3d
|
docs: Update references to Ollama repository url
Updated references to the Ollama repository URL from https://github.com/jmorganca/ollama to https://github.com/ollama/ollama.
|
2024-04-01 07:29:56 -07:00 |
|
Krrish Dholakia
|
ea2356fd95
|
bump: version 1.34.17 → 1.34.18
|
2024-04-01 07:29:56 -07:00 |
|
Krrish Dholakia
|
5800a5095a
|
refactor(main.py): trigger new build
|
2024-04-01 07:29:56 -07:00 |
|
Krrish Dholakia
|
a1365f6035
|
test: cleanup
|
2024-04-01 07:29:56 -07:00 |
|
Krrish Dholakia
|
d4dd6d0cdc
|
fix(proxy/utils.py): uncomment max parallel request limit check
|
2024-04-01 07:29:56 -07:00 |
|
Krrish Dholakia
|
aebb0e489c
|
test: fix test
|
2024-04-01 07:29:56 -07:00 |
|
Krrish Dholakia
|
17cabf013c
|
fix(caching.py): respect redis namespace for all redis get/set requests
|
2024-04-01 07:29:56 -07:00 |
|
Krrish Dholakia
|
583e334bd2
|
fix(utils.py): set redis_usage_cache to none by default
|
2024-04-01 07:29:56 -07:00 |
|
Krrish Dholakia
|
0c77f75ce9
|
fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams
allows tpm/rpm checks to work across instances
https://github.com/BerriAI/litellm/issues/2730
|
2024-04-01 07:29:56 -07:00 |
|
Krrish Dholakia
|
ea76c546ff
|
docs(deploy.md): fix docs for litlelm-database docker run example
|
2024-04-01 07:29:56 -07:00 |
|
Ishaan Jaff
|
15b5cb1612
|
(fix) check size of data to predict
|
2024-04-01 07:29:56 -07:00 |
|
Ishaan Jaff
|
e62e83c42a
|
(ui) dont let prediction block spend view
|
2024-04-01 07:29:56 -07:00 |
|
Ishaan Jaff
|
18fec3ad8e
|
Merge pull request #2779 from DaxServer/update-proxy-dockerfile-branch
fix(docs): Correct Docker pull command in deploy.md
|
2024-04-01 07:10:45 -07:00 |
|
Ishaan Jaff
|
7e24461ae9
|
Merge pull request #2778 from DaxServer/main-1
docs: Update references to Ollama repository url
|
2024-04-01 07:10:23 -07:00 |
|
Emir Ayar
|
c0336d3f40
|
add a third condition: list of text-content dictionaries
|
2024-03-31 22:43:30 +02:00 |
|
DaxServer
|
28f6caa04c
|
fix(docs): Correct Docker pull command in deploy.md
Corrected the Docker pull command in deploy.md to remove duplicated 'docker pull' command.
|
2024-03-31 20:10:00 +02:00 |
|
DaxServer
|
61b6f8be44
|
docs: Update references to Ollama repository url
Updated references to the Ollama repository URL from https://github.com/jmorganca/ollama to https://github.com/ollama/ollama.
|
2024-03-31 19:35:37 +02:00 |
|
Krrish Dholakia
|
006ea0abe0
|
bump: version 1.34.17 → 1.34.18
|
2024-03-30 22:10:21 -07:00 |
|
Krish Dholakia
|
1356f6cd32
|
Merge pull request #2775 from BerriAI/litellm_redis_user_api_key_cache_v3
fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams
|
2024-03-30 22:07:05 -07:00 |
|
Krrish Dholakia
|
f5d920e314
|
refactor(main.py): trigger new build
|
2024-03-30 21:41:14 -07:00 |
|
Krrish Dholakia
|
60f89faf1c
|
test: cleanup
|
2024-03-30 21:40:43 -07:00 |
|
Krrish Dholakia
|
3b8e7241b4
|
fix(proxy/utils.py): uncomment max parallel request limit check
|
2024-03-30 20:51:59 -07:00 |
|
Krrish Dholakia
|
364526d0bc
|
test: fix test
|
2024-03-30 20:22:48 -07:00 |
|
Krrish Dholakia
|
5926792de6
|
fix(caching.py): respect redis namespace for all redis get/set requests
|
2024-03-30 20:20:29 -07:00 |
|
Krrish Dholakia
|
d9ff13b624
|
fix(utils.py): set redis_usage_cache to none by default
|
2024-03-30 20:10:56 -07:00 |
|
Krrish Dholakia
|
a7aa6fae64
|
docs(deploy.md): fix docs for litlelm-database docker run example
|
2024-03-30 20:08:27 -07:00 |
|
Krrish Dholakia
|
f58fefd589
|
fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams
allows tpm/rpm checks to work across instances
https://github.com/BerriAI/litellm/issues/2730
|
2024-03-30 20:01:36 -07:00 |
|
Ishaan Jaff
|
c365de122a
|
check num retries in async wrapper
|
2024-03-30 19:33:40 -07:00 |
|
Ishaan Jaff
|
8ee3975901
|
Merge pull request #2770 from BerriAI/ui_dont_let_failed_prediction_block_spend_view
(ui) dont let failed prediction block spend view
|
2024-03-30 19:10:29 -07:00 |
|
Ishaan Jaff
|
bd95626579
|
(fix) improve async perf
|
2024-03-30 19:07:04 -07:00 |
|
Ishaan Jaff
|
cdd6e79e6c
|
Revert "bump: version 1.34.17 → 1.34.18"
This reverts commit 7e0e6bf092.
|
2024-03-30 18:41:29 -07:00 |
|
Ishaan Jaff
|
7e0e6bf092
|
bump: version 1.34.17 → 1.34.18
|
2024-03-30 14:42:11 -07:00 |
|
Ishaan Jaff
|
480774fd75
|
Merge pull request #2772 from BerriAI/ui_view_team_name_usage
[UI] view team name in usage
|
2024-03-30 14:40:37 -07:00 |
|
Ishaan Jaff
|
22a22197c7
|
(ui) new ui build
|
2024-03-30 14:38:19 -07:00 |
|
Ishaan Jaff
|
24ca4e310c
|
(ui) show team based usage
|
2024-03-30 14:20:08 -07:00 |
|
Ishaan Jaff
|
23a18d4be3
|
(ui) show proxy spend
|
2024-03-30 14:02:43 -07:00 |
|