CLARKBENHAM
|
4f95966475
|
tests showing error
|
2024-04-02 18:45:05 -07:00 |
|
CLARKBENHAM
|
6b0f3d3fd3
|
add routing strategy
|
2024-04-02 17:26:57 -07:00 |
|
CLARKBENHAM
|
2d7bafa12d
|
comments
|
2024-04-02 17:18:56 -07:00 |
|
CLARKBENHAM
|
75d029a91d
|
comments
|
2024-04-02 17:18:03 -07:00 |
|
CLARKBENHAM
|
f32d39aa93
|
check if in future None results are returned
|
2024-04-02 14:49:20 -07:00 |
|
CLARKBENHAM
|
a2bf891e48
|
test for rate limits
|
2024-04-02 13:49:13 -07:00 |
|
Ishaan Jaff
|
768cb6ec36
|
Merge pull request #2795 from BerriAI/ui_edit_keys
[UI] Edit Keys
|
2024-04-02 12:59:01 -07:00 |
|
Ishaan Jaff
|
407199a9e7
|
new ui build
|
2024-04-02 12:58:31 -07:00 |
|
Ishaan Jaff
|
ccfd7b5ab5
|
(ui) edit keys models / budgets
|
2024-04-02 12:53:22 -07:00 |
|
Krrish Dholakia
|
80f8645e1a
|
build(config.yml): pin boto3 version - circle ci
|
2024-04-02 12:39:31 -07:00 |
|
Krish Dholakia
|
63bff68846
|
Merge pull request #2791 from w3bdesign/patch-1
Delete node_modules directory
|
2024-04-02 12:35:07 -07:00 |
|
Daniel Fjeldstad
|
255dbdedff
|
Update .gitignore
Includes /node_modules
|
2024-04-02 21:31:57 +02:00 |
|
Ishaan Jaff
|
5eacee7cdd
|
ui populate edit screen
|
2024-04-02 09:57:26 -07:00 |
|
Krrish Dholakia
|
72abe200a9
|
fix(main.py): fix elif block
|
2024-04-02 09:47:49 -07:00 |
|
Ishaan Jaff
|
22799b8890
|
v0 pencil icon
|
2024-04-02 09:07:37 -07:00 |
|
Krish Dholakia
|
d95a1f3a28
|
Merge pull request #2790 from phact/patch-2
Fix max_tokens type in main.py
|
2024-04-02 09:02:34 -07:00 |
|
Krish Dholakia
|
7233e5ab25
|
Merge pull request #2789 from BerriAI/litellm_set_ttl
fix(proxy_server.py): allow user to set in-memory + redis ttl
|
2024-04-02 08:53:34 -07:00 |
|
Krish Dholakia
|
595fddca01
|
Merge pull request #2794 from turmind/main
Add sync iterator
|
2024-04-02 08:52:10 -07:00 |
|
Krrish Dholakia
|
4e03b35481
|
bump: version 1.34.20 → 1.34.21
|
2024-04-02 08:51:30 -07:00 |
|
Krrish Dholakia
|
2fc7aede12
|
refactor(main.py): trigger new build
|
2024-04-02 08:51:18 -07:00 |
|
Krrish Dholakia
|
0d949d71ab
|
fix(main.py): support text completion input being a list of strings
addresses - https://github.com/BerriAI/litellm/issues/2792, https://github.com/BerriAI/litellm/issues/2777
|
2024-04-02 08:50:16 -07:00 |
|
jdhuang
|
b6f98e408f
|
Add sync iterator
|
2024-04-02 20:14:37 +08:00 |
|
Daniel Fjeldstad
|
775a18c2cd
|
Delete node_modules directory
This folder should generally not be committed to Github
|
2024-04-02 08:46:27 +02:00 |
|
Sebastián Estévez
|
d3a86e7b7f
|
Fix max_tokens type in main.py
|
2024-04-02 00:28:08 -04:00 |
|
Ishaan Jaff
|
71db88115d
|
bump: version 1.34.19 → 1.34.20
|
2024-04-01 19:55:07 -07:00 |
|
Ishaan Jaff
|
91269257f2
|
(docs) openai wildcard models
|
2024-04-01 19:53:34 -07:00 |
|
Ishaan Jaff
|
92984a1c6f
|
Merge pull request #2788 from BerriAI/litellm_support_-_models
[Feat] Allow using model = * on proxy config.yaml
|
2024-04-01 19:46:50 -07:00 |
|
Ishaan Jaff
|
98df2b027b
|
test test_wildcard_openai_routing
|
2024-04-01 19:46:07 -07:00 |
|
Krrish Dholakia
|
6b35436c2a
|
bump: version 1.34.18 → 1.34.19
|
2024-04-01 19:17:25 -07:00 |
|
Krish Dholakia
|
da85384649
|
Merge pull request #2787 from BerriAI/litellm_optional_team_jwt_claim
fix(proxy_server.py): don't require scope for team-based jwt access
|
2024-04-01 19:16:39 -07:00 |
|
Krrish Dholakia
|
c096ba566f
|
fix(proxy_server.py): fix cache param arg name
|
2024-04-01 19:14:39 -07:00 |
|
Krrish Dholakia
|
203e2776f8
|
fix(proxy_server.py): allow user to set in-memory + redis ttl
addresses - https://github.com/BerriAI/litellm/issues/2700
|
2024-04-01 19:13:23 -07:00 |
|
Ishaan Jaff
|
037b624c89
|
(fix) allow wildcard models
|
2024-04-01 19:07:05 -07:00 |
|
Ishaan Jaff
|
aabd7eff1f
|
feat router allow * models
|
2024-04-01 19:00:24 -07:00 |
|
Krrish Dholakia
|
c52819d47c
|
fix(proxy_server.py): don't require scope for team-based jwt access
If team with the client_id exists then it should be allowed to make a request, if it doesn't then as we discussed it should return an error
|
2024-04-01 18:52:00 -07:00 |
|
Ishaan Jaff
|
b14b6083f5
|
Merge pull request #2785 from BerriAI/litellm_high_traffic_redis_caching_fixes
[Feat] Proxy - high traffic redis caching - when using `url`
|
2024-04-01 18:38:27 -07:00 |
|
Krrish Dholakia
|
ceabf726b0
|
fix(main.py): support max retries for transcription calls
|
2024-04-01 18:37:53 -07:00 |
|
Krrish Dholakia
|
c3e4af76cf
|
refactor: fix linting issue
|
2024-04-01 18:11:38 -07:00 |
|
Krrish Dholakia
|
ca54b62656
|
refactor(main.py): trigger new build
|
2024-04-01 18:03:46 -07:00 |
|
Krrish Dholakia
|
6467dd4e11
|
fix(tpm_rpm_limiter.py): fix cache init logic
|
2024-04-01 18:01:38 -07:00 |
|
Ishaan Jaff
|
4ebb4570be
|
(fix) handle urls correctly
|
2024-04-01 17:08:48 -07:00 |
|
Ishaan Jaff
|
916e4032ee
|
redis show client_list, info
|
2024-04-01 16:54:42 -07:00 |
|
Ishaan Jaff
|
9accc544e9
|
add /cache/redis/info endpoint
|
2024-04-01 16:51:23 -07:00 |
|
Krrish Dholakia
|
9c0aecf9b8
|
fix(proxy/utils.py): support redis caching for alerting
|
2024-04-01 16:13:59 -07:00 |
|
Krrish Dholakia
|
cdae08f3c3
|
docs(openai.md): fix docs to include example of calling openai on proxy
|
2024-04-01 12:09:22 -07:00 |
|
Krish Dholakia
|
d3e61a0adc
|
Merge pull request #2783 from BerriAI/litellm_context_window_Fallback_fix
fix(router.py): fix check for context window fallbacks
|
2024-04-01 11:55:49 -07:00 |
|
Krrish Dholakia
|
a917fadf45
|
docs(routing.md): refactor docs to show how to use pre-call checks and fallback across model groups
|
2024-04-01 11:21:27 -07:00 |
|
Ishaan Jaff
|
d5d800e141
|
(fix) _update_end_user_cache
|
2024-04-01 11:18:00 -07:00 |
|
Krrish Dholakia
|
52b1538b2e
|
fix(router.py): support context window fallbacks for pre-call checks
|
2024-04-01 10:51:54 -07:00 |
|
Krrish Dholakia
|
f46a9d09a5
|
fix(router.py): fix check for context window fallbacks
fallback if list is not none
|
2024-04-01 10:41:12 -07:00 |
|