Commit Graph

9280 Commits

Author SHA1 Message Date
Krrish Dholakia
3810b050c1 fix(proxy_server.py): increment cached global proxy spend object 2024-03-29 20:02:31 -07:00
Krrish Dholakia
5280fc809f fix(proxy_server.py): enforce end user budgets with 'litellm.max_end_user_budget' param 2024-03-29 17:14:40 -07:00
Krrish Dholakia
786116783f fix(proxy_server.py): fix max budget check to also fire slack alert 2024-03-29 16:24:40 -07:00
Krrish Dholakia
be6481bb36 fix(proxy_server.py): fix checks 2024-03-29 15:34:13 -07:00
Krrish Dholakia
d8c15a5677 fix(auth_checks.py): make global spend checks more accurate 2024-03-29 14:57:44 -07:00
Krrish Dholakia
bbd94f504c test(test_rules.py): fix assert 2024-03-29 13:12:16 -07:00
Krish Dholakia
b6cf3321f7
Merge pull request #2640 from mnicstruwig/fix/fix-xml-function-args-parsing
Fix XML function calling args parsing.
2024-03-29 10:11:52 -07:00
Ishaan Jaff
6233351b01 (ui) show users spend report 2024-03-29 09:29:51 -07:00
Ishaan Jaff
f72cbdbffe (ui) teams models 2024-03-29 09:29:51 -07:00
Ishaan Jaff
971ba05bc1 (ui) show budget, models etc 2024-03-29 09:29:51 -07:00
Krrish Dholakia
15dfb6a076 build(config.yml): pin boto3 dep 2024-03-29 09:27:25 -07:00
Krrish Dholakia
63271846c2 refactor(main.py): trigger new build 2024-03-29 09:24:47 -07:00
Krrish Dholakia
bef07eaf09 build(circle_ci/requirements.txt): remove unpinned boto3 dep 2024-03-29 09:22:32 -07:00
Krrish Dholakia
41fb76740e fix(utils.py): exception mapping on 'next()' streaming error 2024-03-29 09:18:41 -07:00
Krrish Dholakia
109cd93a39 fix(sagemaker.py): support model_id consistently. support dynamic args for async calls 2024-03-29 09:05:00 -07:00
Krrish Dholakia
d547944556 fix(sagemaker.py): support 'model_id' param for sagemaker
allow passing inference component param to sagemaker in the same format as we handle this for bedrock
2024-03-29 08:43:17 -07:00
Krrish Dholakia
90c007fc69 bump: version 1.34.12 → 1.34.13 2024-03-29 07:56:57 -07:00
Krrish Dholakia
cd53291b62 fix(utils.py): support bedrock mistral streaming 2024-03-29 07:56:10 -07:00
Krrish Dholakia
cdb940d504 docs(prod.md): update prod docs with batch writing info 2024-03-28 23:42:43 -07:00
Ishaan Jaff
c9fecc11ed (fix) neatly show models on table 2024-03-28 23:27:23 -07:00
Ishaan Jaff
1d9f02fa9b (ui) adjust size 2024-03-28 23:27:23 -07:00
Ishaan Jaff
e78e0c7400 (ui) re-order 2024-03-28 23:27:23 -07:00
Ishaan Jaff
e9e9c3d1b5 (fix) clean up view user spend 2024-03-28 23:27:23 -07:00
Krrish Dholakia
618cb2441a fix(proxy_server.py): handle pydantic json versioning issue 2024-03-28 23:23:50 -07:00
Krrish Dholakia
5e55df1eaf fix(proxy_server.py): fix pydantic versioning issue 2024-03-28 22:42:26 -07:00
Krish Dholakia
753ad601fa
Update ghcr_deploy.yml 2024-03-28 22:38:11 -07:00
Krrish Dholakia
c395357b59 bump: version 1.34.11 → 1.34.12 2024-03-28 22:18:44 -07:00
Krish Dholakia
a1a2fb4223
Merge pull request #2741 from BerriAI/litellm_jwt_auth_fixes_3
fix(proxy_server.py): fix tpm/rpm limiting for jwt auth
2024-03-28 22:16:31 -07:00
Krrish Dholakia
5a117490ec fix(proxy_server.py): fix tpm/rpm limiting for jwt auth
fixes tpm/rpm limiting for jwt auth and implements unit tests for jwt auth
2024-03-28 21:19:34 -07:00
Ishaan Jaff
036d9c3cad
Merge pull request #2740 from BerriAI/litellm_ui_fixes
(ui) new build
2024-03-28 21:03:15 -07:00
Ishaan Jaff
bd207fe228 (ui) new build 2024-03-28 21:00:46 -07:00
Ishaan Jaff
d33b099de0
Merge pull request #2739 from BerriAI/litellm_ui_fixes
(fix) ui - clean up username display
2024-03-28 20:39:58 -07:00
Ishaan Jaff
94efa2d8dc (new ui build) 2024-03-28 20:38:30 -07:00
Ishaan Jaff
9dde7abf4c (ui) show team models on ui 2024-03-28 20:36:32 -07:00
Ishaan Jaff
69ae445e65 (ui) add form validaton 2024-03-28 20:31:38 -07:00
Krrish Dholakia
c15ba368e7 fix(proxy_server.py): enable spend tracking for team-based jwt auth 2024-03-28 20:16:22 -07:00
Ishaan Jaff
e03a59a0d8 (feat) new ui build 2024-03-28 19:57:25 -07:00
Ishaan Jaff
c7c10ca85e (fix) ui - clean up username 2024-03-28 19:54:11 -07:00
Ishaan Jaff
792999d756
Merge pull request #2738 from BerriAI/litellm_ui_cleanup
[Admin UI] Use consistent spacing, show mandatory fields
2024-03-28 19:08:56 -07:00
Ishaan Jaff
1a4583fa54 (new ui build) 2024-03-28 19:08:16 -07:00
Krrish Dholakia
85a5291142 docs(prod.md): doc improvements 2024-03-28 19:04:24 -07:00
Ishaan Jaff
060a2f9fda (feat) make key/team name required on UI 2024-03-28 18:57:44 -07:00
Krrish Dholakia
da7a00d6d2 docs(prod.md): fix docker run commands 2024-03-28 18:51:53 -07:00
Ishaan Jaff
440d0a0a4b (fix) ui alignment 2024-03-28 18:50:32 -07:00
Krrish Dholakia
7c44b32cc2 refactor(proxy/utils.py): add more debug logs 2024-03-28 18:44:35 -07:00
Ishaan Jaff
d071d90522 (fix) ui clean up items 2024-03-28 18:42:56 -07:00
Krrish Dholakia
eb318afe52 docs(prod.md): cleanup doc 2024-03-28 18:34:09 -07:00
Krish Dholakia
359ca003ad
Update Dockerfile 2024-03-28 16:40:36 -07:00
Krish Dholakia
b159e6d7f1
Update Dockerfile 2024-03-28 16:36:51 -07:00
Krish Dholakia
f40c37161b
Update ghcr_deploy.yml 2024-03-28 16:34:46 -07:00