Commit Graph

9352 Commits

Author SHA1 Message Date
Krrish Dholakia
f5d920e314 refactor(main.py): trigger new build 2024-03-30 21:41:14 -07:00
Krrish Dholakia
60f89faf1c test: cleanup 2024-03-30 21:40:43 -07:00
Krrish Dholakia
3b8e7241b4 fix(proxy/utils.py): uncomment max parallel request limit check 2024-03-30 20:51:59 -07:00
Krrish Dholakia
364526d0bc test: fix test 2024-03-30 20:22:48 -07:00
Krrish Dholakia
5926792de6 fix(caching.py): respect redis namespace for all redis get/set requests 2024-03-30 20:20:29 -07:00
Krrish Dholakia
d9ff13b624 fix(utils.py): set redis_usage_cache to none by default 2024-03-30 20:10:56 -07:00
Krrish Dholakia
f58fefd589 fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams
allows tpm/rpm checks to work across instances

https://github.com/BerriAI/litellm/issues/2730
2024-03-30 20:01:36 -07:00
Krrish Dholakia
0342cd3b6b fix(proxy_server.py): support azure openai text completion calls 2024-03-30 11:30:06 -07:00
Krish Dholakia
2ca303ec0e
Merge pull request #2748 from BerriAI/litellm_anthropic_tool_calling_list_parsing_fix
fix(factory.py): parse list in xml tool calling response (anthropic)
2024-03-30 11:27:02 -07:00
Krrish Dholakia
ff9de34a5d bump: version 1.34.16 → 1.34.17 2024-03-30 09:04:57 -07:00
Krrish Dholakia
c0204310ee fix(main.py): fix translation to text_completions format for async text completion calls 2024-03-30 09:02:51 -07:00
Krrish Dholakia
89471ba4c5 build(model_prices_and_context_window.json): add proper bedrock mixtral model name 2024-03-30 08:37:06 -07:00
Krrish Dholakia
22d5603778 ci(config.yml): add lunary to circle ci 2024-03-29 22:09:21 -07:00
Krrish Dholakia
4826018756 docs(users.md): fix doc for end-user param 2024-03-29 21:54:07 -07:00
Krrish Dholakia
e74a15be19 bump: version 1.34.15 → 1.34.16 2024-03-29 21:48:31 -07:00
Krrish Dholakia
af2eabba91 fix(proxy_server.py): fix /key/update endpoint to update key duration
also adds a test for this to our ci/cd
2024-03-29 21:47:10 -07:00
Krrish Dholakia
68a1fa36cf fix(handle_jwt.py): fix linting issue 2024-03-29 21:35:36 -07:00
Krish Dholakia
dfd20cb155
Merge pull request #2244 from lunary-ai/main
[Feat] Update integration with Lunary
2024-03-29 21:32:01 -07:00
Vincelwt
1b84dfac91
Merge branch 'main' into main 2024-03-30 13:21:53 +09:00
Krrish Dholakia
97616ee267 bump: version 1.34.14 → 1.34.15 2024-03-29 21:16:01 -07:00
Krish Dholakia
6d9887969f
Merge pull request #2757 from BerriAI/litellm_fix_budget_alerts
fix(auth_checks.py): make global spend checks more accurate
2024-03-29 21:13:27 -07:00
Krish Dholakia
f44df7bed6
Merge pull request #2762 from jacobnguyenn/update-jwt-auth
fix: still verify kid on single pub key fetched
2024-03-29 21:08:22 -07:00
Krrish Dholakia
cbf35087c7 test(test_key_generate_prisma.py): fix test 2024-03-29 20:30:43 -07:00
Krrish Dholakia
48ac36e70d docs(proxy_server.py): fix example on swagger for team member delete 2024-03-29 20:09:54 -07:00
phuongnd96
4bf4be3a0f
fix: still verify kid on single pub key fetched 2024-03-30 10:09:38 +07:00
Krrish Dholakia
3810b050c1 fix(proxy_server.py): increment cached global proxy spend object 2024-03-29 20:02:31 -07:00
Krrish Dholakia
5280fc809f fix(proxy_server.py): enforce end user budgets with 'litellm.max_end_user_budget' param 2024-03-29 17:14:40 -07:00
Ishaan Jaff
141396a214
Merge pull request #2760 from BerriAI/litellm_team_add_all_models
[UI] team, key add `all_models`
2024-03-29 16:45:02 -07:00
Ishaan Jaff
062239feb5 (ui) new build 2024-03-29 16:38:18 -07:00
Ishaan Jaff
ba56e988f5 (ui) add all_models 2024-03-29 16:36:02 -07:00
Ishaan Jaff
30a4f224ee (feat) team add all models available 2024-03-29 16:28:36 -07:00
Krrish Dholakia
786116783f fix(proxy_server.py): fix max budget check to also fire slack alert 2024-03-29 16:24:40 -07:00
Ishaan Jaff
e8ead49d29
Merge pull request #2628 from BerriAI/dependabot/npm_and_yarn/docs/my-website/webpack-dev-middleware-5.3.4
build(deps): bump webpack-dev-middleware from 5.3.3 to 5.3.4 in /docs/my-website
2024-03-29 16:12:29 -07:00
Ishaan Jaff
2974e0da31
Merge pull request #2689 from BerriAI/dependabot/npm_and_yarn/docs/my-website/express-4.19.2
build(deps): bump express from 4.18.2 to 4.19.2 in /docs/my-website
2024-03-29 16:12:17 -07:00
Ishaan Jaff
cea999229a
Merge pull request #2759 from BerriAI/litellm_team_delete
[UI] /team/delete
2024-03-29 16:09:48 -07:00
Ishaan Jaff
733d36e275 (ui new build) 2024-03-29 16:09:29 -07:00
Ishaan Jaff
fb5bc5aac0 (ui) team delete 2024-03-29 16:06:47 -07:00
Ishaan Jaff
cdb06d7ef0 (ui) /team/delete call 2024-03-29 15:53:28 -07:00
Krrish Dholakia
be6481bb36 fix(proxy_server.py): fix checks 2024-03-29 15:34:13 -07:00
Ishaan Jaff
aa50963674 bump: version 1.34.13 → 1.34.14 2024-03-29 15:19:10 -07:00
Ishaan Jaff
0ac7512821 (feat) new ui build 2024-03-29 15:16:59 -07:00
Krrish Dholakia
d8c15a5677 fix(auth_checks.py): make global spend checks more accurate 2024-03-29 14:57:44 -07:00
Ishaan Jaff
6b08be4c8e
Update README.MD 2024-03-29 14:56:41 -07:00
Ishaan Jaff
a951738849
Update README.MD 2024-03-29 14:56:04 -07:00
Ishaan Jaff
e40a86d37a
Merge pull request #2752 from BerriAI/litellm_grafana_metrics
[Fix + Docs] grafana / prometheus metrics
2024-03-29 14:38:45 -07:00
Ishaan Jaff
a78ed81cd9 (docs) grafana metrics 2024-03-29 14:38:37 -07:00
Ishaan Jaff
24570bc075 (docs) grafana / prometheus 2024-03-29 14:25:45 -07:00
Ishaan Jaff
c2283235a1 (docs) /metrics endpoint 2024-03-29 13:36:24 -07:00
Ishaan Jaff
15fe00678a
Merge pull request #2751 from BerriAI/docs_cleanup
Docs cleanup
2024-03-29 13:13:20 -07:00
Krrish Dholakia
bbd94f504c test(test_rules.py): fix assert 2024-03-29 13:12:16 -07:00