Commit Graph

9712 Commits

Author SHA1 Message Date
Krrish Dholakia
5f910c1811 test(test_streaming.py): fix vertex project name 2024-04-06 18:45:17 -07:00
Krrish Dholakia
6f94f3d127 fix(router.py): improve pre-call check -> get model group cache one-time 2024-04-06 18:24:51 -07:00
Ishaan Jaff
4512510d37 Revert "fix test streaming"
This reverts commit f10aba1007.
2024-04-06 18:24:00 -07:00
Ishaan Jaff
f10aba1007 fix test streaming 2024-04-06 18:23:10 -07:00
Ishaan Jaff
187774ef5c bump: version 1.34.31 → 1.34.32 2024-04-06 18:20:23 -07:00
Krrish Dholakia
7ae6432f94 fix(router.py): check usage based routing cache in pre-call check
allows pre-call rpm check to work across instances
2024-04-06 18:19:02 -07:00
Krrish Dholakia
a6f987e065 test(test_amazing_vertex_completion.py): fix project name 2024-04-06 17:59:49 -07:00
Krrish Dholakia
205ac1496a fix(router.py): store in-memory deployment request count for 60s only 2024-04-06 17:53:39 -07:00
Krrish Dholakia
0d1cca9aa0 fix(router.py): make router async calls coroutine safe
uses pre-call checks to check if a call is below it's rpm limit, works even if multiple async calls are
made simultaneously
2024-04-06 17:31:26 -07:00
Krish Dholakia
a101591f74
Update README.md 2024-04-06 16:11:33 -07:00
Ishaan Jaff
f09e6ba98d
Merge pull request #2878 from BerriAI/litellm_azure_gpt_instruct
re-use Azure OpenAI client for azure text completions
2024-04-06 13:35:39 -07:00
Ishaan Jaff
a6bc673ffa feat - re-use OpenAI client for azure text 2024-04-06 12:23:58 -07:00
Ishaan Jaff
a2c63075ef
Merge pull request #2877 from BerriAI/litellm_fix_text_completion
[Feat] Text-Completion-OpenAI - Re-use OpenAI Client
2024-04-06 12:15:52 -07:00
Krrish Dholakia
b49e47b634 ci(vertex_key.json): switch gcloud accounts 2024-04-06 12:14:46 -07:00
Ishaan Jaff
c2f978fd5a (docs) use text completion with litellm proxy 2024-04-06 12:07:20 -07:00
Ishaan Jaff
3b622556be test - setting org for openai text completion 2024-04-06 11:53:26 -07:00
Ishaan Jaff
a55f3cdace test - router re-use openai client 2024-04-06 11:33:17 -07:00
Ishaan Jaff
01fef1a9f8 feat - re-use openai client for text completion 2024-04-06 11:28:25 -07:00
Ishaan Jaff
ad7302cdc8 feat - re-use openai client for text completion 2024-04-06 11:25:33 -07:00
Krish Dholakia
5c2af90ac0
Merge pull request #2844 from nicovank/main
[integrations/langfuse] Use packaging over deprecated pkg_resources
2024-04-06 10:58:07 -07:00
Krrish Dholakia
e424a294a5 build(model_prices_and_context_window.json): add pricing for bedrock mistral paris region 2024-04-06 09:23:09 -07:00
Krrish Dholakia
90e03399fa bump: version 1.34.30 → 1.34.31 2024-04-06 09:07:11 -07:00
Krrish Dholakia
6f1377481e bump: version 1.34.29 → 1.34.30 2024-04-06 09:07:06 -07:00
Krrish Dholakia
ef9e29d575 refactor(main.py): trigger new build 2024-04-06 09:06:53 -07:00
Krrish Dholakia
7b30e5ae38 fix(utils.py): fix content check in pre-call rules 2024-04-06 09:03:19 -07:00
Krish Dholakia
9119858f4a
Merge pull request #2798 from CLARKBENHAM/main
add test for rate limits - Router isn't coroutine safe
2024-04-06 08:47:40 -07:00
Krish Dholakia
7495222a8b
Merge pull request #2855 from Caixiaopig/fix_update_default_claude3_maxtokens
Updating the default Anthropic Officlal Claude 3 max_tokens to 4096
2024-04-06 08:39:55 -07:00
Krrish Dholakia
afa2e2eba9 docs(anthropic.md): update anthropic docs to show 'tool' param usage 2024-04-06 08:35:43 -07:00
Krrish Dholakia
30f57e7aa5 fix(utils.py): move info statement to debug 2024-04-05 22:06:46 -07:00
Krrish Dholakia
dce96478c7 docs(vertex.md): add claude 3 on vertex ai to docs 2024-04-05 21:48:42 -07:00
Ishaan Jaff
3d298fc549 (test) completion 2024-04-05 21:03:04 -07:00
Ishaan Jaff
83580dc00a (ci/cd) run again 2024-04-05 20:44:51 -07:00
Ishaan Jaff
122dff007b fix gemini test 2024-04-05 20:38:28 -07:00
Krish Dholakia
1790869739
Merge pull request #2870 from BerriAI/litellm_ui_fixes
feat(prisma.schema): UI improvements for tracking spend for users
2024-04-05 18:42:41 -07:00
Krrish Dholakia
cff2a8324e build(ui): fix pagination tab 2024-04-05 18:19:30 -07:00
Ishaan Jaff
17abd7e20d
Merge pull request #2871 from BerriAI/litellm_stable_releases
CI/CD deploy stable releases
2024-04-05 17:36:10 -07:00
Krrish Dholakia
e8675e6394 build(ui): on success model create message 2024-04-05 17:29:54 -07:00
Ishaan Jaff
bb1fd29d51 bump: version 1.34.28 → 1.34.29 2024-04-05 17:26:19 -07:00
Ishaan Jaff
7fc416b636 (ci/cd) run again 2024-04-05 17:26:02 -07:00
Krrish Dholakia
5197c2294a build(ui): fix required field error on model create ui
don’t console log api key
2024-04-05 17:25:36 -07:00
Ishaan Jaff
6f6c2d2648 fix - deploy release with a commit hash 2024-04-05 17:21:42 -07:00
Ishaan Jaff
7fdb4e356a fix use stable releases 2024-04-05 17:09:55 -07:00
Krrish Dholakia
11186d6ab4 build(schema.prisma): add user alias to prisma schema 2024-04-05 17:06:30 -07:00
Krrish Dholakia
5d1a813b66 feat(prisma.schema): allow setting user_alias 2024-04-05 17:04:14 -07:00
Ishaan Jaff
cba0db9cb4 stable releases use commit hash 2024-04-05 17:03:38 -07:00
Ishaan Jaff
212ca40f29
Merge pull request #2869 from BerriAI/litellm_build_images_to_specific_commit
[CI/CD] Use specific commit hash on docker builds
2024-04-05 16:39:21 -07:00
Ishaan Jaff
c224adcb27 fix use correct commit hash when creating releases 2024-04-05 16:38:08 -07:00
Ishaan Jaff
ac1e8d36e4 fix remove extra line - __init__ 2024-04-05 16:32:00 -07:00
Ishaan Jaff
f204857043 circle ci - pass commit hash for new docker builds 2024-04-05 16:30:50 -07:00
Ishaan Jaff
fe24c4b329 ci/cd - use commit hash when building 2024-04-05 16:25:55 -07:00