Commit Graph

10335 Commits

Author SHA1 Message Date
Ishaan Jaff
a71d4fc172 (ui) hide default team for non admins 2024-04-20 15:55:18 -07:00
Ishaan Jaff
31e600c4fe (ui) - simplify user flow 2024-04-20 15:50:01 -07:00
Krrish Dholakia
c5d880b6fd docs(routing.md): add simple shuffle async support to docs 2024-04-20 15:02:22 -07:00
Krrish Dholakia
b96741e4f4 fix(router.py): async simple-shuffle support 2024-04-20 15:01:12 -07:00
Ishaan Jaff
a909af3fc0 (ci/cd) fix test_master_key_hashing 2024-04-20 14:50:34 -07:00
Krish Dholakia
fcde3ba213
Merge pull request #3192 from BerriAI/litellm_calculate_max_parallel_requests
fix(router.py): Make TPM limits concurrency-safe
2024-04-20 13:24:29 -07:00
Ishaan Jaff
6e2de63e7d
Merge pull request #3196 from BerriAI/litellm_fix_slack_alerting_embedding
fix - slack alerting show `input` for embedding requests
2024-04-20 13:22:36 -07:00
Ishaan Jaff
ddc71d766a fix - slack alerting show input in the api_base 2024-04-20 13:16:47 -07:00
Krish Dholakia
9f91f9919f
Merge pull request #3115 from elisalimli/litellm_fix/missing-spaces-between-prompts-cohere-chat
Fix new line issue in cohere_message_pt
2024-04-20 13:15:20 -07:00
Krish Dholakia
3faada32d5
Merge pull request #3118 from n1lanjan/2833-anthropic-tool-call-fix
Fix tool call errors using anthropic
2024-04-20 13:14:29 -07:00
Krrish Dholakia
c96ca1f85e fix(router.py): improve debug logsd 2024-04-20 13:12:12 -07:00
Krish Dholakia
a9828b1e13
Merge pull request #3150 from ushuz/anthropic-vertex-adc
Load google ADC before init AnthropicVertex
2024-04-20 13:00:10 -07:00
Krrish Dholakia
0f69f0b44e test(test_router_max_parallel_requests.py): more extensive testing for setting max parallel requests 2024-04-20 12:56:54 -07:00
Ishaan Jaff
f89f8a4157
Merge pull request #3184 from BerriAI/litellm_ui_non_admins_flow
[UI] - non admin flow - only Create + Test Key available
2024-04-20 12:40:43 -07:00
Krrish Dholakia
7aa737cf10 fix(router.py): add if router caching setup on info logs 2024-04-20 12:34:09 -07:00
Ishaan Jaff
7b24a74e77 test fix - test_key_delete_ui 2024-04-20 12:30:58 -07:00
Krrish Dholakia
e56dc2817b test(test_router_max_parallel_requests.py): add unit tests for different scenarios 2024-04-20 12:29:38 -07:00
Ishaan Jaff
0dc7f02b51
Merge pull request #3193 from BerriAI/litellm_sec_fix_delete_files
[Fix] - `/audio/transcriptions` security fix
2024-04-20 12:26:02 -07:00
Krrish Dholakia
26579303e0 fix(main.py): ignore max_parallel_requests as a litellm param 2024-04-20 12:15:04 -07:00
Krrish Dholakia
1507b23e30 test(test_openai_endpoints.py): make test stricter 2024-04-20 12:11:54 -07:00
Ishaan Jaff
07a10247db fix - security fix 2024-04-20 12:10:08 -07:00
Krrish Dholakia
47e9d5f2ec fix(router.py): fix init line for self.default_max_parallel_requests 2024-04-20 12:08:21 -07:00
Ishaan Jaff
5d39865362 fix - audio_transcriptions security fix 2024-04-20 11:58:15 -07:00
Krish Dholakia
78579d4a24
Merge pull request #3170 from rick-github/ollama-special-symbol
Disable special tokens in ollama completion when counting tokens
2024-04-20 11:57:01 -07:00
Krish Dholakia
8a2f8c0418
Merge pull request #3189 from merefield/main
FIX: ollama chat completion proxy internal server 500
2024-04-20 11:56:34 -07:00
Krish Dholakia
b5316fe90d
Merge pull request #3191 from BerriAI/litellm_redis_ssl_kwarg_fix
fix(_redis.py): support redis ssl as a kwarg `REDIS_SSL`
2024-04-20 11:56:23 -07:00
Ishaan Jaff
fd282ea932 fix testing fixes 2024-04-20 11:48:41 -07:00
Ishaan Jaff
a34f725db7 fix - test keys 2024-04-20 11:43:43 -07:00
Krrish Dholakia
33d828a0ed fix(utils.py): map vertex ai exceptions - rate limit error 2024-04-20 11:12:05 -07:00
Ishaan Jaff
7ebf2ca4d9 (ci/cd) testing with team_id and /user/new 2024-04-20 11:09:34 -07:00
Krrish Dholakia
4c78f8f309 fix(router.py): calculate max_parallel_requests from given tpm limits
use the azure formula to calculate rpm -> max_parallel_requests based on a deployment's tpm limits
2024-04-20 10:43:18 -07:00
Krrish Dholakia
d1217b955a fix(_redis.py): support redis ssl as a kwarg REDIS_SSL 2024-04-20 10:19:44 -07:00
Krish Dholakia
e52e4cc1a9
Update README.md 2024-04-20 09:48:49 -07:00
Krrish Dholakia
0ce2fb83b0 docs(hosted.md): add hosted proxy pricing info to docs 2024-04-20 09:40:47 -07:00
Krrish Dholakia
3ce73fce23 docs(hosted.md): add hosted proxy info to docs 2024-04-20 09:30:28 -07:00
Krrish Dholakia
5d8af892c7 build(interpret_load_test.py): fix update release body text 2024-04-20 08:54:00 -07:00
Krrish Dholakia
8963a507f7 docs(quick_start.md): add disclaimer 2024-04-20 08:49:14 -07:00
Krrish Dholakia
2afdf34a9f docs(quick_start.md): add example of using proxy with litellm sdk 2024-04-20 08:49:14 -07:00
Ishaan Jaff
200f58c1e7 (fix) missing PIL import 2024-04-20 08:27:00 -07:00
merefield
50a917a096 FIX: use value not param name when mapping frequency_penalty 2024-04-20 09:25:35 +01:00
Krrish Dholakia
ad05cce8b7 docs(prod.md): update prod docs with new redis recommendations 2024-04-19 23:57:36 -07:00
Ishaan Jaff
afeb1941ce bump: version 1.35.16 → 1.35.17 2024-04-19 21:24:28 -07:00
Ishaan Jaff
96200cbb11
Merge pull request #3186 from BerriAI/litellm_fix_gemini_pro_latest_bug
[Fix] completion(model="gemini/gemini-pro-1.5-latest" raises Exception
2024-04-19 21:23:11 -07:00
Ishaan Jaff
81e4d59357 test - gemini-1.5-pro-latest 2024-04-19 21:22:19 -07:00
Ishaan Jaff
63805873e7 fix - supports_vision should not raise Exception 2024-04-19 21:19:07 -07:00
Ishaan Jaff
abeadadf3e fix - create key user flow 2024-04-19 21:15:57 -07:00
Krrish Dholakia
fa14d3c8dc test: remove duplicate test file 2024-04-19 19:56:36 -07:00
Krrish Dholakia
5811d21094 test(test_amazing_vertex_completion.py): fix gemini tool calling test 2024-04-19 19:39:38 -07:00
Krrish Dholakia
e5b98814ad test(test_proxy_server.py): fix test to use valid redis host 2024-04-19 19:22:24 -07:00
Ishaan Jaff
00a07a99cd fix - backend logic for non admin flow 2024-04-19 17:36:29 -07:00