Commit Graph

16368 Commits

Author SHA1 Message Date
Paul Gauthier
6a32b05bb1 vertex_ai/claude-3-5-sonnet@20240620 support prefill 2024-08-14 10:14:19 -07:00
Ishaan Jaff
98ea24aab0
Merge pull request #5202 from BerriAI/litellm_prom_prefix_litellm
[Fix] Prometheus use 'litellm_' prefix for new deployment metrics
2024-08-14 09:50:36 -07:00
Ishaan Jaff
38b6196413
Merge pull request #5200 from BerriAI/litellm_gcs_failure_callback
[Feat-Proxy] Add failure logging for GCS bucket
2024-08-14 09:50:29 -07:00
Ishaan Jaff
69f6952597
Merge pull request #5186 from BerriAI/litellm_prisma_issues
[Fix-Proxy] Fix prisma non-root user issues
2024-08-14 09:29:57 -07:00
Ishaan Jaff
47afbfcbaa allow running as non-root user 2024-08-14 09:26:47 -07:00
Ishaan Jaff
6f06da7d46 fix use normal prisma 2024-08-14 09:24:22 -07:00
Ishaan Jaff
acadabe6c9 use litellm_ prefix for new deployment metrics 2024-08-14 09:08:14 -07:00
Krrish Dholakia
4cef6df4cf docs(sidebar.js): cleanup docs 2024-08-14 09:04:52 -07:00
Ishaan Jaff
326d797111 log failure calls on gcs + testing 2024-08-14 08:55:51 -07:00
Ishaan Jaff
bb877f6ead fix test for gcs bucket 2024-08-14 08:40:02 -07:00
Ishaan Jaff
63af2942ab feat log fail events on gcs 2024-08-14 08:39:16 -07:00
Krish Dholakia
5b46c88eb6
Merge pull request #5199 from zby/calendar_example
Mismatch in example fixed
2024-08-14 08:37:07 -07:00
Krish Dholakia
a6bf763dd9
Merge pull request #5116 from thiswillbeyourgithub/fix_ollama_argument_order
fix: wrong order of arguments for ollama
2024-08-14 08:36:14 -07:00
Zbigniew Łukasiak
963c921c5a
Mismatch in example fixed 2024-08-14 15:07:10 +02:00
Ishaan Jaff
e0978378c1 return detailed error message on check_valid_ip 2024-08-13 21:29:21 -07:00
Ishaan Jaff
05725b8341 bump: version 1.43.9 → 1.43.10 2024-08-13 21:20:11 -07:00
Ishaan Jaff
4d2cedfdb6
Merge pull request #5191 from BerriAI/litellm_load_config_from_s3
[Feat] Allow loading LiteLLM config from s3 buckets
2024-08-13 21:19:16 -07:00
Ishaan Jaff
09535b25f4 fix use s3 get_credentials to get boto3 creds 2024-08-13 21:18:06 -07:00
Krish Dholakia
c8f4cd373d
Merge pull request #5189 from ArtyomZemlyak/patch-1
Fix not sended json_data_for_triton
2024-08-13 20:44:26 -07:00
Krrish Dholakia
c1279ed809 fix(bedrock_httpx.py): fix error code for not found provider/model combo to be 404 2024-08-13 20:36:12 -07:00
Krish Dholakia
d6125ca257
Merge pull request #5190 from Manouchehri/chatgpt-4o-latest-pricing
(models): Add chatgpt-4o-latest
2024-08-13 20:34:54 -07:00
Ishaan Jaff
a37f087b62 fix ci/cd pipeline 2024-08-13 20:33:33 -07:00
Ishaan Jaff
86818ddffc comment on using boto3 2024-08-13 20:28:40 -07:00
Ishaan Jaff
6f7b204294 docs - set litellm config as s3 object 2024-08-13 20:26:29 -07:00
Ishaan Jaff
4e7b0ce76e feat read config from s3 2024-08-13 20:18:59 -07:00
Ishaan Jaff
1475ae59f3 add helper to load config from s3 2024-08-13 20:16:54 -07:00
David Manouchehri
9617e578f3
(models): Add chatgpt-4o-latest. 2024-08-14 03:03:22 +00:00
Artem Zemliak
5290490106
Fix not sended json_data_for_triton 2024-08-14 09:57:48 +07:00
Ishaan Jaff
fef6f50e23 fic docker file to run in non root model 2024-08-13 19:29:40 -07:00
Krrish Dholakia
66d77f177f fix(bedrock_httpx.py): raise bad request error if invalid bedrock model given 2024-08-13 19:27:06 -07:00
Ishaan Jaff
353b470cbc fix prisma issues 2024-08-13 19:17:01 -07:00
Ishaan Jaff
b8e5b25dcc
Merge pull request #5184 from fozziethebeat/fix-vllm-docs
Improving the proxy docs for configuring with vllm
2024-08-13 18:47:01 -07:00
Ishaan Jaff
c7804e1ea2 ui new build 2024-08-13 18:45:09 -07:00
Ishaan Jaff
2de276cb44 temp set prisma pems 2024-08-13 18:40:00 -07:00
Ishaan Jaff
ab7758840b skip prisma gen step 2024-08-13 18:38:10 -07:00
Ishaan Jaff
4159897570
Merge pull request #5187 from BerriAI/litellm_handle_session_expired_ui
[Feat-UI] - Handle session expired on UI
2024-08-13 17:15:23 -07:00
Ishaan Jaff
d85762b32f ui - handle session expired on ui 2024-08-13 17:09:56 -07:00
Ishaan Jaff
2c0f4c9865 fix make prisma readable 2024-08-13 16:57:19 -07:00
Krrish Dholakia
cdce13434e fix(teams.tsx): add team_id to team table on ui 2024-08-13 16:08:49 -07:00
Keith Stevens
17c6a4e532 Improving the proxy docs for configuring with vllm 2024-08-13 16:07:41 -07:00
Ishaan Jaff
063fb380e1
Merge pull request #5181 from BerriAI/litellm_check_x_fwded_for
[Feat-Proxy Security] Allow Using `x-forwarded-for` for enforcing + tracking  ip address
2024-08-13 16:07:31 -07:00
Ishaan Jaff
d0e6ca659f add test for test_check_valid_ip_sent_with_x_forwarded_for 2024-08-13 15:54:53 -07:00
Ishaan Jaff
b94c982ec9 use _check_valid_ip 2024-08-13 15:41:01 -07:00
Ishaan Jaff
0c6c350c23 feat log use_x_forwarded_for 2024-08-13 15:22:54 -07:00
Krrish Dholakia
a9a3282031 fix(langsmith.py): support langsmith 'extra' field object
Closes https://github.com/BerriAI/litellm/issues/5179
2024-08-13 15:20:50 -07:00
Ishaan Jaff
ab208eb546 check use_x_forwarded_for 2024-08-13 15:18:24 -07:00
Krrish Dholakia
3a1b3227d8 fix(utils.py): ignore none chunk in stream infinite loop check
Fixes https://github.com/BerriAI/litellm/issues/5158#issuecomment-2287156946
2024-08-13 15:06:44 -07:00
Ishaan Jaff
b24da18d2d
Merge pull request #5180 from BerriAI/litellm_allow_controlling_logged_tags_langfuse
[Feat-Proxy+langfuse] LiteLLM-specific Tags on Langfuse - `cache_hit`, `cache_key`
2024-08-13 13:50:01 -07:00
Krrish Dholakia
7e99cfe938 docs(user_keys.md): cleanup instructor docs 2024-08-13 13:15:46 -07:00
Krrish Dholakia
ac8c0ecd85 docs(user_keys.md): cleanup docs 2024-08-13 13:14:27 -07:00