Commit Graph

23118 Commits

Author SHA1 Message Date
David Manouchehri
cd21c80a15
feat(bedrock_httpx.py): Add AWS IAM cred caching for OIDC flow. 2024-06-11 15:43:15 +00:00
David Manouchehri
02aaaf5976
Merge remote-tracking branch 'upstream/main' into oidc-bedrock-httpx-caching-part-1 2024-06-11 15:42:31 +00:00
David Manouchehri
4de9e46d42
Revert "feat(bedrock_httpx.py): Add AWS IAM cred caching for OIDC flow."
This reverts commit 240a0da271.
2024-06-11 15:42:18 +00:00
David Manouchehri
1a77c1bf16
Revert "fix(bedrock_httpx.py): Fix STS region endpoint."
This reverts commit fd16937ad8.
2024-06-11 15:42:09 +00:00
wslee
9e52fd0ba6 fix provider name 2024-06-11 16:23:08 +09:00
wslee
5d7fad1c11 change filename too 2024-06-11 16:20:05 +09:00
wslee
18cc703aa2 change friendli_ai -> friendliai 2024-06-11 16:17:30 +09:00
wslee
b9d261ce21 resolve comment 2024-06-11 14:52:03 +09:00
wslee
1442adbc33 resolve comments 2024-06-11 14:49:39 +09:00
Krrish Dholakia
318abde095 docs(users.md): fix typo 2024-06-10 22:37:30 -07:00
Krrish Dholakia
5c423caffd docs(users.md): fix typo 2024-06-10 22:36:46 -07:00
Krrish Dholakia
61834eed7b docs(users.md): add team reset budgets to docs 2024-06-10 22:29:55 -07:00
Ishaan Jaff
b875a72be8 docs - reliability 2024-06-10 21:54:38 -07:00
Ishaan Jaff
d628bf0bd3 fix azure falbacks test 2024-06-10 21:50:54 -07:00
Krrish Dholakia
2e49614230 fix(utils.py): exception map vertex ai 500 internal server errors 2024-06-10 21:37:54 -07:00
Krrish Dholakia
b756374a4f feat(utils.py): bump tiktoken dependency to 0.7.0
adds support for gpt-4o token counting
2024-06-10 21:21:23 -07:00
Ishaan Jaff
a7e9e5b3cb ui - new build 2024-06-10 21:11:33 -07:00
Ishaan Jaff
43eef61aa7 fix azure cost tracking 2024-06-10 21:09:55 -07:00
Ishaan Jaff
86971c76a1
Merge pull request #4116 from BerriAI/litellm_show_model_group_in_exceptions
fix - show `model group` in  Azure ContentPolicy exceptions
2024-06-10 20:53:53 -07:00
Krrish Dholakia
c5d7a6dbdb docs(bedrock.md): update docs with deprecation notice for passing in boto3.client 2024-06-10 20:39:00 -07:00
Ishaan Jaff
b4db464604 fix - show model group in exceptions 2024-06-10 20:30:31 -07:00
Krish Dholakia
55a20c7cce
Merge pull request #4084 from BerriAI/litellm_batch_add_team_members
fix(proxy_server.py): allow passing in a list of team members
2024-06-10 20:26:35 -07:00
Krish Dholakia
8379d58318
Merge pull request #4106 from BerriAI/litellm_anthropic_bedrock_tool_calling_fix
fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming
2024-06-10 20:21:16 -07:00
Krish Dholakia
4475d2e5b5
Merge branch 'main' into litellm_aws_kms_fixes 2024-06-10 20:17:34 -07:00
Ishaan Jaff
8d18583c67
Merge pull request #4108 from BerriAI/litellm_ui_fix_show_unique_model_names
ui - Fix Test Key dropdown
2024-06-10 20:08:43 -07:00
Ishaan Jaff
cae2100011
Merge pull request #4114 from msabramo/msabramo/assistants-doc-add-get-thread
`assistants.md`: Add "Get a Thread" example
2024-06-10 20:05:15 -07:00
Krrish Dholakia
e6c96aa950 fix(utils.py): fix tgai timeout exception mapping + skip flaky test 2024-06-10 19:50:16 -07:00
Krrish Dholakia
82149b8cf4 test(test_text_completion.py): skip unstable test 2024-06-10 19:45:24 -07:00
Marc Abramowitz
717163780d assistants.md: Add "Get a Thread" example 2024-06-10 17:56:26 -07:00
Ishaan Jaff
8f1e3b8bce
Merge pull request #4112 from msabramo/msabramo/assistants-doc-remove-extra-trailing-backslash
`assistants.md`: Remove extra trailing backslash
2024-06-10 17:55:32 -07:00
Krrish Dholakia
622858e37c fix(utils.py): handle together ai timeout exception 2024-06-10 17:54:57 -07:00
Krrish Dholakia
3a01a485f7 docs(debugging.md): add controlling log level to docs 2024-06-10 17:39:33 -07:00
Marc Abramowitz
28fa8d294a assistants.md: Remove extra trailing backslash
that prevents `curl` command from working.
2024-06-10 17:35:02 -07:00
Krrish Dholakia
b2c9b5bbf4 feat(proxy/_logging.py): support controlling log level when json logs=True
allow user to control log level when json_logs=True
2024-06-10 17:33:43 -07:00
Ishaan Jaff
8f3c25d0c5
Merge pull request #4110 from msabramo/msabramo/enterpise
Fix typos: Enterpise -> Enterprise
2024-06-10 17:29:34 -07:00
Marc Abramowitz
8b30d3f4e9 Fix typos: Enterpise -> Enterprise 2024-06-10 17:26:31 -07:00
Krrish Dholakia
8f140cb5ee fix(utils.py): make sure redis caching works with aws kms encryption 2024-06-10 16:42:19 -07:00
Ishaan Jaff
3347a58e11 ui - chat ui fix 2024-06-10 15:48:36 -07:00
Krrish Dholakia
e4dbb9b2db fix(proxy_cli.py): support passing the database url as an encrypted kms key 2024-06-10 15:48:27 -07:00
Ishaan Jaff
fcd1d077f5 doc fix llm cord 2024-06-10 15:26:09 -07:00
Ishaan Jaff
bb915a80f1
Merge pull request #4107 from BerriAI/litellm_client_side_fallbacks
[Feat] Client Side Fallbacks
2024-06-10 15:23:56 -07:00
Ishaan Jaff
7e2ded9e8e docs - simple fallbacks 2024-06-10 15:07:33 -07:00
Ishaan Jaff
7f5621944d docs - client side fallbacks 2024-06-10 15:06:25 -07:00
Ishaan Jaff
dfe874c9e5 test - client side fallbacks 2024-06-10 15:00:36 -07:00
Ishaan Jaff
66fd69b704 docs - using client side fallbacks 2024-06-10 14:49:50 -07:00
Krrish Dholakia
65baa83928 fix(bedrock_httpx.py): returning correct finish reason on streaming completion 2024-06-10 14:47:49 -07:00
Ishaan Jaff
b52802bbfa doc - client side fallbacks 2024-06-10 14:33:42 -07:00
Ishaan Jaff
1656bbf03e doc - client side fallbacks 2024-06-10 14:33:32 -07:00
Ishaan Jaff
a9006b965f fix - support fallbacks as list 2024-06-10 14:32:28 -07:00
Krrish Dholakia
84652dd946 fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming
Fixes https://github.com/BerriAI/litellm/issues/4091
2024-06-10 14:20:25 -07:00