Commit Graph

15149 Commits

Author SHA1 Message Date
Krrish Dholakia
11cdb79fc0 test: cleanup testing 2024-07-25 19:35:29 -07:00
Krrish Dholakia
2c71f6dd04 feat(auth_check.py): support using redis cache for team objects
Allows team update / check logic to work across instances instantly
2024-07-25 19:35:29 -07:00
Krish Dholakia
e6963217ba
Merge branch 'main' into litellm_parallel_requests 2024-07-24 19:25:56 -07:00
Krish Dholakia
0ac7736b1f
Merge pull request #4638 from friendliai/feat/friendli-dedicated-endpoint
feat: add support for friendliai dedicated endpoint
2024-07-24 19:23:15 -07:00
wslee
40bb165108 support dynamic api base 2024-07-25 11:14:38 +09:00
wslee
dd10da4d46 add support for friendli dedicated endpoint 2024-07-25 11:14:35 +09:00
Krrish Dholakia
f35af3bf1c test(test_completion.py): update azure extra headers 2024-07-24 18:42:50 -07:00
Ishaan Jaff
b93b2636a9
Update README.md 2024-07-24 16:51:40 -07:00
Krrish Dholakia
b5c5ed2209 fix(key_management_endpoints.py): if budget duration set, set budget_reset_at 2024-07-24 15:02:22 -07:00
Ishaan Jaff
dc3b39ca71
Merge pull request #4864 from BerriAI/docs_add_using_groq_with_proxy
doc example using litellm proxy with groq
2024-07-24 14:34:12 -07:00
Ishaan Jaff
fe0b0ddaaa doc example using litellm proxy with groq 2024-07-24 14:33:49 -07:00
Ishaan Jaff
53dd47c5cb
Merge pull request #4862 from BerriAI/litellm_fix_unsupported_params_Error
[Fix-litellm python] Raise correct error for UnsupportedParams Error
2024-07-24 14:26:25 -07:00
Krrish Dholakia
65705fde25 test(test_embedding.py): add simple azure embedding ad token test
Addresses https://github.com/BerriAI/litellm/issues/4859#issuecomment-2248838617
2024-07-24 13:38:03 -07:00
Krrish Dholakia
77ffee4e2e test(test_completion.py): add basic test to confirm azure ad token flow works as expected 2024-07-24 13:07:25 -07:00
Krrish Dholakia
99d8b0ad68 fix(bedrock_httpx.py): fix async client check 2024-07-24 12:43:52 -07:00
Ishaan Jaff
30c27b3f92 test UnsupportedParamsError 2024-07-24 12:21:22 -07:00
Ishaan Jaff
8ea4b73c27 add UnsupportedParamsError to litellm exceptions 2024-07-24 12:20:14 -07:00
Ishaan Jaff
11512c057d feat use UnsupportedParamsError as litellm error type 2024-07-24 12:19:10 -07:00
Krrish Dholakia
d9539e518e build(docker-compose.yml): add prometheus scraper to docker compose
persists prometheus data across restarts
2024-07-24 10:09:23 -07:00
Ishaan Jaff
ac7f6598f3
Merge pull request #4853 from BerriAI/litellm_support_tags
[Feat] - Support Logging tags on langsmith
2024-07-24 09:51:56 -07:00
Ishaan Jaff
9c2c231c7c
Merge pull request #4857 from Manouchehri/improve-oidc-tests-5
(test_embedding.py) - Re-enable embedding test with Azure OIDC.
2024-07-24 09:48:01 -07:00
Ishaan Jaff
691c1a5355
Merge pull request #4848 from Manouchehri/llama-3.1-bedrock-1
Add Llama 3.1 for Bedrock
2024-07-24 09:47:32 -07:00
David Manouchehri
ced03d9d7f
(test_embedding.py) - Re-enable embedding test with Azure OIDC. 2024-07-24 16:41:24 +00:00
Krish Dholakia
035d03c7f2
Merge pull request #4856 from msabramo/fix-test_prompt_factory-flake8-warning
Fix `test_prompt_factory` flake8 warning
2024-07-24 09:38:48 -07:00
Marc Abramowitz
a50fe3e1ca Fix test_prompt_factory flake8 warning
```shell
$ poetry run flake8 litellm/tests/test_prompt_factory.py
<unknown>:215: SyntaxWarning: invalid escape sequence '\/'
litellm/tests/test_prompt_factory.py:215:21: W605 invalid escape sequence '\/'
```

Fixed by making the string a raw string, which is equivalent:

```
$ python
Python 3.11.6 (main, Oct 25 2023, 19:49:20) [Clang 14.0.0 (clang-1400.0.29.202)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> "data:image\/jpeg;base64,1234" == r"data:image\/jpeg;base64,1234"
True
```

See: https://stackoverflow.com/questions/52335970/how-to-fix-syntaxwarning-invalid-escape-sequence-in-python
2024-07-24 09:14:22 -07:00
Ishaan Jaff
d06229d168
Merge pull request #4855 from Manouchehri/improve-oidc-tests-4
(test_secret_manager.py) - Improve and add CircleCI v1 test with Amazon.
2024-07-24 09:13:48 -07:00
David Manouchehri
c364a3129e
(test_secret_manager.py) - Improve and add CircleCI v1 test with Amazon. 2024-07-24 16:05:58 +00:00
Ishaan Jaff
f325e29147
Merge pull request #4854 from Manouchehri/oidc-azure-tests-3
OIDC azure tests 3
2024-07-24 08:53:53 -07:00
Ishaan Jaff
b5d580752d
Merge pull request #4843 from elabbarw/main
feat - Add Azure_AI Llama v3.1 API deployments to the model prices json file
2024-07-24 08:53:29 -07:00
Wanis Elabbar
1350ac217d
Merge pull request #3 from elabbarw/elabbarw-llamav31prices
update azure_ai llamav31 prices with sources
2024-07-24 16:50:35 +01:00
Wanis Elabbar
77cf1fd600
update azure_ai llamav31 prices with sources 2024-07-24 16:50:07 +01:00
David Manouchehri
4b89397136
(tests) - Skip embedding Azure AD test for now. 2024-07-24 15:42:57 +00:00
David Manouchehri
af3a900b4d
(tests) - Try azure AD auth directly. 2024-07-24 15:42:40 +00:00
Krish Dholakia
bd9486501d
Merge pull request #4846 from msabramo/speed-up-check_view_exists
Check existence of multiple views in 1 query
2024-07-24 08:06:04 -07:00
Krrish Dholakia
41fda47587 test(test_embedding.py): fix base url 2024-07-24 08:04:27 -07:00
Ishaan Jaff
cea8fcc3fc test - logging langsmith tags 2024-07-24 07:12:45 -07:00
Ishaan Jaff
e378ab8bc9 docs - logging langsmith tags 2024-07-24 07:12:36 -07:00
Ishaan Jaff
adfd6ab900 langsmith - support logging tags 2024-07-24 07:08:40 -07:00
Wanis Elabbar
e370b0cde3
Merge branch 'BerriAI:main' into main 2024-07-24 08:32:49 +01:00
David Manouchehri
609075bd17
Add Llama 3.1 for Bedrock. 2024-07-24 05:48:23 +00:00
Marc Abramowitz
642f1a7bcc Check existence of multiple views in 1 query
instead of multiple queries. This is more efficient because it lets us check for
all views in one query instead of multiple queries.
2024-07-23 21:55:02 -07:00
Krrish Dholakia
d5d2ffffdf bump: version 1.41.28 → 1.42.0 2024-07-23 21:54:06 -07:00
Krish Dholakia
6c580ac8dc
Merge pull request #4845 from BerriAI/litellm_vertex_ai_llama3_1_api
feat(vertex_ai_llama.py): vertex ai llama3.1 api support
2024-07-23 21:51:46 -07:00
Krrish Dholakia
fb0a13c8bb fix(anthropic.py): support openai system message being a list 2024-07-23 21:45:56 -07:00
Krrish Dholakia
ae693424e4 fix(__init__.py): update init 2024-07-23 17:55:28 -07:00
Krrish Dholakia
7df94100e8 build(model_prices_and_context_window.json): add model pricing for vertex ai llama 3.1 api 2024-07-23 17:36:07 -07:00
Krrish Dholakia
83ef52e180 feat(vertex_ai_llama.py): vertex ai llama3.1 api support
Initial working commit for vertex ai llama 3.1 api support
2024-07-23 17:07:30 -07:00
Krish Dholakia
cb4c42e061
Merge pull request #4839 from Manouchehri/azure-oidc-test-1
Add test for Azure OIDC auth
2024-07-23 17:01:00 -07:00
Ishaan Jaff
83b13d34ba bump: version 1.41.27 → 1.41.28 2024-07-23 16:48:50 -07:00
Ishaan Jaff
e9d6816011
Merge pull request #4838 from BerriAI/doc_anthropic_proxy_usage
doc - using anthropic with litellm proxy server
2024-07-23 16:38:09 -07:00