Commit Graph

15167 Commits

Author SHA1 Message Date
Ishaan Jaff
5ff0e47f22 docs add example on using text to speech models 2024-07-25 19:35:48 -07:00
Ishaan Jaff
1a89f9e86d feat - support health check audio_speech 2024-07-25 19:35:48 -07:00
Ishaan Jaff
734d0c3643 fix whisper health check with litellm 2024-07-25 19:35:48 -07:00
Krrish Dholakia
c23cf1ecc5 fix(router.py): add support for diskcache to router 2024-07-25 19:35:48 -07:00
Krrish Dholakia
a5ecf6b1c1 fix(proxy_server.py): check if input list > 0 before indexing into it
resolves 'list index out of range' error
2024-07-25 19:35:48 -07:00
David Manouchehri
fb1a805959 Check for converse support first. 2024-07-25 19:35:40 -07:00
David Manouchehri
2dd30d59ae Support tool calling for Llama 3.1 on Amazon bedrock. 2024-07-25 19:35:40 -07:00
David Manouchehri
35776d7e73 Add Llama 3.1 405b for Bedrock 2024-07-25 19:35:40 -07:00
Krrish Dholakia
52648ebac6 docs(enterprise.md): cleanup docs 2024-07-25 19:35:40 -07:00
Krrish Dholakia
24ff9882ee docs(enterprise.md): cleanup docs 2024-07-25 19:35:40 -07:00
Krrish Dholakia
9ec34313b0 docs(caching.md): update caching docs to include ttl info 2024-07-25 19:35:40 -07:00
Krrish Dholakia
86973d6aca fix(main.py): fix calling openai gpt-3.5-turbo-instruct via /completions
Fixes https://github.com/BerriAI/litellm/issues/749
2024-07-25 19:35:40 -07:00
Krrish Dholakia
9955b1b486 fix(internal_user_endpoints.py): support updating budgets for /user/update 2024-07-25 19:35:29 -07:00
Ishaan Jaff
993920ca6c docs add mistral api large 2 2024-07-25 19:35:29 -07:00
Ishaan Jaff
53075030ff feat - add mistral large 2 2024-07-25 19:35:29 -07:00
Ishaan Jaff
bb44d69152 bump: version 1.42.0 → 1.42.1 2024-07-25 19:35:29 -07:00
Ishaan Jaff
910597fcfa docs groq models 2024-07-25 19:35:29 -07:00
Ishaan Jaff
6579095124 feat - add groq/llama-3.1 2024-07-25 19:35:29 -07:00
Krrish Dholakia
11cdb79fc0 test: cleanup testing 2024-07-25 19:35:29 -07:00
Krrish Dholakia
2c71f6dd04 feat(auth_check.py): support using redis cache for team objects
Allows team update / check logic to work across instances instantly
2024-07-25 19:35:29 -07:00
Krish Dholakia
e6963217ba
Merge branch 'main' into litellm_parallel_requests 2024-07-24 19:25:56 -07:00
Krish Dholakia
0ac7736b1f
Merge pull request #4638 from friendliai/feat/friendli-dedicated-endpoint
feat: add support for friendliai dedicated endpoint
2024-07-24 19:23:15 -07:00
wslee
40bb165108 support dynamic api base 2024-07-25 11:14:38 +09:00
wslee
dd10da4d46 add support for friendli dedicated endpoint 2024-07-25 11:14:35 +09:00
Krrish Dholakia
f35af3bf1c test(test_completion.py): update azure extra headers 2024-07-24 18:42:50 -07:00
Ishaan Jaff
b93b2636a9
Update README.md 2024-07-24 16:51:40 -07:00
Krrish Dholakia
b5c5ed2209 fix(key_management_endpoints.py): if budget duration set, set budget_reset_at 2024-07-24 15:02:22 -07:00
Ishaan Jaff
dc3b39ca71
Merge pull request #4864 from BerriAI/docs_add_using_groq_with_proxy
doc example using litellm proxy with groq
2024-07-24 14:34:12 -07:00
Ishaan Jaff
fe0b0ddaaa doc example using litellm proxy with groq 2024-07-24 14:33:49 -07:00
Ishaan Jaff
53dd47c5cb
Merge pull request #4862 from BerriAI/litellm_fix_unsupported_params_Error
[Fix-litellm python] Raise correct error for UnsupportedParams Error
2024-07-24 14:26:25 -07:00
Krrish Dholakia
65705fde25 test(test_embedding.py): add simple azure embedding ad token test
Addresses https://github.com/BerriAI/litellm/issues/4859#issuecomment-2248838617
2024-07-24 13:38:03 -07:00
Krrish Dholakia
77ffee4e2e test(test_completion.py): add basic test to confirm azure ad token flow works as expected 2024-07-24 13:07:25 -07:00
Krrish Dholakia
99d8b0ad68 fix(bedrock_httpx.py): fix async client check 2024-07-24 12:43:52 -07:00
Ishaan Jaff
30c27b3f92 test UnsupportedParamsError 2024-07-24 12:21:22 -07:00
Ishaan Jaff
8ea4b73c27 add UnsupportedParamsError to litellm exceptions 2024-07-24 12:20:14 -07:00
Ishaan Jaff
11512c057d feat use UnsupportedParamsError as litellm error type 2024-07-24 12:19:10 -07:00
Krrish Dholakia
d9539e518e build(docker-compose.yml): add prometheus scraper to docker compose
persists prometheus data across restarts
2024-07-24 10:09:23 -07:00
Ishaan Jaff
ac7f6598f3
Merge pull request #4853 from BerriAI/litellm_support_tags
[Feat] - Support Logging tags on langsmith
2024-07-24 09:51:56 -07:00
Ishaan Jaff
9c2c231c7c
Merge pull request #4857 from Manouchehri/improve-oidc-tests-5
(test_embedding.py) - Re-enable embedding test with Azure OIDC.
2024-07-24 09:48:01 -07:00
Ishaan Jaff
691c1a5355
Merge pull request #4848 from Manouchehri/llama-3.1-bedrock-1
Add Llama 3.1 for Bedrock
2024-07-24 09:47:32 -07:00
David Manouchehri
ced03d9d7f
(test_embedding.py) - Re-enable embedding test with Azure OIDC. 2024-07-24 16:41:24 +00:00
Krish Dholakia
035d03c7f2
Merge pull request #4856 from msabramo/fix-test_prompt_factory-flake8-warning
Fix `test_prompt_factory` flake8 warning
2024-07-24 09:38:48 -07:00
Marc Abramowitz
a50fe3e1ca Fix test_prompt_factory flake8 warning
```shell
$ poetry run flake8 litellm/tests/test_prompt_factory.py
<unknown>:215: SyntaxWarning: invalid escape sequence '\/'
litellm/tests/test_prompt_factory.py:215:21: W605 invalid escape sequence '\/'
```

Fixed by making the string a raw string, which is equivalent:

```
$ python
Python 3.11.6 (main, Oct 25 2023, 19:49:20) [Clang 14.0.0 (clang-1400.0.29.202)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> "data:image\/jpeg;base64,1234" == r"data:image\/jpeg;base64,1234"
True
```

See: https://stackoverflow.com/questions/52335970/how-to-fix-syntaxwarning-invalid-escape-sequence-in-python
2024-07-24 09:14:22 -07:00
Ishaan Jaff
d06229d168
Merge pull request #4855 from Manouchehri/improve-oidc-tests-4
(test_secret_manager.py) - Improve and add CircleCI v1 test with Amazon.
2024-07-24 09:13:48 -07:00
David Manouchehri
c364a3129e
(test_secret_manager.py) - Improve and add CircleCI v1 test with Amazon. 2024-07-24 16:05:58 +00:00
Ishaan Jaff
f325e29147
Merge pull request #4854 from Manouchehri/oidc-azure-tests-3
OIDC azure tests 3
2024-07-24 08:53:53 -07:00
Ishaan Jaff
b5d580752d
Merge pull request #4843 from elabbarw/main
feat - Add Azure_AI Llama v3.1 API deployments to the model prices json file
2024-07-24 08:53:29 -07:00
Wanis Elabbar
1350ac217d
Merge pull request #3 from elabbarw/elabbarw-llamav31prices
update azure_ai llamav31 prices with sources
2024-07-24 16:50:35 +01:00
Wanis Elabbar
77cf1fd600
update azure_ai llamav31 prices with sources 2024-07-24 16:50:07 +01:00
David Manouchehri
4b89397136
(tests) - Skip embedding Azure AD test for now. 2024-07-24 15:42:57 +00:00