Commit Graph

12286 Commits

Author SHA1 Message Date
Ishaan Jaff
098df3dcd6
Merge pull request #3901 from BerriAI/admin_ui_add_logout_sso
[Feat] Implement Logout Admin UI
2024-05-29 14:36:12 -07:00
Ishaan Jaff
9ae6eb1388 feat - implement logout sso 2024-05-29 14:19:31 -07:00
Ishaan Jaff
56233e6819
Merge pull request #3900 from BerriAI/revert-3895-litellm_triton_chatcompletion_support
Revert "Added support for Triton chat completion using trtlllm generate endpo…"
2024-05-29 13:42:59 -07:00
Ishaan Jaff
99e506525c
Revert "Added support for Triton chat completion using trtlllm generate endpo…" 2024-05-29 13:42:49 -07:00
Ishaan Jaff
e8c1e87ac9
Merge pull request #3895 from giritatavarty-8451/litellm_triton_chatcompletion_support
Added support for Triton chat completion using trtlllm generate endpo…
2024-05-29 12:50:31 -07:00
Krish Dholakia
c76deb8f76
Merge pull request #3846 from nirga/revert-3831-revert-3780-traceloop-failures
fix: Log errors in Traceloop Integration (reverts previous revert)
2024-05-29 08:54:01 -07:00
Ishaan Jaff
dc8480a5e9 test_batch_completion_multiple_models_multiple_messages 2024-05-28 22:54:54 -07:00
Krrish Dholakia
19551efdd3 bump: version 1.39.1 → 1.39.2 2024-05-28 22:39:25 -07:00
Krish Dholakia
0114207b2e
Merge pull request #3887 from BerriAI/litellm_batch_completions
feat(router.py): support fastest response batch completion call
2024-05-28 22:38:12 -07:00
Krish Dholakia
e838bd1c79
Merge branch 'main' into litellm_batch_completions 2024-05-28 22:38:05 -07:00
Ishaan Jaff
6e9cc26ca1
Merge pull request #3888 from BerriAI/litellm_add_files_proxy
[Feat] LiteLLM Proxy Add `POST /v1/files` and `GET /v1/files`
2024-05-28 22:36:33 -07:00
Ishaan Jaff
7671a65f1b bump: version 1.39.0 → 1.39.1 2024-05-28 22:35:00 -07:00
Ishaan Jaff
1b53a1e98d
Merge pull request #3889 from BerriAI/litellm_router_batch_n_models_m_messages
feat - router add abatch_completion - N Models, M Messages
2024-05-28 22:29:34 -07:00
Ishaan Jaff
9ab96e12ed fix - update abatch_completion docstring 2024-05-28 22:27:09 -07:00
Ishaan Jaff
473ec66b84 feat - router add abatch_completion 2024-05-28 22:19:33 -07:00
Krrish Dholakia
3db30ecb4c docs(batching.md): add batch completion fastest response on proxy to docs 2024-05-28 22:14:22 -07:00
Krrish Dholakia
2ee599b848 docs(batching.md): add batch completion to docs 2024-05-28 22:08:06 -07:00
Krrish Dholakia
e3000504f9 fix(router.py): support batch completions fastest response streaming 2024-05-28 21:51:09 -07:00
Krrish Dholakia
f168e35629 build(config.yml): add pillow to ci/cd 2024-05-28 21:39:09 -07:00
Krrish Dholakia
1ebae6e7b0 fix(router.py): support comma-separated model list for batch completion fastest response 2024-05-28 21:34:37 -07:00
Ishaan Jaff
ca8163bbba feat - add afile_content, file_content 2024-05-28 20:58:22 -07:00
Krrish Dholakia
20106715d5 feat(proxy_server.py): enable batch completion fastest response calls on proxy
introduces new `fastest_response` flag for enabling the call
2024-05-28 20:09:31 -07:00
Ishaan Jaff
37e18a42fc feat - add file endpoints proxy 2024-05-28 20:03:13 -07:00
Krrish Dholakia
ecd182eb6a feat(router.py): support fastest response batch completion call
returns fastest response. cancels others.
2024-05-28 19:44:41 -07:00
Ishaan Jaff
6bf6059b3e
Merge pull request #3882 from BerriAI/litellm_add_batches_sdk
[BETA-Feature] Add OpenAI `v1/batches` Support on LiteLLM SDK
2024-05-28 19:38:12 -07:00
Krish Dholakia
9e88a2cabb
Merge pull request #3886 from BerriAI/litellm_time_to_first_token_2
feat(proxy_server.py): Time to first token Request-level breakdown
2024-05-28 18:36:57 -07:00
Krrish Dholakia
bffa79a8c5 feat(proxy_server.py): give request-level breakdown if ttft metric is selected for ju
st that day
2024-05-28 18:09:22 -07:00
Ishaan Jaff
0020672c19 fear support GET /v1/batches{batch_id} 2024-05-28 17:58:34 -07:00
Ishaan Jaff
c2e24b4ed8 feat add v1/batches 2024-05-28 17:49:36 -07:00
Ishaan Jaff
37d350b466 add batches, files to routes 2024-05-28 17:39:17 -07:00
Ishaan Jaff
5e9d024c2c fix - test openai batches 2024-05-28 17:29:13 -07:00
Krrish Dholakia
3558f06de2 fix(model_dashboard.tsx): fix adding model on ui 2024-05-28 17:29:02 -07:00
Ishaan Jaff
215f19440c fix python3.8 error 2024-05-28 17:25:08 -07:00
Ishaan Jaff
c6eb004ed1 fix python 3.8 error 2024-05-28 17:21:59 -07:00
Krish Dholakia
b5c89a249a
Merge pull request #3883 from BerriAI/litellm_anthropic_parallel_streaming_fix
fix(anthropic.py): fix parallel streaming on anthropic.py
2024-05-28 17:21:57 -07:00
Ishaan Jaff
6688215c18 feat - add aretrieve_batch 2024-05-28 17:12:41 -07:00
Ishaan Jaff
1ef7cd923c feat - add acreate_batch 2024-05-28 17:03:29 -07:00
Ishaan Jaff
758ed9e923 feat - add litellm.acreate_file 2024-05-28 16:47:27 -07:00
Krrish Dholakia
324bf027f5 fix(anthropic.py): fix parallel streaming on anthropic.py
prevent parallel requests from cancelling each other

Fixes https://github.com/BerriAI/litellm/issues/3881
2024-05-28 16:29:09 -07:00
Ishaan Jaff
938f4703c3 feat- add retrieve_batch() 2024-05-28 15:55:32 -07:00
Ishaan Jaff
38285e53c3 working create_batch 2024-05-28 15:45:23 -07:00
Ishaan Jaff
d5dbf084ed feat - import batches in __init__ 2024-05-28 15:35:11 -07:00
Ishaan Jaff
0af4c9206f test - openai batches file 2024-05-28 14:54:58 -07:00
Ishaan Jaff
b9515c3b96 feat - add batches types 2024-05-28 12:53:46 -07:00
Krish Dholakia
77e9008eb0
Merge pull request #2888 from rick-github/ollama-image-handling
Update ollama.py for image handling
2024-05-28 10:25:06 -07:00
Ishaan Jaff
6a6f163d51 ui - mount 2024-05-28 08:55:01 -07:00
Ishaan Jaff
ddd0005ed1 bump: version 1.38.12 → 1.39.0 2024-05-28 08:15:37 -07:00
Ishaan Jaff
e6789a0150 fix app mounting ui 2024-05-28 08:14:15 -07:00
Ishaan Jaff
83d381bdb2 ui - new build, release 2024-05-28 08:10:34 -07:00
Ishaan Jaff
cea10e21e7 bump: version 1.38.11 → 1.38.12 2024-05-28 08:10:34 -07:00