Commit Graph

3891 Commits

Author SHA1 Message Date
ishaan-jaff
cc0df56bd6 (chore) remove old doc -> this is now Router 2023-11-30 13:33:17 -08:00
Krrish Dholakia
82553e8aac fix(azure.py): fix linting errors 2023-11-30 13:32:29 -08:00
ishaan-jaff
9a1accfe2a (chore) proxy: remove junk load test 2023-11-30 13:31:23 -08:00
Krrish Dholakia
1f3ef72a4b bump: version 1.8.1 → 1.9.0 2023-11-30 13:19:49 -08:00
Krrish Dholakia
4f07c8565a feat(main.py): add support for azure-openai via cloudflare ai gateway 2023-11-30 13:19:49 -08:00
ishaan-jaff
be8bdb580a (test) proxy + router: add bursty load test 2023-11-30 13:17:11 -08:00
ishaan-jaff
a8a6838867 (docs) example: azure config.yaml 2023-11-30 13:16:41 -08:00
ishaan-jaff
97ff0caf70 (feat) proxy: config - azure allow users to pass in base_url 2023-11-30 10:56:55 -08:00
ishaan-jaff
908c32c9c1 (docs) librechat + proxy 2023-11-30 10:47:16 -08:00
ishaan-jaff
fe6ff7cf10 (docs) proxy + librechat 2023-11-30 10:46:48 -08:00
Krrish Dholakia
aea74758e6 docs(simple_proxy.md): improve librechat tutorial 2023-11-30 10:19:18 -08:00
Krrish Dholakia
3d850337a2 docs(routing.md): shoutout sweep on load balancing docs 2023-11-30 09:35:28 -08:00
Ishaan Jaff
e3d37b9bdc
Update proxy_server_config.yaml 2023-11-30 09:30:41 -08:00
Ishaan Jaff
94fd2e3227
Update Dockerfile 2023-11-30 09:27:42 -08:00
Ishaan Jaff
a965c4dfb1
Update proxy_server_config.yaml 2023-11-30 09:26:54 -08:00
Krrish Dholakia
062ede96e3 refactor(proxy_server.py): fix linting issues 2023-11-30 09:24:59 -08:00
ishaan-jaff
cbc358ef77 (docs) proxy: Render deploys 2023-11-30 09:21:07 -08:00
Krrish Dholakia
b4b7acdb72 fix(utils.py): fix azure completion cost calculation 2023-11-30 09:19:35 -08:00
Krrish Dholakia
7ee089b5ca fix(proxy_server.py): provide an endpoint that gives model-specific info from proxy 2023-11-30 09:08:19 -08:00
Ishaan Jaff
f742d14582
Update Dockerfile 2023-11-30 09:03:04 -08:00
Ishaan Jaff
57df87120a
Update Dockerfile 2023-11-30 09:00:23 -08:00
Ishaan Jaff
6fddd078b9
Update Dockerfile 2023-11-30 08:57:44 -08:00
Ishaan Jaff
96151cf260
Update Dockerfile 2023-11-30 08:57:10 -08:00
ishaan-jaff
a56d4a1e83 (fix) proxy: print cwd() 2023-11-30 08:52:06 -08:00
Ishaan Jaff
1772da92c0
Update Dockerfile 2023-11-30 08:46:38 -08:00
Krrish Dholakia
8ab31b99a9 bump: version 1.8.0 → 1.8.1 2023-11-30 08:45:52 -08:00
Krrish Dholakia
01c7e18f31 fix(utils.py): include system fingerprint in streaming response object 2023-11-30 08:45:52 -08:00
Ishaan Jaff
78421d89aa
Update Dockerfile 2023-11-30 08:44:25 -08:00
Ishaan Jaff
2a2fffdd09
Update Dockerfile 2023-11-30 08:40:24 -08:00
ishaan-jaff
ecdc5bdad6 (dos) config.yaml 2023-11-30 08:34:36 -08:00
Ishaan Jaff
f7da28eb34
Merge pull request #958 from rishabgit/main
docs: adds gpt-3.5-turbo-1106 in supported models
2023-11-30 08:26:55 -08:00
Rishab Mallick
5693626ba5 docs: adds gpt-3.5-turbo-1106 in supported models 2023-11-30 13:32:51 +05:30
ishaan-jaff
9331f67c69 (docs) add pplx-online 2023-11-29 21:18:42 -08:00
ishaan-jaff
08fd41d43d (feat) add pplx-online llms 2023-11-29 21:15:36 -08:00
Krrish Dholakia
e98fac66da fix(utils.py): fix register model cost map 2023-11-29 21:12:29 -08:00
Krrish Dholakia
03fb143a87 docs(simple_proxy.md): adding librechat tutorial to docs 2023-11-29 21:03:17 -08:00
ishaan-jaff
e5ce45dc2c (cleanup) proxy/health 2023-11-29 20:15:52 -08:00
Krrish Dholakia
583571a43a bump: version 1.7.21 → 1.8.0 2023-11-29 20:14:54 -08:00
Krrish Dholakia
0d200cd8dc feat(main.py): allow updating model cost via completion() 2023-11-29 20:14:39 -08:00
ishaan-jaff
4c1ef4e270 (chore) fix testing 2023-11-29 20:05:13 -08:00
Krrish Dholakia
50cc4a8595 fix(proxy_server.py): have /health and /routes be router endpoints 2023-11-29 19:59:56 -08:00
ishaan-jaff
4ed5b3b46d (chore) linting fix 2023-11-29 19:58:12 -08:00
Krrish Dholakia
a9fdae0d23 test(test_streaming.py): refactor testing 2023-11-29 19:58:04 -08:00
Krrish Dholakia
7b53bf7d9a bump: version 1.7.20 → 1.7.21 2023-11-29 19:58:04 -08:00
Krrish Dholakia
c312ac4ca8 fix(main.py): don't pass stream to petals 2023-11-29 19:58:04 -08:00
ishaan-jaff
9780efca4b (feat) router: async client Azure, OpenAI 2023-11-29 19:45:08 -08:00
Krrish Dholakia
2760cdcce5 bump: version 1.7.19 → 1.7.20 2023-11-29 19:44:16 -08:00
Krrish Dholakia
1f5a1122fc fix(replicate.py): fix custom prompt formatting 2023-11-29 19:44:09 -08:00
ishaan-jaff
c05da0797b (feat) Embedding: Async Azure 2023-11-29 19:43:47 -08:00
ishaan-jaff
53554bae85 (test) aembedding 2023-11-29 19:36:42 -08:00