Commit Graph

3021 Commits

Author SHA1 Message Date
ishaan-jaff
db0e032d53 (docs) simple proxy 2023-11-08 17:55:11 -08:00
ishaan-jaff
fc05510a5d (docs) call specific model 2023-11-08 17:52:42 -08:00
ishaan-jaff
fc45f41818 (docs) add instructions on running with FLASK 2023-11-08 17:48:14 -08:00
Krrish Dholakia
c57ed0a9d7 refactor(openai.py): moving openai chat completion calls to http 2023-11-08 17:40:41 -08:00
ishaan-jaff
da1451e493 (docs) use FLASK benchmarks with proxy 2023-11-08 17:25:59 -08:00
ishaan-jaff
68e668df13 (docs) lm harness 2023-11-08 17:21:12 -08:00
Krrish Dholakia
53abc31c27 refactor(azure.py): moving azure openai calls to http calls 2023-11-08 16:52:18 -08:00
ishaan-jaff
01a7660a12 (test) replicate with params 2023-11-08 14:28:06 -08:00
ishaan-jaff
b102489f49 (docs) replicate input params 2023-11-08 14:23:37 -08:00
ishaan-jaff
fe82e172b9 (fix) clean up proxy cli 2023-11-08 13:48:02 -08:00
Ishaan Jaff
c63b09857c
Update README.md 2023-11-08 13:39:29 -08:00
Ishaan Jaff
e825de8b4e
Update README.md 2023-11-08 13:37:30 -08:00
Ishaan Jaff
af99f5f30b
Update README.md 2023-11-08 13:37:02 -08:00
Ishaan Jaff
cbe1414210
Update README.md 2023-11-08 13:31:40 -08:00
Ishaan Jaff
cdd2a45600
Update README.md 2023-11-08 13:30:39 -08:00
Ishaan Jaff
f00c2e6c16
readme proxy 2023-11-08 13:28:39 -08:00
ishaan-jaff
3498e881af (docs) proxy server 2023-11-08 13:27:17 -08:00
ishaan-jaff
50a1c55ce1 (docs) proxy 2023-11-08 13:24:21 -08:00
ishaan-jaff
57c78cebb9 (docs) proxy cli args 2023-11-08 13:19:25 -08:00
ishaan-jaff
c6e4ea8558 (docs) proxy cli add params supported 2023-11-08 13:11:49 -08:00
ishaan-jaff
547f41071e (fix) proxy cli --test 2023-11-08 12:00:13 -08:00
ishaan-jaff
4dd7e2519f (test) add text completion steaming test 2023-11-08 11:59:31 -08:00
ishaan-jaff
2a751c277f (feat) add streaming for text_completion 2023-11-08 11:58:07 -08:00
ishaan-jaff
a404b0fc3b (fix) remove errant print from hf 2023-11-08 11:49:15 -08:00
ishaan-jaff
6ee599545a (fix) text_completion don't pass echo to HF after translating 2023-11-08 11:45:05 -08:00
ishaan-jaff
afea84e0c0 (test) run a test again 2023-11-08 10:34:57 -08:00
ishaan-jaff
aba39670a3 (test) run ci/cd again 2023-11-08 10:21:19 -08:00
ishaan-jaff
55eb274f36 (test) remove dup hf test 2023-11-08 09:54:40 -08:00
ishaan-jaff
b8ebab5d4f (test) router functionality 2023-11-08 09:48:48 -08:00
ishaan-jaff
39ca8b5043 bump: version 0.13.7 → 0.13.8 2023-11-08 09:46:57 -08:00
Ishaan Jaff
8cedacfa2d
Merge pull request #781 from clalanliu/main
fix: fix bug for the case --model is not specified
2023-11-08 08:26:32 -08:00
Alan Liu
6c17ab6e75 fix: fix bug for the case --model is not specified 2023-11-08 23:57:24 +08:00
ishaan-jaff
3239ec80c9 (docs) embedding models 2023-11-07 21:43:02 -08:00
Krrish Dholakia
e7735274de fix(factory.py): fixing llama-2 non-chat models prompt templating 2023-11-07 21:33:54 -08:00
Krrish Dholakia
ce27e08e7d (fix): llama-2 non-chat models prompt template 2023-11-07 21:33:54 -08:00
ishaan-jaff
4ca4038246 (docs) proxy server 2023-11-07 17:27:58 -08:00
ishaan-jaff
febb163850 (docs) proxy server openai api base 2023-11-07 17:24:47 -08:00
Krrish Dholakia
193cbe632f fix(utils.py): llmmonitor integration 2023-11-07 15:49:32 -08:00
ishaan-jaff
83ef369871 (docs) proxy server 2023-11-07 15:39:59 -08:00
ishaan-jaff
c972e4acf2 (docs) proxy server 2023-11-07 15:30:29 -08:00
ishaan-jaff
adf7539be2 (docs) proxy server 2023-11-07 15:27:29 -08:00
ishaan-jaff
7c37d24b46 (docs) proxy 2023-11-07 15:16:28 -08:00
ishaan-jaff
4c31045cee (docs) proxy 2023-11-07 15:14:06 -08:00
ishaan-jaff
813da8ec04 (docs) proxy 2023-11-07 15:11:47 -08:00
ishaan-jaff
ff482f2eb9 (docs) proxy server 2023-11-07 12:16:30 -08:00
Krish Dholakia
ae676116ac
Update README.md 2023-11-07 12:11:15 -08:00
Krish Dholakia
6a5671c576
Update README.md 2023-11-07 12:10:52 -08:00
Krish Dholakia
7a5debb796
Update README.md 2023-11-07 12:10:23 -08:00
Krish Dholakia
9a9c78e9b7
Update README.md 2023-11-07 12:08:59 -08:00
Krish Dholakia
4785fc39bc
Update README.md 2023-11-07 12:08:31 -08:00