Commit Graph

3965 Commits

Author SHA1 Message Date
ishaan-jaff
89cd54094c (docs) proxy: add example OTEL config yaml 2023-12-02 11:22:40 -08:00
ishaan-jaff
067e4e7057 (docs) proxy: add example config.yaml 2023-12-02 11:11:39 -08:00
ishaan-jaff
30e34e62d0 (docs) proxy otel 2023-12-02 11:11:16 -08:00
ishaan-jaff
6866895a27 (fix) proxy: config reading error 2023-12-02 11:09:38 -08:00
ishaan-jaff
54c5736f81 (fix) otel - make it optional 2023-12-02 11:02:03 -08:00
ishaan-jaff
f897d5e849 (ci/cd) HF embedding 2023-12-02 10:57:33 -08:00
ishaan-jaff
7f28333ad8 (docs) simple proxy 2023-12-02 10:42:12 -08:00
ishaan-jaff
5edb529891 (feat) proxy: embedding add OTEL collector 2023-12-02 09:41:29 -08:00
ishaan-jaff
4830aa08ee (fix) linting error 2023-12-02 09:39:26 -08:00
ishaan-jaff
6a0ebc1bb3 (chore) cleanup proxy 2023-12-02 09:37:14 -08:00
ishaan-jaff
278ab7dcab (docs) otel collector 2023-12-01 21:46:37 -08:00
ishaan-jaff
dd8c1b0458 (feat) allow users to set OTEL_ENDPOINT as env 2023-12-01 21:29:26 -08:00
ishaan-jaff
8b6c4918fd (docs) OTEL simple proxy 2023-12-01 21:28:46 -08:00
ishaan-jaff
2a25d9c15d (feat) proxy: name OTEL logger 2023-12-01 21:08:25 -08:00
ishaan-jaff
c431bf8daa (feat) proxy: otel logging 2023-12-01 21:04:08 -08:00
ishaan-jaff
3e62f90b43 (feat) proxy: add OTEL logging input/output 2023-12-01 21:04:07 -08:00
ishaan-jaff
848acdf28e (feat) proxy: add otel config 2023-12-01 21:04:07 -08:00
Krrish Dholakia
60af976aac fix(proxy_server.py): expose model_info as part of pydantic model params object 2023-12-01 20:55:26 -08:00
Krrish Dholakia
41afe48bf8 bump: version 1.9.5 → 1.10.0 2023-12-01 20:47:40 -08:00
Krrish Dholakia
bb687cb96f fix(proxy_server.py): redact api keys from proxy load 2023-12-01 20:47:13 -08:00
Krrish Dholakia
47730da262 fix(proxy_server.py): fix linting errors 2023-12-01 20:40:49 -08:00
Krrish Dholakia
72381c3cc2 feat(proxy_server.py): dynamic reloading config.yaml with new models 2023-12-01 20:32:24 -08:00
Krrish Dholakia
eae5b3ce50 fix(__init__.py): fix linting error 2023-12-01 20:08:08 -08:00
Krrish Dholakia
ccd10b07a8 docs(secret.md): add azure key vault support to docs 2023-12-01 20:07:20 -08:00
Krrish Dholakia
328113a28e fix(proxy_server.py): fix linting errors 2023-12-01 19:45:09 -08:00
Krrish Dholakia
368fee224e feat: support for azure key vault 2023-12-01 19:36:06 -08:00
Krrish Dholakia
cac7ecf840 fix(proxy_server.py): check if bearer token passed in 2023-12-01 17:06:29 -08:00
ishaan-jaff
a971d78d6c bump: version 1.9.4 → 1.9.5 2023-12-01 16:47:14 -08:00
ishaan-jaff
6c6add2a3c (fix) ci/cd 2023-12-01 16:06:22 -08:00
ishaan-jaff
61f902347f (proxy) fix types 2023-12-01 16:05:29 -08:00
ishaan-jaff
80e2ffbfa6 (feat) proxy: use dict 2023-12-01 16:00:00 -08:00
Krrish Dholakia
2c1103247d test: fix flaky test 2023-12-01 15:46:39 -08:00
Krrish Dholakia
4da20ac0b9 fix(proxy_server.py): accept max tokens as int 2023-12-01 15:19:34 -08:00
Krrish Dholakia
ac4429c35f test(test_completion.py): commenting out flaky test 2023-12-01 15:06:54 -08:00
Krrish Dholakia
8c1439e910 fix: linting errors 2023-12-01 15:02:22 -08:00
ishaan-jaff
fc40e83783 (fix) linting 2023-12-01 14:51:44 -08:00
ishaan-jaff
455c915b70 (linting) fix 2023-12-01 14:34:15 -08:00
ishaan-jaff
73eb5a7718 (fix) linting 2023-12-01 14:08:19 -08:00
ishaan-jaff
24386c05aa (fix) proxy: pydantic 2023-12-01 13:58:28 -08:00
ishaan-jaff
e8ae347681 (feat) proxy-pydantic,swagger for chat/completion 2023-12-01 13:50:51 -08:00
ishaan-jaff
e77b7e5a50 (docs) proxy: add tags=chat/completions + add response type 2023-12-01 10:00:48 -08:00
ishaan-jaff
2977d04f56 (fix) proxy: raise exceptions 2023-12-01 09:21:06 -08:00
ishaan-jaff
1e9aa69268 (fix) proxy: use orjson.loads() 2023-11-30 20:24:31 -08:00
ishaan-jaff
fb8ccdd422 (ci/cd) add orjson as a dep 2023-11-30 20:18:18 -08:00
ishaan-jaff
06805c7f47 (fix) formatting 2023-11-30 20:03:56 -08:00
ishaan-jaff
1081d4c766 (feat) aembedding: return raw openai response 2023-11-30 20:02:47 -08:00
ishaan-jaff
10d5ab8643 (feat) proxy: /embedding -> use ORJSON responses 2023-11-30 20:00:35 -08:00
ishaan-jaff
2d55cc753e (feat) proxy: use orjson 2023-11-30 19:50:47 -08:00
ishaan-jaff
853af29a25 (test) load test embedding 2023-11-30 19:04:51 -08:00
ishaan-jaff
e1fe79e0c0 (docs) add embedding() profile 2023-11-30 19:04:51 -08:00