Commit Graph

5186 Commits

Author SHA1 Message Date
Krrish Dholakia
2c1103247d test: fix flaky test 2023-12-01 15:46:39 -08:00
Krrish Dholakia
4da20ac0b9 fix(proxy_server.py): accept max tokens as int 2023-12-01 15:19:34 -08:00
Krrish Dholakia
ac4429c35f test(test_completion.py): commenting out flaky test 2023-12-01 15:06:54 -08:00
Krrish Dholakia
8c1439e910 fix: linting errors 2023-12-01 15:02:22 -08:00
ishaan-jaff
fc40e83783 (fix) linting 2023-12-01 14:51:44 -08:00
ishaan-jaff
455c915b70 (linting) fix 2023-12-01 14:34:15 -08:00
ishaan-jaff
73eb5a7718 (fix) linting 2023-12-01 14:08:19 -08:00
ishaan-jaff
24386c05aa (fix) proxy: pydantic 2023-12-01 13:58:28 -08:00
ishaan-jaff
e8ae347681 (feat) proxy-pydantic,swagger for chat/completion 2023-12-01 13:50:51 -08:00
ishaan-jaff
e77b7e5a50 (docs) proxy: add tags=chat/completions + add response type 2023-12-01 10:00:48 -08:00
ishaan-jaff
2977d04f56 (fix) proxy: raise exceptions 2023-12-01 09:21:06 -08:00
chabala98
c2e2e927fb fix system prompts for replicate 2023-12-01 13:16:35 +01:00
ishaan-jaff
1e9aa69268 (fix) proxy: use orjson.loads() 2023-11-30 20:24:31 -08:00
ishaan-jaff
fb8ccdd422 (ci/cd) add orjson as a dep 2023-11-30 20:18:18 -08:00
ishaan-jaff
06805c7f47 (fix) formatting 2023-11-30 20:03:56 -08:00
ishaan-jaff
1081d4c766 (feat) aembedding: return raw openai response 2023-11-30 20:02:47 -08:00
ishaan-jaff
10d5ab8643 (feat) proxy: /embedding -> use ORJSON responses 2023-11-30 20:00:35 -08:00
ishaan-jaff
2d55cc753e (feat) proxy: use orjson 2023-11-30 19:50:47 -08:00
ishaan-jaff
853af29a25 (test) load test embedding 2023-11-30 19:04:51 -08:00
ishaan-jaff
e1fe79e0c0 (docs) add embedding() profile 2023-11-30 19:04:51 -08:00
Krrish Dholakia
aa36bd2784 fix(utils.py): expand openai_token_counter selection 2023-11-30 18:51:51 -08:00
Krrish Dholakia
ff4457e2d2 fix(router.py): back-off if no models available 2023-11-30 18:42:29 -08:00
Krrish Dholakia
7b99cfe6b9 test(test_token_counter.py): include testing for function calls 2023-11-30 18:24:21 -08:00
Krrish Dholakia
7f04758bcb (fix) support counting tokens for tool calls 2023-11-30 18:24:21 -08:00
dependabot[bot]
50877b1b38
build(deps): bump aiohttp from 3.8.6 to 3.9.0
Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.8.6 to 3.9.0.
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.8.6...v3.9.0)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-30 23:47:51 +00:00
Ishaan Jaff
854ffbe79a
Merge pull request #966 from PSU3D0/proxy_extras
(feat) Allow installing proxy dependencies explicitly with `pip install litellm[proxy]`
2023-11-30 15:46:25 -08:00
Frank Colson
6fb178dc94 Update docs 2023-11-30 16:43:09 -07:00
Frank Colson
7ddfeb75bc Add backwards compatability 2023-11-30 16:35:19 -07:00
Frank Colson
d557f3be74 Remove YAML dependency 2023-11-30 16:31:43 -07:00
Ishaan Jaff
8d39af11d6
Azure Deploy - fix startup command 2023-11-30 15:31:03 -08:00
Frank Colson
5e6913dff2 Use poetry extras for proxy 2023-11-30 16:23:34 -07:00
ishaan-jaff
0da78a64df bump: version 1.9.3 → 1.9.4 2023-11-30 15:20:29 -08:00
ishaan-jaff
bc2299184b (fix) proxy - don't overwrite metadata passed 2023-11-30 15:15:47 -08:00
Ishaan Jaff
f305c3aaef Add or update the Azure App Service build and deployment workflow config 2023-11-30 14:56:41 -08:00
ishaan-jaff
afc1b2209b (feat) docker - allow user to specify base image 2023-11-30 14:49:21 -08:00
ishaan-jaff
8c1a9f1c4e (feat) add bedrock:llama2-70bchat 2023-11-30 14:41:19 -08:00
ishaan-jaff
95634bde76 bump: version 1.9.2 → 1.9.3 2023-11-30 14:30:12 -08:00
ishaan-jaff
f565e6249d (feat) proxy: docker - use wheels for builds 2023-11-30 14:29:30 -08:00
ishaan-jaff
3b2bbc757e (feat) add pip wheel - faster docker image builds 2023-11-30 14:20:30 -08:00
Krrish Dholakia
c473abde49 fix(azure.py): logging fix 2023-11-30 14:13:40 -08:00
Krrish Dholakia
10c522025f bump: version 1.9.1 → 1.9.2 2023-11-30 14:09:06 -08:00
Krrish Dholakia
032f71adb2 fix(router.py): support cloudflare ai gateway for azure models on router 2023-11-30 14:09:06 -08:00
ishaan-jaff
936c27c9ee (fix +test) langfuse log metadata 2023-11-30 13:53:43 -08:00
Krrish Dholakia
6475e0a916 bump: version 1.9.0 → 1.9.1 2023-11-30 13:45:38 -08:00
Krrish Dholakia
a5c99d8594 fix(langfuse.py): fix metadata logging for langfuse 2023-11-30 13:45:34 -08:00
ishaan-jaff
cc0df56bd6 (chore) remove old doc -> this is now Router 2023-11-30 13:33:17 -08:00
Krrish Dholakia
82553e8aac fix(azure.py): fix linting errors 2023-11-30 13:32:29 -08:00
ishaan-jaff
9a1accfe2a (chore) proxy: remove junk load test 2023-11-30 13:31:23 -08:00
Krrish Dholakia
1f3ef72a4b bump: version 1.8.1 → 1.9.0 2023-11-30 13:19:49 -08:00
Krrish Dholakia
4f07c8565a feat(main.py): add support for azure-openai via cloudflare ai gateway 2023-11-30 13:19:49 -08:00