Commit Graph

1159 Commits

Author SHA1 Message Date
dependabot[bot]
6ead640637
build(deps): bump sharp from 0.32.5 to 0.32.6 in /docs/my-website
Bumps [sharp](https://github.com/lovell/sharp) from 0.32.5 to 0.32.6.
- [Release notes](https://github.com/lovell/sharp/releases)
- [Changelog](https://github.com/lovell/sharp/blob/main/docs/changelog.md)
- [Commits](https://github.com/lovell/sharp/compare/v0.32.5...v0.32.6)

---
updated-dependencies:
- dependency-name: sharp
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-16 18:59:28 +00:00
Krrish Dholakia
fcc250b312 docs(simple_proxy.md): add tutorial on handling multiple instances of 1 model 2023-11-16 09:14:15 -08:00
Ishaan Jaff
d6ad62d793
Merge pull request #811 from dchristian3188/bedrock-llama
Bedrock llama
2023-11-16 07:57:50 -08:00
ishaan-jaff
63b2b6c9a2 (docs) remove bloat gpt cache 2023-11-15 17:30:47 -08:00
ishaan-jaff
cc955fca89 (docs) config 2023-11-15 16:48:01 -08:00
ishaan-jaff
77394e7987 (docs) using litellm proxy + langfuse 2023-11-15 14:29:14 -08:00
ishaan-jaff
e9dfea887c (docs) using litellm proxy + Langfuse 2023-11-15 13:52:47 -08:00
ishaan-jaff
b7859f0dd1 (docs) show how to debug proxy logs 2023-11-15 13:44:17 -08:00
ishaan-jaff
8cced8eabc (docs) proxy cli settings 2023-11-15 13:33:29 -08:00
ishaan-jaff
ae7731b4dc (docs) using litellm with curl, OpenAI v1.0.0+ 2023-11-15 13:29:20 -08:00
Krrish Dholakia
33d823a18d docs(routing.md): add contributor s/o 2023-11-15 13:20:02 -08:00
Krrish Dholakia
8c104e9c6a fix(azure.py-+-proxy_server.py): fix function calling response object + support router on proxy 2023-11-15 13:15:16 -08:00
ishaan-jaff
f3bbedbbbc (docs) proxy add example on using local hf llm 2023-11-15 13:00:43 -08:00
ishaan-jaff
5963d9d283 (docs) config for azure ad 2023-11-14 15:47:37 -08:00
ishaan-jaff
0e9446f213 (docs) proxy 2023-11-14 15:42:23 -08:00
ishaan-jaff
255c0fab1d (docs) passing azure_ad_token to config 2023-11-14 15:27:59 -08:00
ishaan-jaff
952ab1a401 (docs) azure ad 2023-11-14 14:38:33 -08:00
ishaan-jaff
1a73913766 (docs) azure passing azure_ad_token 2023-11-14 13:49:39 -08:00
ishaan-jaff
ede03af21d (docs) pass azure_ad_token 2023-11-14 13:44:03 -08:00
Krrish Dholakia
7ef8611952 fix(simple_proxy.md): enable setting a master key to protect proxy endpoints 2023-11-14 12:44:33 -08:00
Krrish Dholakia
17b02c0753 fix(migration.md): migration guide for new litellm MAJOR release 2023-11-14 12:02:53 -08:00
ishaan-jaff
3280a8e2e2 (docs) eval suites 2023-11-13 20:33:25 -08:00
David Christian
404d4e8737 updated docs 2023-11-13 15:43:52 -08:00
ishaan-jaff
cf0ab7155e (fix) proxy + docs: use openai.chat.completions.create instead of openai.ChatCompletions 2023-11-13 08:24:26 -08:00
Ishaan Jaff
60770e1eec
Merge pull request #806 from BerriAI/dependabot/npm_and_yarn/docs/my-website/babel/traverse-7.23.3
build(deps): bump @babel/traverse from 7.22.10 to 7.23.3 in /docs/my-website
2023-11-13 08:15:20 -08:00
dependabot[bot]
6c9b3e2e71
build(deps): bump @babel/traverse in /docs/my-website
Bumps [@babel/traverse](https://github.com/babel/babel/tree/HEAD/packages/babel-traverse) from 7.22.10 to 7.23.3.
- [Release notes](https://github.com/babel/babel/releases)
- [Changelog](https://github.com/babel/babel/blob/main/CHANGELOG.md)
- [Commits](https://github.com/babel/babel/commits/v7.23.3/packages/babel-traverse)

---
updated-dependencies:
- dependency-name: "@babel/traverse"
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-13 16:11:42 +00:00
dependabot[bot]
4e30b81eaf
build(deps): bump postcss from 8.4.27 to 8.4.31 in /docs/my-website
Bumps [postcss](https://github.com/postcss/postcss) from 8.4.27 to 8.4.31.
- [Release notes](https://github.com/postcss/postcss/releases)
- [Changelog](https://github.com/postcss/postcss/blob/main/CHANGELOG.md)
- [Commits](https://github.com/postcss/postcss/compare/8.4.27...8.4.31)

---
updated-dependencies:
- dependency-name: postcss
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-13 16:11:38 +00:00
ishaan-jaff
ecc6790a23 (docs) fast eval with proxy 2023-11-11 12:08:10 -08:00
ishaan-jaff
b6e6c7bb86 (docs) use fast eval 2023-11-11 12:06:17 -08:00
ishaan-jaff
0cee50f66d (docs) openai 2023-11-10 21:00:37 -08:00
ishaan-jaff
71da9d0d63 (docs) add gpt-4 vision 2023-11-10 17:34:20 -08:00
ishaan-jaff
5da6fb84fa (docs) simple proxy 2023-11-10 15:59:12 -08:00
ishaan-jaff
5fcf9fc799 (docs) proxy setting default models 2023-11-10 13:06:22 -08:00
ishaan-jaff
ebcd29b1ec (docs) proxy pass headers 2023-11-10 12:59:34 -08:00
ishaan-jaff
9d4cbf1d22 (docs) pass headers in config 2023-11-10 12:56:53 -08:00
ishaan-jaff
bf2cb91841 (docs) add replicate cold boots info 2023-11-10 12:46:33 -08:00
Krrish Dholakia
84460b8222 docs(input.md): adding anyscale supported params 2023-11-10 09:26:57 -08:00
ishaan-jaff
76d8ea674e (docs) replicate 2023-11-09 18:16:21 -08:00
ishaan-jaff
6f639f30c5 (docs) replicate deployments 2023-11-09 18:10:38 -08:00
ishaan-jaff
e355a0674f (docs) using auto evals 2023-11-09 17:31:50 -08:00
ishaan-jaff
7ddd29da93 (docs) litellm eval suites 2023-11-09 17:22:42 -08:00
ishaan-jaff
108336aeef (docs) using proxy with mlfow eval 2023-11-09 17:21:43 -08:00
ishaan-jaff
953593e137 (docs) add mlflow 2023-11-09 17:18:32 -08:00
ishaan-jaff
88111fbb36 (docs) auto evals 2023-11-09 17:18:32 -08:00
ishaan-jaff
bba62b56d3 (docs) auto eval tutorial 2023-11-09 15:43:55 -08:00
ishaan-jaff
87328a973e (docs) add tutorial on using litellm with autoeval 2023-11-09 15:42:12 -08:00
ishaan-jaff
40e7e2ce48 (docs) cleanup 2023-11-09 13:24:13 -08:00
ishaan-jaff
9fd51f66d0 (docs) cleanup 2023-11-09 13:20:15 -08:00
ishaan-jaff
376dae73f9 (docs) openai proxy configs 2023-11-09 13:18:35 -08:00
ishaan-jaff
d48ed083ab (docs) cleanup 2023-11-09 11:51:55 -08:00
ishaan-jaff
4bc70329a4 (docs) proxy with config 2023-11-09 11:50:13 -08:00
ishaan-jaff
e2a380b832 (docs) deprecated proxy 2023-11-09 10:55:28 -08:00
ishaan-jaff
fbebb28970 (docs) simple proxy 2023-11-09 10:46:16 -08:00
ishaan-jaff
2c67bda137 (docs) proxy 2023-11-09 10:38:19 -08:00
ishaan-jaff
db0e032d53 (docs) simple proxy 2023-11-08 17:55:11 -08:00
ishaan-jaff
fc05510a5d (docs) call specific model 2023-11-08 17:52:42 -08:00
ishaan-jaff
fc45f41818 (docs) add instructions on running with FLASK 2023-11-08 17:48:14 -08:00
ishaan-jaff
da1451e493 (docs) use FLASK benchmarks with proxy 2023-11-08 17:25:59 -08:00
ishaan-jaff
68e668df13 (docs) lm harness 2023-11-08 17:21:12 -08:00
ishaan-jaff
b102489f49 (docs) replicate input params 2023-11-08 14:23:37 -08:00
ishaan-jaff
3498e881af (docs) proxy server 2023-11-08 13:27:17 -08:00
ishaan-jaff
50a1c55ce1 (docs) proxy 2023-11-08 13:24:21 -08:00
ishaan-jaff
57c78cebb9 (docs) proxy cli args 2023-11-08 13:19:25 -08:00
ishaan-jaff
c6e4ea8558 (docs) proxy cli add params supported 2023-11-08 13:11:49 -08:00
ishaan-jaff
3239ec80c9 (docs) embedding models 2023-11-07 21:43:02 -08:00
ishaan-jaff
4ca4038246 (docs) proxy server 2023-11-07 17:27:58 -08:00
ishaan-jaff
febb163850 (docs) proxy server openai api base 2023-11-07 17:24:47 -08:00
ishaan-jaff
83ef369871 (docs) proxy server 2023-11-07 15:39:59 -08:00
ishaan-jaff
c972e4acf2 (docs) proxy server 2023-11-07 15:30:29 -08:00
ishaan-jaff
adf7539be2 (docs) proxy server 2023-11-07 15:27:29 -08:00
ishaan-jaff
7c37d24b46 (docs) proxy 2023-11-07 15:16:28 -08:00
ishaan-jaff
4c31045cee (docs) proxy 2023-11-07 15:14:06 -08:00
ishaan-jaff
813da8ec04 (docs) proxy 2023-11-07 15:11:47 -08:00
ishaan-jaff
ff482f2eb9 (docs) proxy server 2023-11-07 12:16:30 -08:00
ishaan-jaff
3ef75029cb (docs) proxy server 2023-11-07 12:06:25 -08:00
ishaan-jaff
a16707fc1a (docs) proxy 2023-11-07 11:49:40 -08:00
ishaan-jaff
10b94c8a0a (docs) proxy 2023-11-07 11:39:10 -08:00
ishaan-jaff
0f23f04d06 (docs) cleanup 2023-11-07 11:34:02 -08:00
ishaan-jaff
87d0b72a4a (docs) proxy 2023-11-07 09:48:58 -08:00
Krrish Dholakia
50564ab38e docs(routing.md): adding comparison to docs 2023-11-06 18:57:50 -08:00
Krrish Dholakia
ba66294a3d fix(router.py): fix linting issues 2023-11-06 18:50:09 -08:00
ishaan-jaff
f7990525ff (docs) add gpt-4 turbo 2023-11-06 13:32:08 -08:00
ishaan-jaff
deddb48683 (docs) litelm custom openai server 2023-11-06 09:24:35 -08:00
ishaan-jaff
7e9c635186 (docs) custom openai proxy 2023-11-06 09:20:20 -08:00
Kyle
067e5c3d91 Merge branch 'main' of github.com:kylehh/litellm into main 2023-11-05 02:58:32 -08:00
Kyle
fb1205f143 name change 2023-11-05 02:58:19 -08:00
kYLe
99d241d2d5
Merge branch 'BerriAI:main' into main 2023-11-05 04:56:18 -06:00
Kyle
256d8d1a7f change name 2023-11-05 02:55:09 -08:00
ishaan-jaff
5da47688ef (docs) litellm playground fix 2023-11-04 22:28:01 -07:00
ishaan-jaff
6e4a575b0f (docs) lm eval harness 2023-11-04 17:55:32 -07:00
ishaan-jaff
44ee34529b (docs) lm harness 2023-11-04 17:51:50 -07:00
ishaan-jaff
45d681107d (docs) lm harness tutorial 2023-11-04 17:51:16 -07:00
ishaan-jaff
53c2ada9e3 (docs) index.md 2023-11-04 17:23:36 -07:00
Krrish Dholakia
37fd895692 docs(custom_callback.md): adding callback class to docs 2023-11-04 17:14:42 -07:00
ishaan-jaff
53371d37b7 (docs) lm eval harness 2023-11-03 18:11:07 -07:00
Krrish Dholakia
4e1885734a refactor(proxy_server.py): print statement showing how to add debug for logs 2023-11-03 17:41:14 -07:00
Krrish Dholakia
432520ffcf docs(simple_proxy.md): improving tutorial 2023-11-03 14:06:08 -07:00
Krrish Dholakia
22fd8953c1 docs(simple_proxy.md): adding docs 2023-11-03 14:03:48 -07:00
Krrish Dholakia
9f180831fe docs(simple_proxy.md): doc cleanup 2023-11-03 13:07:07 -07:00
Krrish Dholakia
f6486b9df9 docs(simple_proxy.md): adding bedrock tutorial 2023-11-03 12:58:48 -07:00
Krrish Dholakia
6b3671b593 fix(proxy_server.py): accept config.yaml 2023-11-03 12:50:52 -07:00
ishaan-jaff
9484d19920 (docs) caching 2023-11-02 14:51:07 -07:00
ishaan-jaff
764ba41224 (docs) embedding 2023-11-02 10:57:57 -07:00
ishaan-jaff
f24e1cb133 (docs) embedding cohere 2023-11-02 10:56:24 -07:00
ishaan-jaff
4dfefc475d (docs) cohere embedding 2023-11-02 10:45:56 -07:00
ishaan-jaff
fdc88cc0ee (docs) cohere embedding models 2023-11-02 10:35:46 -07:00
ishaan-jaff
8ea2270058 (feat) cohere embedding 2023-11-02 10:26:02 -07:00
ishaan-jaff
33350c7c41 (docs) cohere 2023-11-02 10:23:52 -07:00
Krrish Dholakia
73cd0f3778 docs(proxy_server.md): cleanup 2023-11-01 18:13:22 -07:00
Krrish Dholakia
82065716de docs(lm_evaluation_harness.md): adding github link to docs 2023-11-01 17:46:21 -07:00
Krrish Dholakia
9afd3c8bfa docs(lm_evaluation_harness.md): tutorial showing how to use lm evaluation harness with tgi 2023-11-01 17:45:16 -07:00
ishaan-jaff
9cfd218101 (feat) detect amazon.titan-embed-text-v1 as bedrock embedding model 2023-11-01 14:46:33 -07:00
ishaan-jaff
f4a45ec35b (docs) bedrock 2023-11-01 14:17:53 -07:00
ishaan-jaff
dc5a50d20e (docs) bedrock 2023-11-01 14:16:13 -07:00
ishaan-jaff
5c92cca9a4 (docs) add bedrock embedding 2023-11-01 14:15:08 -07:00
ishaan-jaff
59b3a64e64 (docs) add bedrock embeddings() 2023-11-01 14:12:48 -07:00
Krrish Dholakia
8deeb52f7c docs(function_call.md): cleanup 2023-11-01 13:55:00 -07:00
Krrish Dholakia
fb4be198ee docs(routing.md): adding context window fallback dict and num retries 2023-11-01 13:52:18 -07:00
ishaan-jaff
270fc02578 (docs) add litellm.api_version 2023-11-01 11:52:20 -07:00
Krish Dholakia
d898b1c412
Merge pull request #734 from morgendigital/patch-1
Docker Hub image is built for ARM64 only
2023-11-01 08:21:45 -07:00
ishaan-jaff
522f1ac7c8 (docs) bedrock 2023-10-31 22:32:41 -07:00
ishaan-jaff
cedc756d2e (docs) hf viewing log probs 2023-10-31 18:37:18 -07:00
ishaan-jaff
c0e6596395 (docs) hf 2023-10-31 18:25:44 -07:00
Krrish Dholakia
847de09308 docs(simple_proxy.md): add model alias to docs 2023-10-31 17:30:02 -07:00
ishaan-jaff
b32cedeb28 (docs) function calling for non openai llms 2023-10-31 17:15:35 -07:00
Morgendigital
3c49949e0b
Docker Hub image is built for ARM64 only
When trying to run it on a x64 Linux machine, I get the following error:

```
WARNING: The requested image's platform (linux/arm64) does not match the detected host platform (linux/amd64/v3) and no specific platform was requested
```

The Docker image was apparently built for ARM64 only.
2023-10-31 23:28:38 +01:00
ishaan-jaff
7578716adc (docs) openai set - org + api base 2023-10-30 18:03:53 -07:00
ishaan-jaff
5f47c8d310 (docs) update calling ft gpt3.5 2023-10-30 17:56:01 -07:00
ishaan-jaff
80d3fd845f (docs) example on setting organization param for openai 2023-10-30 17:43:32 -07:00
ishaan-jaff
d61e4cab19 (docs) openai.md 2023-10-30 17:33:23 -07:00
ishaan-jaff
d32f354bb2 (docs) openai supported models 2023-10-30 17:31:03 -07:00
Krish Dholakia
9b84a4c8bd
(docs) updates 2023-10-30 16:51:38 -07:00
ishaan-jaff
47ac4fa58f (docs) update encode/decode doc 2023-10-30 14:13:06 -07:00
ishaan-jaff
c61fa70ba0 (docs) encode docstring 2023-10-30 14:10:29 -07:00
ishaan-jaff
313eee17e3 (docs) validate keys 2023-10-30 14:07:35 -07:00
ishaan-jaff
370b6be52a (docs) update model alias 2023-10-30 13:58:07 -07:00
ishaan-jaff
689c14525c (docs) update token trimming 2023-10-30 13:56:23 -07:00
ishaan-jaff
359f40d483 (docs) getting started 2023-10-30 13:39:50 -07:00
Krrish Dholakia
ee2e186c62 docs(routing.md): clean up title 2023-10-29 21:13:45 -07:00
Krrish Dholakia
7304c75f9c docs(simple_proxy.md): updating copy 2023-10-28 19:21:19 -07:00
Krrish Dholakia
ffd80ca850 docs(input.md): updating litellm-specific params for completion 2023-10-28 19:17:07 -07:00
Krrish Dholakia
585f7b0434 docs(input.md): add litellm params to docs 2023-10-28 19:13:55 -07:00
Krrish Dholakia
758b75cb8d docs(simple_proxy.md): updating titles 2023-10-28 16:18:56 -07:00
Krrish Dholakia
23f03f7e6f docs(simple_proxy.md): add llama index tutorial to docs 2023-10-28 16:14:51 -07:00
ishaan-jaff
b76304246e (docs) reliability with fallbacks + router 2023-10-28 15:28:03 -07:00
Krrish Dholakia
b18b9d6380 docs(simple_proxy.md): add arize ai llm evals to docs 2023-10-28 15:14:27 -07:00
Krrish Dholakia
59e47fac78 docs(simple_proxy.md): prompt tools tutorials 2023-10-28 14:52:17 -07:00
Ishaan Jaff
914067227a
Merge pull request #713 from josearangos/main
refactor Contributing to documentation steps
2023-10-28 12:39:40 -07:00
ishaan-jaff
2272a5d1fa (docs) cleanup remove bload - ab test lllms 2023-10-28 12:34:40 -07:00
josearangos
cc7b06f8e4 refactor Contributing to documentation steps 2023-10-28 14:25:01 -05:00
Krrish Dholakia
347a5c46e2 docs(simple_proxy.md): adding NeMO Guardrails tutorial to docs 2023-10-28 12:17:16 -07:00
ishaan-jaff
bdc96d6390 (docs) improve sentry callback 2023-10-27 16:33:12 -07:00
ishaan-jaff
1d955e7b07 (docs) use sentry DSN to send data 2023-10-27 16:25:02 -07:00
Krrish Dholakia
afe14c8a96 fix(utils.py/completion_with_fallbacks): accept azure deployment name in rotations 2023-10-27 16:00:42 -07:00
ishaan-jaff
895cb5d0f9 (docs) add LiteLLM Server - deploy liteLLM 2023-10-26 20:18:51 -07:00
ishaan-jaff
7f90f400c3 (docs) add 1 click deploy to index.md 2023-10-26 20:12:29 -07:00
ishaan-jaff
13ff7cd429 (docs) add deploy button to index.md 2023-10-26 20:10:58 -07:00
ishaan-jaff
3563ae81a8 (docs) improve async + streaming completion 2023-10-26 12:10:37 -07:00
Krrish Dholakia
8d2a4a597a doc cleanup 2023-10-26 11:33:40 -07:00
ishaan-jaff
758628a621 (docs) litellm server deploy aws 2023-10-25 19:05:53 -07:00
ishaan-jaff
63fc276a2b (docs) litellm server deploy on aws 2023-10-25 19:04:37 -07:00
ishaan-jaff
0b0556cfd7 (docs) litellm server deploy on app runner 2023-10-25 18:58:55 -07:00
ishaan-jaff
913262fd99 (docs) litellm server instructions on deploying to aws app runner 2023-10-25 18:33:43 -07:00
ishaan-jaff
ae54db8c84 (docs) proxy server deploy to AWS 2023-10-25 17:07:53 -07:00
Krrish Dholakia
96068a2031 docs(routing.md): renaming docs for simplicity 2023-10-25 14:23:17 -07:00
Ishaan Jaff
628e52e9ab
Merge pull request #700 from josearangos/main
docs error ==> openai.error instead of openai.errors
2023-10-25 14:23:02 -07:00
ishaan-jaff
aa4d049a48 (docs) proxy server add caching flip per completion request 2023-10-25 14:17:21 -07:00
Krrish Dholakia
aec4de68a7 docs(routing.md): fix deployment tutorial 2023-10-25 14:02:11 -07:00
josearangos
203aa24aed docs error openai.error instead of openai.errors 2023-10-25 15:57:26 -05:00
ishaan-jaff
e7eb495a3a (docs) proxy add info on testing caching 2023-10-25 11:29:48 -07:00
ishaan-jaff
f208a1231b (docs) proxy server add info on caching 2023-10-25 10:38:58 -07:00
Krrish Dholakia
edfa4d550a docs(anyscale.md): adding anyscale documentation
n
2023-10-25 09:12:29 -07:00
ishaan-jaff
7b76a7ed25 (docs) on deploying render 2023-10-24 21:28:37 -07:00
ishaan-jaff
e897a75887 (docs) simple proxy testing 2023-10-24 21:13:41 -07:00
ishaan-jaff
923bc706fd (docs) simple proxy server 2023-10-24 21:00:01 -07:00
ishaan-jaff
70fcf351d8 (docs) simple proxy updates 2023-10-24 20:55:15 -07:00
ishaan-jaff
55b9fb6bfb (docs) add deploy to render litellm 2023-10-24 20:40:52 -07:00
Krrish Dholakia
046e1384c3 docs(huggingface.md): adding huggingface text-embedding-inference to docs 2023-10-24 17:53:39 -07:00
ishaan-jaff
e5c6f512f9 (docs) show how to set custom input_callback 2023-10-24 17:40:59 -07:00
Krish Dholakia
b86c679e71
Merge pull request #647 from nirga/traceloop-bug
fix: bugs in traceloop integration
2023-10-24 17:38:30 -07:00
ishaan-jaff
30dd0b5c6b (docs) proxy server title 2023-10-24 17:14:57 -07:00
Krrish Dholakia
59ddda5c4b docs(token_usage.md): adding registering model via url to docs 2023-10-24 16:21:38 -07:00
Krrish Dholakia
24c1207451 docs(proxy_server.md): cli tool deprecation notice 2023-10-24 16:01:05 -07:00
ishaan-jaff
f9ff8cbfb1 (docs) update cloud run deploy link 2023-10-24 12:53:23 -07:00
ishaan-jaff
ea0c65d146 (docs) add async embeddings 2023-10-23 15:23:23 -07:00
ishaan-jaff
fbac910436 (fix) openai proxy set langfuse as callback 2023-10-23 14:42:04 -07:00
ishaan-jaff
98100be5b6 (docs) proxy server auth 2023-10-23 11:56:35 -07:00
ishaan-jaff
07b2dec580 (docs) proxy server 2023-10-23 11:45:18 -07:00
ishaan-jaff
a89e40df5e (docs) testing proxy with anthropic 2023-10-23 11:28:46 -07:00
ishaan-jaff
d37dc4a891 (docs) update sidebar 2023-10-23 11:25:57 -07:00
ishaan-jaff
42cae96a36 (docs) add azure example for testing 2023-10-23 11:25:08 -07:00
ishaan-jaff
31e44aa87e (docs) gcloud run proxy 2023-10-23 11:20:00 -07:00
ishaan-jaff
b32c211669 (docs) proxy server 2023-10-23 11:10:24 -07:00
ishaan-jaff
c33fab924f (docs) update testing proxy 2023-10-23 10:58:38 -07:00
Ishaan Jaff
e1b873a2a0
Merge pull request #673 from kevinjyee/main
Update function calling docs
2023-10-23 10:42:34 -07:00
ishaan-jaff
0b7cc4b419 (docs) testing gcp proxy 2023-10-23 10:31:01 -07:00
ishaan-jaff
af5685ba5e (docs) proxy server instructions 2023-10-23 10:10:55 -07:00
Kevin Yee
54cd10db15 Update function calling docs 2023-10-23 13:03:39 -04:00
ishaan-jaff
5b88363433 (docs) proxy server 2023-10-23 09:50:09 -07:00
ishaan-jaff
0903cdd088 (docs) proxy server 2023-10-23 09:47:06 -07:00
ishaan-jaff
c07cae58f1 (docs) proxy server 2023-10-23 09:38:09 -07:00
ishaan-jaff
98a7f37d5f (docs) set env variables on google cloud run 2023-10-23 09:36:11 -07:00
Ishaan Jaff
3c5fb92a14
Merge pull request #671 from shrikant14/aws-client-docs
Incorrect boto3 parameter name
2023-10-23 08:53:31 -07:00
ishaan-jaff
cc1ea6e3c8 (docs) proxy server 2023-10-23 08:45:42 -07:00
ishaan-jaff
d68f50785a (docs) deploy on Google cloud run 2023-10-23 08:41:50 -07:00
ishaan-jaff
959d44e8a4 (docs) add deploy to cloud run 2023-10-23 08:40:15 -07:00
shrikant
59b139f8d2 incorrect boto3 parameter name 2023-10-23 10:12:20 -05:00
Krrish Dholakia
1c2883a928 docs(simple_proxy.md): adding docs on simple deployed proxy server
n
2023-10-23 07:57:03 -07:00
Krrish Dholakia
a05e3d2d8b docs(token_usage.md): fix docs 2023-10-21 16:16:20 -07:00
Krrish Dholakia
c300ab45d4 docs(token_usage.md): fix completion cost docs 2023-10-21 16:15:11 -07:00
Krrish Dholakia
3fac512b74 docs(caching): add custom key value pairs to caching docs
b
2023-10-21 12:37:17 -07:00
ishaan-jaff
d9bba09f5d (docs) perplexity 2023-10-21 10:27:34 -07:00
Pratik date
0b51f1ecb9
Update index.md 2023-10-21 12:22:41 +05:30
ishaan-jaff
9884bbd196 (docs) perplexity ai api 2023-10-20 14:47:16 -07:00
Krrish Dholakia
0b94e968e1 docs(multiple_deployments.md): docs on how to route between multiple deployments 2023-10-20 14:30:29 -07:00
Krrish Dholakia
62d9ce6e66 docs(token_usage.md): add docs on token encoding and decoding 2023-10-20 12:10:18 -07:00
ishaan-jaff
9e25e6e6b4 (docs) add timeout param 2023-10-20 11:55:42 -07:00
Krrish Dholakia
4198901a2d docs(token_usage.md): adding new register model function 2023-10-19 18:33:53 -07:00
Prasad Chalasani
4e9b690460 proxy server: fix langroid part 2023-10-19 17:20:20 -04:00
Krrish Dholakia
41b7237c8a docs(gradio): fixing twitter handle for contributor 2023-10-19 11:37:32 -07:00
ishaan-jaff
8f13f376e4 (docs) perplexity ai provider 2023-10-19 10:02:39 -07:00
ishaan-jaff
ba0fa553b4 (docs) cleanup integrations 2023-10-19 09:40:51 -07:00
Krrish Dholakia
7967f2a82e docs(proxy_server.md): clean up docs 2023-10-19 09:33:58 -07:00
ishaan-jaff
49097c5a3d (docs) add slack callback for litellm 2023-10-19 09:32:29 -07:00
ishaan-jaff
32e1bbb793 (docs) fix sidebar js 2023-10-19 09:14:21 -07:00
Krrish Dholakia
52ff9054e4 docs(proxy_server.md): refactor docs to improve docker image tutorial 2023-10-19 09:10:07 -07:00
Krish Dholakia
5cb27d4580
Merge pull request #645 from dcruiz01/add-gradio-integration-tutorial
Tutorial for using LiteLLM within Gradio Chatbot Application
2023-10-19 08:36:46 -07:00
Nir Gazit
c21e86faec fix: bugs in traceloop integration 2023-10-19 17:23:51 +02:00
Krrish Dholakia
e0350bd0cb docs(routing.md): improve readability 2023-10-18 17:52:56 -07:00
Krrish Dholakia
8e982fcda6 docs(routing.md): cleanup 2023-10-18 17:48:11 -07:00
Krrish Dholakia
985dffe54b docs(routing.md): add proxy with multiple azure deployments to docs 2023-10-18 17:47:14 -07:00
ishaan-jaff
d59491f704 (docs) calculate cost for streaming responses 2023-10-18 17:46:37 -07:00
ishaan-jaff
0a83d1a924 (docs) add how to track costs for streaming responses 2023-10-18 17:42:55 -07:00
ZQ
47cfae618e
Update sidebars.js 2023-10-18 17:37:59 -07:00
ishaan-jaff
c8f8686d7c (docs) fix traceloop pip 2023-10-18 17:35:38 -07:00
Krrish Dholakia
2e5db47ad0 docs(routing.md): make title more clear 2023-10-18 16:39:05 -07:00
dcruiz01
b0e2992244 Added Gradio integration tutorial 2023-10-18 15:31:59 -07:00
Krrish Dholakia
07b6b2f44e docs(proxy_server.md): add librechat and smart-chatbot-ui tutorials 2023-10-18 15:30:14 -07:00
Krrish Dholakia
1ba4297d09 docs(routing.md): redis cache
n
2023-10-18 14:39:01 -07:00
Krrish Dholakia
64eeb0d421 docs(routing.md): rename routing file 2023-10-18 14:26:59 -07:00
Krrish Dholakia
bace883dcf docs(routing.md): adding router to docs 2023-10-18 14:20:53 -07:00
ishaan-jaff
44991629ab (docs) langsmith callbacks 2023-10-18 12:59:06 -07:00
ishaan-jaff
d135abbf86 (docs) advanced lagsmith usage 2023-10-18 12:56:43 -07:00
ishaan-jaff
556d3af09e (docs) add langsmith callback docs 2023-10-18 12:13:39 -07:00
Krrish Dholakia
91efd2b85f docs(index.md): show that you can iterate over streaming response 2023-10-18 11:30:11 -07:00
Krrish Dholakia
c528880021 docs(redis_cache.md): create a separate file for redis cache docs 2023-10-18 11:27:28 -07:00
Nir Gazit
4602a61c58 fixed typo in Traceloop docs 2023-10-18 19:47:19 +02:00
Nir Gazit
c5da6f36be fix: updates to traceloop docs 2023-10-18 19:37:12 +02:00
ishaan-jaff
0aa3563ccf (docs) add wandb callback 2023-10-17 18:15:58 -07:00
Krrish Dholakia
ebc34ddeb6 docs(proxy_server.md): adding perf details 2023-10-17 14:33:43 -07:00
ishaan-jaff
efe04cab5a (docs) add support & talk to founders to all docs for logging & obs 2023-10-17 14:14:46 -07:00
ishaan-jaff
cbd2c5816a (docs) add logging & observability to docs 2023-10-17 14:08:51 -07:00
Krrish Dholakia
8d56e6dad2 docs(proxy_server.md): cleanup 2023-10-17 13:30:16 -07:00
Krrish Dholakia
e2248e27e5 docs(proxy_server.md): adding chatdev tutorial to docs 2023-10-17 12:38:40 -07:00
ishaan-jaff
38671ff740 (docs) langfuse 2023-10-17 12:10:26 -07:00
ishaan-jaff
53e6ef62e7 (docs) langfuse logger 2023-10-17 12:05:30 -07:00
ishaan-jaff
e4397e7e2a (docs) langfuse callback 2023-10-17 11:59:13 -07:00
Krrish Dholakia
bf5fd640ab docs(proxy_server.md): fix docs 2023-10-17 09:28:52 -07:00
Krrish Dholakia
dcb866b353 docs(proxy_server.md): update proxy server docs to include multi-agent autogen tutorial 2023-10-17 09:22:34 -07:00
Toni Engelhardt
ff198ccce3
Verbose warning 2023-10-17 09:23:06 +01:00
ishaan-jaff
8fa9dab9fe (docs) function calling 2023-10-16 21:58:18 -07:00
ishaan-jaff
d8a5339c0b (docs) updated langfuse docs, set langfuse generation 2023-10-16 21:41:45 -07:00
Krrish Dholakia
1df487a45d docs(proxy_server): cleanup docs 2023-10-16 15:38:57 -07:00
Krrish Dholakia
529834fdf8 docs(proxy_server.md): add docs on how to self host proxy with docker image 2023-10-16 15:19:13 -07:00
ishaan-jaff
02085671a6 (docs) function calling for Non OpenAI LLMs 2023-10-16 11:27:14 -07:00
Krrish Dholakia
d0dec2f2ed docs(proxy_server.md): add perplexityai api key to docs 2023-10-15 22:53:29 -07:00
ishaan-jaff
b6aa9cb82d (docs) add function calling examples and function_to_dict 2023-10-14 18:39:30 -07:00
Krrish Dholakia
2a111cfb58 docs(custom_callback.md): improve example 2023-10-14 12:30:49 -07:00
Krrish Dholakia
087b67d753 docs(custom_callback.md): add details for how to pass additional metadata to completion call 2023-10-14 12:24:45 -07:00
Krrish Dholakia
d6f2d9b9bb docs(custom_callback.md): add details on what kwargs are passed to custom callbacks 2023-10-14 11:29:26 -07:00
Krrish Dholakia
fc757dc1b4 docs(proxy_server.md): add logs, save keys, model fallbacks, config file template to proxy server docs 2023-10-14 10:52:01 -07:00
ishaan-jaff
7641729657 (docs) update embedding docs 2023-10-14 10:27:22 -07:00
ishaan-jaff
8251e71a2a (docs) add deepinfra models + pricing 2023-10-14 10:05:06 -07:00
ishaan-jaff
81becfa2ec (docs) fix formatting 2023-10-13 21:48:24 -07:00
ishaan-jaff
680bf6f110 (docs) add example of using Azure with passing api_key, api_base, api_version 2023-10-13 21:27:01 -07:00
Krrish Dholakia
d9ddd7b338 fix(proxy_server): cleaning up print statements 2023-10-13 20:16:31 -07:00
Krrish Dholakia
d0e7c3016e docs(model_config_proxy.md): add tutorial on saving custom prompt templates for openai-compatible server 2023-10-13 16:31:02 -07:00
ishaan-jaff
3cec7fb77c (docs) langchain 2023-10-13 14:38:45 -07:00
ishaan-jaff
672ba7db14 (docs) continue dev integration 2023-10-13 14:36:40 -07:00
ishaan-jaff
ab59e250d6 (docs) add replit embedding langfuse docs 2023-10-13 14:33:29 -07:00
ishaan-jaff
cc9b0b440a (docs) proxy_server - example using continue dev 2023-10-13 14:15:43 -07:00
Krrish Dholakia
c09104e577 docs(docs): cleanup 2023-10-13 13:04:22 -07:00
ishaan-jaff
9eb8524c09 (docs) add palm to ChatLiteLLM example 2023-10-13 12:59:06 -07:00
Krrish Dholakia
8bb9be3c5a docs(proxy_server): fix code 2023-10-12 21:42:19 -07:00
Krrish Dholakia
8dc009255b fix(init.py): fix linting errors 2023-10-12 21:31:53 -07:00
ishaan-jaff
f194268b80 (docs) add example using guidance with proxy 2023-10-12 21:25:18 -07:00
ishaan-jaff
78d60f000e (docs) show where the costs are written to 2023-10-12 11:49:25 -07:00
ishaan-jaff
2453628bb3 (docs) update cost display on docs 2023-10-12 11:43:23 -07:00
ishaan-jaff
88679a6d08 (docs) import embedding on litellm hosted cache 2023-10-12 11:38:12 -07:00
ishaan-jaff
171b8fce0a (docs) add import embedding for caching example 2023-10-12 11:25:13 -07:00
Krrish Dholakia
e1ee2890b9 fix(utils): remove ui to view error message 2023-10-11 16:01:57 -07:00
ishaan-jaff
accd6eb97f (docs) move litellm proxy higher up 2023-10-11 10:54:11 -07:00
ishaan-jaff
db90f96659 (docs) add ollama higher up in litellm docs 2023-10-11 10:52:56 -07:00
ishaan-jaff
6e2e020428 (docs) ollama add mistral, code llama and llama2 2023-10-11 10:18:58 -07:00
ishaan-jaff
f84fb8c76d (docs) ollama models 2023-10-11 08:55:38 -07:00
ishaan-jaff
41cd1bbfd6 (docs) add ollama docker image 2023-10-11 08:42:03 -07:00
ishaan-jaff
2694dd34b0 (docs) new ollama_docker image 2023-10-11 08:42:03 -07:00
Krrish Dholakia
ca7e2f6a05 docs(proxy_server.md): add docker image details to docs 2023-10-11 08:28:08 -07:00
Prasad Chalasani
9fe795dc81 shorter langroid example, update section title 2023-10-11 10:48:58 -04:00
Krrish Dholakia
5a72688648 docs(proxy_server): name fix 2023-10-10 16:51:38 -07:00
Krrish Dholakia
15afa6cde9 docs(proxy_server): adding langdroid tutorial 2023-10-10 16:28:58 -07:00
Krrish Dholakia
109826e868 docs(proxy_server): fix autogen tutorial docs 2023-10-10 16:27:04 -07:00
ishaan-jaff
7125016d24 (docs) custom callback for tracking costs 2023-10-10 11:36:02 -07:00
ishaan-jaff
68b655df51 (docs) proxy_server 2023-10-10 10:38:10 -07:00
ishaan-jaff
449403e2b3 (docs) proxy_server 2023-10-10 10:26:44 -07:00
ishaan-jaff
cf580a4995 (docs) add cost tracking to proxy server 2023-10-10 10:19:15 -07:00
ishaan-jaff
2b8a8297af (docs) fix tracking end users 2023-10-10 10:04:47 -07:00
Krrish Dholakia
0d863f00ad refactor(bedrock.py): take model names from model cost dict 2023-10-10 07:35:03 -07:00
Krrish Dholakia
253e8d27db fix: bug fix when n>1 passed in 2023-10-09 16:46:33 -07:00
ishaan-jaff
2004b449e8 (docs) Proxy add tutorial on using multiple llms 2023-10-09 16:21:40 -07:00
Krrish Dholakia
46bfeddfc7 docs(stream.md): fix async streaming tutorial 2023-10-09 11:47:49 -07:00
Zeeshan Hooda
112df4a19d
(test) add bedrock existing client auth test 2023-10-09 03:39:40 -06:00
Zeeshan Hooda
f735ca7e46
(docs) bedrock pass existing client to completion 2023-10-09 01:14:53 -06:00
Krrish Dholakia
f7473638ce docs(set_keys.md): doc updates 2023-10-08 10:01:19 -07:00
Krrish Dholakia
c48c6e9358 docs(set_keys.md): adds validate_environment function to docs 2023-10-08 10:00:56 -07:00
Krrish Dholakia
a833e3f929 docs(proxy_server.md): adding /ollama_logs endpoint to docs 2023-10-07 20:38:19 -07:00
Krrish Dholakia
10ad137b2e docs(telemetry): add telemetry to docs 2023-10-07 17:49:42 -07:00
Krrish Dholakia
51e5e2b8d5 docs(proxy_server): doc cleanup 2023-10-07 17:29:04 -07:00
Krrish Dholakia
f6a48946b9 docs(custom-callback): return complete streaming response to custom callback 2023-10-07 15:54:52 -07:00
ishaan-jaff
42c363073b (docs) pass aws_access_key_id etc to completion 2023-10-07 15:49:28 -07:00
ishaan-jaff
f941975a78 (docs) with github 2023-10-07 15:38:36 -07:00
ishaan-jaff
286cb993a4 (docs) bedrock 2023-10-07 15:31:40 -07:00
ishaan-jaff
a67a531507 (docs) bedrock 2023-10-07 15:29:38 -07:00
Krrish Dholakia
86a835f6fd docs(callbacks.md): add input callback to the callback docs 2023-10-07 14:21:30 -07:00
Krrish Dholakia
ab8093118b docs(adding-litellm-proxy-config-to-docs): adding litellm proxy config to docs 2023-10-07 14:14:05 -07:00
Krrish Dholakia
78e413675e docs(completion-docs): add ollama provider specific settings 2023-10-07 13:53:01 -07:00
Krrish Dholakia
d69038883c docs(completion-docs): adds more details on provider-specific params 2023-10-07 13:49:30 -07:00
ishaan-jaff
aa615fea4f (docs) azure 2023-10-07 13:41:18 -07:00
ishaan-jaff
160e0e092a (docs) azure openai 2023-10-07 13:36:35 -07:00
ishaan-jaff
2bdf16dac9 (docs) azure 2023-10-07 13:22:31 -07:00
ishaan-jaff
37454cf874 (docs) update azure docs 2023-10-07 12:08:19 -07:00
ishaan-jaff
66dd747f68 (docs) update index.md on docs.litellm.ai 2023-10-07 11:44:21 -07:00
Krrish Dholakia
b90f352736 docs(docs.md): cleanup litellm api docs 2023-10-07 10:58:14 -07:00
ishaan-jaff
d42cd8fa07 docs(rate limit aware acompletion calls): docs 2023-10-06 20:48:53 -07:00
Krrish Dholakia
306a38880d feat(ollama.py): exposing ollama config 2023-10-06 15:52:58 -07:00
ishaan-jaff
868c1c594f docs(openrouter): add to getting started 2023-10-06 10:22:02 -07:00
ishaan-jaff
da8c2c4184 update docs using OR 2023-10-06 09:49:00 -07:00
Krrish Dholakia
296f7f5b76 docs(completion-docs): adding table for prompt formatting 2023-10-06 07:48:37 -07:00
Krrish Dholakia
dd7e397650 style(test_completion.py): fix merge conflict 2023-10-05 22:09:38 -07:00
ishaan-jaff
8b9f30038d docs(llmonitor callback): 2023-10-05 19:34:09 -07:00
Krrish Dholakia
a724d4bed2 docs(added-migration-to-docs): added migration guide to docs 2023-10-05 11:43:54 -07:00
Krrish Dholakia
ed31860206 adding custom prompt templates to ollama 2023-10-05 10:48:16 -07:00
Akash Kundu
c4c2d18128
[docs] minor typo correction
Just a small typo on the langchain tutorial.
2023-10-05 18:06:34 +05:30
ishaan-jaff
5c55011888 docs 2023-10-04 16:14:09 -07:00
ishaan-jaff
6d1749c687 remove api key from output docs 2023-10-04 16:07:44 -07:00
ishaan-jaff
7e9aae363d add rate limit manager to docs 2023-10-04 16:03:58 -07:00
ishaan-jaff
a7a88867ff docs fix 2023-10-04 14:46:11 -07:00
ishaan-jaff
c4a595d352 add batch completion rate limits docs 2023-10-04 14:46:11 -07:00
Krrish Dholakia
69a0a775f8 update docs 2023-10-04 11:30:54 -07:00
ishaan-jaff
0f7256533f docs update 2023-10-04 10:20:08 -07:00