Commit Graph

1159 Commits

Author SHA1 Message Date
ishaan-jaff
4316477276 (docs) embedding 2023-12-16 12:44:21 +05:30
Krrish Dholakia
5b4ca42de6 docs(routing.md): add docs on using caching groups across deployments 2023-12-15 21:51:59 -08:00
ishaan-jaff
bb930b6660 (docs) dynamodb 2023-12-15 21:39:12 +05:30
ishaan-jaff
ae10299058 (docs) dynamo 2023-12-15 18:20:15 +05:30
ishaan-jaff
0f4fa487a5 (docs) dynamodb 2023-12-15 17:32:21 +05:30
ishaan-jaff
eaf4182966 (docs) log proxy i/o to dynamoDB 2023-12-15 15:59:06 +05:30
ishaan-jaff
e170d66991 docs - caching 2023-12-15 14:16:34 +05:30
ishaan-jaff
b9ff8d74ea (docs) deploy on gcp cloud run 2023-12-15 08:50:00 +05:30
Janaka Abeywardhana
53eedbf0ee docs(projects): add Docq.AI to side bar nav 2023-12-15 07:54:34 +05:30
Ishaan Jaff
624d00c5a8
Merge pull request #1142 from janaka/janaka/docs/add-docqai-to-projects
add Docq to projects section.
2023-12-15 07:38:54 +05:30
ishaan-jaff
ca0d8139ec (docs) proxy - deploy on GCP cloud run 2023-12-15 07:29:35 +05:30
Krrish Dholakia
7df9c8e4d8 docs(proxy_server.md): fix old doc links 2023-12-14 12:07:51 -08:00
Krrish Dholakia
52564b685c docs(openai_compatible.md): add docs on calling openai compatible endpoints via litellm pkg 2023-12-14 12:03:29 -08:00
Krrish Dholakia
d7b49dbc41 docs(call_hooks.md): add docs on pre-call hooks 2023-12-14 11:34:37 -08:00
Krrish Dholakia
589a6ca863 docs(redis_cache.md-+-custom_callbacks.md): add cache hit logging info in docs 2023-12-14 11:07:00 -08:00
Krrish Dholakia
0f14fb3797 docs(custom_callback.md): add async failure + streaming logging events to docs
https://github.com/BerriAI/litellm/issues/1125
2023-12-14 10:46:53 -08:00
ishaan-jaff
72a665591d (docs) cache init params 2023-12-14 22:41:25 +05:30
ishaan-jaff
a033016a63 (docs) mistral ai api 2023-12-14 18:49:37 +05:30
Janaka Abeywardhana
aee1f3143d add Docq to projects section. 2023-12-14 17:32:58 +05:30
ishaan-jaff
43fc152a91 (docs) caching - proxy 2023-12-14 16:33:56 +05:30
Krrish Dholakia
73ecc012a9 docs(embedding.md): add embedding docs to proxy 2023-12-13 18:58:46 -08:00
Krish Dholakia
03d6dcefbb
Merge pull request #1123 from nirga/patch-1
fix: traceloop links
2023-12-13 14:52:11 -08:00
Krrish Dholakia
88d09fc5a7 fix(vertex.md): adding gemini-pro support to docs 2023-12-13 14:38:55 -08:00
Nir Gazit
590f0173bc
fix: traceloop links 2023-12-13 22:23:29 +01:00
ishaan-jaff
7856d65d44 (docs) proxy dockerfile 2023-12-12 19:44:55 -08:00
ishaan-jaff
03edba5ff5 (docs) router on config 2023-12-12 19:41:11 -08:00
ishaan-jaff
c294d2c506 (docs) proxy - how to set router_settings 2023-12-12 19:35:21 -08:00
Cam Parry
30faef5052
rebase and docs 2023-12-13 09:30:14 +10:00
Krrish Dholakia
80821f62d1 docs(logging.md): add sentry logging to proxy docs 2023-12-09 23:03:48 -08:00
Krrish Dholakia
149c1b3557 docs(configs.md): added docs on how to configure routing strategy on proxy 2023-12-09 16:31:31 -08:00
ishaan-jaff
adbdb31b9d (docs) proxy caching 2023-12-09 15:56:57 -08:00
ishaan-jaff
9e9781d193 (Docs) Proxy,remove traceloop api key req 2023-12-08 19:26:05 -08:00
ishaan-jaff
dface6a36f (docs) traceloop 2023-12-08 18:47:18 -08:00
ishaan-jaff
0dc7d538b5 (docs) proxy - OTEL + traceloop 2023-12-08 18:39:52 -08:00
ishaan-jaff
b84f6670ea (docs) custom callbacks proxy 2023-12-08 18:00:58 -08:00
ishaan-jaff
34428a8e67 (docs) fix 2023-12-08 17:25:05 -08:00
ishaan-jaff
977bfaaab9 (docs) proxy - get model_info,server_request 2023-12-08 14:57:29 -08:00
Krrish Dholakia
2ede903f0b docs: fix imports 2023-12-08 07:39:13 -08:00
Krrish Dholakia
d548836903 docs: add proxy req/s 2023-12-08 07:33:33 -08:00
Krrish Dholakia
0406e01c6d docs(deploy.md): add proxy perf to docs 2023-12-08 07:32:23 -08:00
Krrish Dholakia
e5638e2c5d fix(router.py): fix default caching response value 2023-12-07 13:44:31 -08:00
Krrish Dholakia
7585b58d2d docs: sagemaker embedding model added to docs 2023-12-07 11:42:51 -08:00
Krrish Dholakia
db12ca4ecb docs(bedrock.md): add cohere embeddings to bedrock docs 2023-12-07 11:35:08 -08:00
Krrish Dholakia
2134285523 docs(quick_start.md): adding gunicorn worker script to docs 2023-12-07 11:31:54 -08:00
Krrish Dholakia
d77e0cc716 docs(config.md): adding docs on parallel request rate limiting 2023-12-07 11:27:48 -08:00
Krrish Dholakia
c7aaa4adf8 docs(deploy.md): add docker instructions to deploy docs 2023-12-07 09:22:54 -08:00
Krrish Dholakia
d18a5e8a11 docs(quick_start.md): adding langchain embedding tutorials to docs 2023-12-06 23:14:02 -08:00
ishaan-jaff
8cd9f18b61 (docs) add async success + fail custom logger 2023-12-06 17:24:39 -08:00
Krrish Dholakia
caac4f1779 docs(virtual_keys.md): fix import line 2023-12-06 15:12:23 -08:00
ishaan-jaff
cf1df8204e (docs) proxy - custom async func 2023-12-06 15:04:24 -08:00
ishaan-jaff
0ea6241d3e (docs) use async callback functions 2023-12-06 15:00:16 -08:00
Krrish Dholakia
f6546076b0 docs(quick_start.md): add docs on calling openai-compatible endpoint on proxy 2023-12-06 11:06:09 -08:00
Krrish Dholakia
37251d327d docs(virtual_keys.md): add custom auth to docs 2023-12-06 10:29:52 -08:00
Ayush Somani
f0df1fade7
(docs) update docs 2023-12-06 10:38:52 +05:30
Ayush Somani
0bf3de0a01
(docs) update docker compose docs 2023-12-06 10:37:45 +05:30
Ayush Somani
b0fcc5af67
Merge branch 'main' into main 2023-12-06 10:32:59 +05:30
Krrish Dholakia
e4fae5a3e8 docs(aws_sagemaker.md): support for all huggingface/jumpstart modelsn 2023-12-05 16:59:37 -08:00
Krrish Dholakia
1addaecf48 docs(aws_sagemaker.md): add hf_model_name to sagemaker docs 2023-12-05 16:58:19 -08:00
Krrish Dholakia
ff949490de docs(input.md): add hf_model_name to docs 2023-12-05 16:56:18 -08:00
Krrish Dholakia
68ca2a28d4 docs: adds redis url to router + proxy docs 2023-12-05 15:08:00 -08:00
ishaan-jaff
4f9f53f7dc (docs) proxy: config example with langchain 2023-12-05 12:20:42 -08:00
ishaan-jaff
e615f2670a (docs) proxy + configs 2023-12-05 12:02:35 -08:00
ishaan-jaff
a85a9d7e00 (docs) using proxy with curl, OpenAI, langchain 2023-12-05 11:55:02 -08:00
ishaan-jaff
41075dc977 (docs) litellm proxy + langchain 2023-12-05 11:46:42 -08:00
ishaan-jaff
f0c704f3c2 (docs) add example on using proxy with OpenAI 2023-12-05 11:45:35 -08:00
ishaan-jaff
05f585153f (docs) add health check on load balancing 2023-12-04 18:01:21 -08:00
ishaan-jaff
acd1678d14 (docs) router 2023-12-04 17:51:31 -08:00
ishaan-jaff
3f541fe999 (docs) custom timeouts proxy 2023-12-04 17:37:09 -08:00
Krrish Dholakia
7adb8f493d docs(custom_callback.md): add async callbacks to docs 2023-12-04 17:01:46 -08:00
Krish Dholakia
b90fcbdac4
Merge pull request #970 from nbaldwin98/fixing-replicate-sys-prompt
fix system prompts for replicate
2023-12-04 16:39:44 -08:00
ishaan-jaff
bbdfd143b8 (docs) input 2023-12-04 15:47:27 -08:00
ishaan-jaff
74d520b1b5 (docs) sagemaker - clarify max tokens 2023-12-04 15:15:39 -08:00
ishaan-jaff
6f8765125b (docs) embedding: add api_base for HF 2023-12-04 11:57:41 -08:00
ishaan-jaff
333e77d161 (docs) custom logger 2023-12-04 11:44:12 -08:00
ishaan-jaff
533b5bcc44 (docs) clean up proxy logging 2023-12-04 11:37:15 -08:00
ishaan-jaff
85ac2b179a (docs) custom logger: proxy 2023-12-04 11:30:09 -08:00
ishaan-jaff
c5b92837c2 (docs) custom callbacks proxy 2023-12-04 11:20:27 -08:00
Krrish Dholakia
31d9762b50 fix(model_management.md): add docs on model management on proxy 2023-12-04 09:36:45 -08:00
ishaan-jaff
f2625bca24 (docs) quick start proxy 2023-12-04 08:07:05 -08:00
Ayush Somani
7d2078d89f
(docs) update docker compose guide 2023-12-03 12:29:18 +05:30
Ayush Somani
28bd076579
(docs) add docker compose guide 2023-12-03 12:28:28 +05:30
Krrish Dholakia
6b1b1b82cf fix(proxy_server.py): hash keys 2023-12-02 19:30:03 -08:00
ishaan-jaff
a4c9e18eb5 (docs) proxy quick start 2023-12-02 19:02:41 -08:00
ishaan-jaff
038433f0ad (docs) litellm 2023-12-02 18:58:24 -08:00
ishaan-jaff
a67240e67f (docs) proxy config with docker 2023-12-02 18:50:50 -08:00
ishaan-jaff
deb6162e78 (docs) proxy 2023-12-02 14:41:17 -08:00
ishaan-jaff
a8e351e195 (docs) proxy 2023-12-02 14:40:20 -08:00
ishaan-jaff
a286256d19 (docs) proxy 2023-12-02 14:36:14 -08:00
ishaan-jaff
d74d1707d4 (docs) proxy: logging 2023-12-02 14:27:16 -08:00
ishaan-jaff
2587749323 (docs) proxy 2023-12-02 14:24:40 -08:00
ishaan-jaff
278ef6bd83 (docs) refactor litellm proxy docs to use a hierarchy 2023-12-02 14:09:39 -08:00
David Manouchehri
7c974bdc57
(docs) Mention Neon as a database option. 2023-12-02 15:15:54 -05:00
ishaan-jaff
da78fd617c (docs) proxy: OTEL 2023-12-02 11:56:02 -08:00
ishaan-jaff
30e34e62d0 (docs) proxy otel 2023-12-02 11:11:16 -08:00
ishaan-jaff
7f28333ad8 (docs) simple proxy 2023-12-02 10:42:12 -08:00
ishaan-jaff
278ab7dcab (docs) otel collector 2023-12-01 21:46:37 -08:00
ishaan-jaff
8b6c4918fd (docs) OTEL simple proxy 2023-12-01 21:28:46 -08:00
Krrish Dholakia
47730da262 fix(proxy_server.py): fix linting errors 2023-12-01 20:40:49 -08:00
Krrish Dholakia
ccd10b07a8 docs(secret.md): add azure key vault support to docs 2023-12-01 20:07:20 -08:00
chabala98
c2e2e927fb fix system prompts for replicate 2023-12-01 13:16:35 +01:00
Frank Colson
6fb178dc94 Update docs 2023-11-30 16:43:09 -07:00
ishaan-jaff
8c1a9f1c4e (feat) add bedrock:llama2-70bchat 2023-11-30 14:41:19 -08:00
ishaan-jaff
cc0df56bd6 (chore) remove old doc -> this is now Router 2023-11-30 13:33:17 -08:00
ishaan-jaff
908c32c9c1 (docs) librechat + proxy 2023-11-30 10:47:16 -08:00
ishaan-jaff
fe6ff7cf10 (docs) proxy + librechat 2023-11-30 10:46:48 -08:00
Krrish Dholakia
aea74758e6 docs(simple_proxy.md): improve librechat tutorial 2023-11-30 10:19:18 -08:00
Krrish Dholakia
3d850337a2 docs(routing.md): shoutout sweep on load balancing docs 2023-11-30 09:35:28 -08:00
ishaan-jaff
cbc358ef77 (docs) proxy: Render deploys 2023-11-30 09:21:07 -08:00
Rishab Mallick
5693626ba5 docs: adds gpt-3.5-turbo-1106 in supported models 2023-11-30 13:32:51 +05:30
ishaan-jaff
9331f67c69 (docs) add pplx-online 2023-11-29 21:18:42 -08:00
Krrish Dholakia
03fb143a87 docs(simple_proxy.md): adding librechat tutorial to docs 2023-11-29 21:03:17 -08:00
ishaan-jaff
c1914a01bc (docs) routing 2023-11-29 18:09:39 -08:00
ishaan-jaff
f299120394 (docs) router 2023-11-29 18:08:00 -08:00
ishaan-jaff
69eca78000 (docs) simple proxy 2023-11-29 16:44:40 -08:00
ishaan-jaff
4b78481fbd (docs) simple proxy 2023-11-29 16:38:36 -08:00
ishaan-jaff
2d0432c5b7 (docs) simple proxy 2023-11-29 16:36:07 -08:00
ishaan-jaff
3b89cff65e (docs) simple proxy 2023-11-29 16:33:00 -08:00
ishaan-jaff
032cd0121b (docs) simple proxy 2023-11-29 16:31:08 -08:00
Krrish Dholakia
cd2883065a docs(stream.md): add stream chunk builder helper function to docs 2023-11-28 08:58:35 -08:00
ishaan-jaff
30b80afe31 (docs) fix local debugging 2023-11-28 08:49:14 -08:00
ishaan-jaff
d7dd9f0307 (docs) health check proxy llms 2023-11-27 12:20:15 -08:00
ishaan-jaff
f54c4ee4b8 (docs) sagemaker add chat llms 2023-11-27 10:24:32 -08:00
Krrish Dholakia
59ba1560e5 fix(router.py): fix fallbacks 2023-11-25 19:34:20 -08:00
Krrish Dholakia
ec81b393e2 fix(utils.py): fix linting erros 2023-11-25 14:14:46 -08:00
Krrish Dholakia
69a3b6b8cf docs(simple_proxy.md): improve loading key from vault example 2023-11-25 12:18:35 -08:00
Krrish Dholakia
f9ac71a45a docs(simple_proxy.md): add loading api keys from key vault to proxy docs 2023-11-25 12:15:11 -08:00
ishaan-jaff
c9fdf25c94 (docs) proxy embedding config 2023-11-25 12:14:19 -08:00
ishaan-jaff
f3fff173d2 (docs) custom openai embedding model config 2023-11-25 12:11:25 -08:00
ishaan-jaff
62d8f9ad2a (docs) simple proxy - reorder configs 2023-11-25 11:59:57 -08:00
ishaan-jaff
c12d6c3fe8 (docs) custom openai embedding 2023-11-25 11:52:59 -08:00
Krrish Dholakia
7cf029d677 docs(simple_proxy.md): update simple proxy docs 2023-11-25 10:18:40 -08:00
ishaan-jaff
1c5b3ad764 (docs) proxy 2023-11-24 17:09:38 -08:00
ishaan-jaff
111c7afaca (docs) proxy performance 2023-11-24 17:07:46 -08:00
Krrish Dholakia
fe900966c1 docs(simple_proxy.md): adding tracking spend via proxy to docs 2023-11-24 15:41:52 -08:00
Krrish Dholakia
2b52e6995c docs(perplexity.md): fix model list
https://github.com/BerriAI/litellm/issues/908
2023-11-24 14:14:47 -08:00
Krrish Dholakia
f1dbdb58bb docs(simple_proxy.md): add cooldown to docs 2023-11-24 13:37:16 -08:00
Krrish Dholakia
12dbdc4c15 docs(simple_proxy.md): add tutorial for doing fallbacks + retries + timeouts on the proxy 2023-11-24 12:20:38 -08:00
Kumaran Rajendhiran
79569e4f2c Fix wrong model mentioned in simple proxy doc page 2023-11-24 19:46:35 +05:30
Krrish Dholakia
f24786095a fix(vertex_ai.py): fix exception mapping for vertex ai 2023-11-23 17:35:33 -08:00
Krrish Dholakia
2cc6acdeec docs(routing.md): add docs on fallbacks, caching, retries, timeouts for router 2023-11-23 17:17:18 -08:00
Krrish Dholakia
abe2a009f9 test(test_completion.py): fix azure read from env variable test 2023-11-23 16:58:07 -08:00
ishaan-jaff
65d978622d (docs) proxy 2023-11-23 11:46:59 -08:00
Krrish Dholakia
276041e3bb docs(routing.md): updating routing docs to include cooldown info 2023-11-23 11:27:22 -08:00
Krrish Dholakia
61fc76a8c4 fix(router.py): fix caching for tracking cooldowns + usage 2023-11-23 11:13:32 -08:00
ishaan-jaff
94c1d71b2c (docs) proxy server 2023-11-23 11:13:26 -08:00
ishaan-jaff
28a192df3a (docs) simple proxy 2023-11-23 11:10:50 -08:00
ishaan-jaff
71042ee345 (docs) caching 2023-11-23 10:40:32 -08:00
ishaan-jaff
efe6fb8831 (docs) proxy server caching 2023-11-23 10:35:34 -08:00
ishaan-jaff
b15b723567 (docs) proxy server: add caching 2023-11-23 08:08:12 -08:00
ishaan-jaff
44e867499f (docs) proxy 2023-11-23 07:55:12 -08:00