Commit Graph

1276 Commits

Author SHA1 Message Date
Krrish Dholakia
d6361e155a docs(deploy.md): update docs for deploying proxy with connected db 2024-01-09 13:34:47 +05:30
Krrish Dholakia
11b6c66609 docs(gemini.md): fix docs 2024-01-09 09:38:04 +05:30
HeavenHM
fa9d0faf13
Update gemini.md
Added example for Gemini Vision Pro
2024-01-09 08:00:51 +05:30
ishaan-jaff
fa74831d79 (docs) control proxy debug using env vars 2024-01-08 16:15:33 +05:30
Ishaan Jaff
a70626d6e9
Merge pull request #1356 from BerriAI/litellm_improve_proxy_logs
[Feat] Improve Proxy Logging
2024-01-08 14:41:01 +05:30
ishaan-jaff
c5589e71e7 (docs) proxy, show users how to use detailed_debug 2024-01-08 12:58:23 +05:30
Krrish Dholakia
c720870f80 docs(gemini.md,-deploy.md): doc updates 2024-01-08 11:02:12 +05:30
Krish Dholakia
4ea3e778f7
Merge pull request #1315 from spdustin/feature_allow_claude_prefill
Adds "pre-fill" support for Claude
2024-01-08 10:48:15 +05:30
ishaan-jaff
7611081d55 (docs) caching + proxy 2024-01-06 15:46:53 +05:30
Krrish Dholakia
b51d98c6e3 docs: fix pip install litellm[proxy] instruction 2024-01-06 13:49:15 +05:30
Krrish Dholakia
e9350ad010 docs(quick_start.md): add ollama to proxy docs 2024-01-06 10:56:25 +05:30
spdustin@gmail.com
ccc0722a80 Add Claude 2.1 to Bedrock support table 2024-01-05 23:08:23 +00:00
spdustin@gmail.com
767679ffcf Add/fix samples for Claude pre-fill and system messages 2024-01-05 23:04:17 +00:00
spdustin@gmail.com
5d074f5b56 Adds tests and updates docs for Claude "pre-fill" 2024-01-05 22:58:41 +00:00
Krrish Dholakia
b0827a87b2 fix(caching.py): support s-maxage param for cache controls 2024-01-04 11:41:23 +05:30
Krrish Dholakia
4946b1ef6d docs(docs/index.md): add proxy details to docs 2024-01-04 11:20:43 +05:30
Krrish Dholakia
0f7d03f761 fix(proxy/rules.md): add docs on setting post-call rules on the proxy 2024-01-04 11:16:50 +05:30
ishaan-jaff
b103ab1f0b (docs) proxy - caching 2024-01-03 18:02:14 +05:30
ishaan-jaff
30c6d164d2 (docs) use s3 Cache on litellm proxy 2024-01-03 17:56:44 +05:30
ishaan-jaff
f9139e05e8 (docs) proxy - cachig 2024-01-03 17:56:44 +05:30
ishaan-jaff
64a0c175d5 (docs) simplify caching docs 2024-01-03 16:21:23 +05:30
ishaan-jaff
8bfaee9654 (docs) simplify caching docs 2024-01-03 16:20:19 +05:30
ishaan-jaff
344e8d8508 (docs) s3 cache 2024-01-03 16:16:18 +05:30
ishaan-jaff
cc29860785 (docs) s3 Cache 2024-01-03 15:42:23 +05:30
Krrish Dholakia
6c8cc33d02 docs(caching.md): fix typo 2024-01-03 12:47:16 +05:30
Krrish Dholakia
8cee267a5b fix(caching.py): support ttl, s-max-age, and no-cache cache controls
https://github.com/BerriAI/litellm/issues/1306
2024-01-03 12:42:43 +05:30
Krrish Dholakia
5055aeb254 docs(alerting.md): add alerting thresholds to docs 2024-01-03 11:21:56 +05:30
Krrish Dholakia
ff4eb5a5d4 docs(alerting.md): add slack alerting to docs 2024-01-02 22:47:01 +05:30
Krrish Dholakia
d17ffdbc83 docs(ui.md): update ui docs to for smtp server hosting 2024-01-02 22:30:17 +05:30
ishaan-jaff
8186af64c7 (docs) xinference on proxy 2024-01-02 16:57:25 +05:30
ishaan-jaff
8f8ac03961 (docs) proxy - using xinference 2024-01-02 16:55:10 +05:30
ishaan-jaff
fdd4e72503 (docs) xinference embedding 2024-01-02 15:39:25 +05:30
ishaan-jaff
0d0ee9e108 (docs) passing user config 2024-01-02 14:43:02 +05:30
ishaan-jaff
1efd1cb30f (docs) passing user_config to completion 2024-01-02 14:19:44 +05:30
ishaan-jaff
60164cd5e4 (docs) pass user config to proxy / router 2024-01-02 14:14:14 +05:30
ishaan-jaff
11f92c0074 (docs) router- init params 2024-01-02 12:14:32 +05:30
Krrish Dholakia
95f850fecc docs(ui.md): add docs on self serve ui flow 2024-01-01 18:25:52 +05:30
Krrish Dholakia
61cd800b9f fix(ui/admin.py): handles trailing '/' case 2024-01-01 17:49:54 +05:30
ishaan-jaff
20236c1c69 (docs) proxy 2024-01-01 12:40:12 +05:30
ishaan-jaff
a98d752f7b (docs) use embeddings with proxy 2024-01-01 12:31:24 +05:30
ishaan-jaff
cf902a53b4 (docs) using /embeddings with Proxy 2024-01-01 12:31:13 +05:30
ishaan-jaff
21cccd02e8 (docs) langfuse + langchain log metadata 2024-01-01 11:53:38 +05:30
ishaan-jaff
a549962f14 (docs) request/response format 2024-01-01 11:52:47 +05:30
ishaan-jaff
76f9c8cc8f (docs) request/response format proxy 2024-01-01 11:52:30 +05:30
ishaan-jaff
8b29f9a48b (docs) pass metatadata to proxy + openai client 2024-01-01 11:12:31 +05:30
ishaan-jaff
5b9973136e (docs) langfuse + proxy - log metadata 2024-01-01 11:03:00 +05:30
Krrish Dholakia
d0d08b4dce docs(routing.md): adding latency-based routing to docs 2024-01-01 08:36:40 +05:30
ishaan-jaff
c269c65371 (docs) langfuse log trace id, trace user id 2023-12-30 20:25:23 +05:30
ishaan-jaff
bf4a9f40e8 (docs) cache context manager 2023-12-30 19:50:22 +05:30
ishaan-jaff
1c93642951 (docs) caching use context manager 2023-12-30 19:43:26 +05:30
ishaan-jaff
231148ed73 (docs) caching 2023-12-30 19:04:36 +05:30
ishaan-jaff
7ecd7b3e8d (docs) proxy - timeout per request 2023-12-30 11:18:03 +05:30
ishaan-jaff
6252987798 (docs) proxy - set timeout per request 2023-12-30 11:17:31 +05:30
Krrish Dholakia
1f76b0e721 docs(routing.md): add retry_after to docs 2023-12-29 15:22:12 +05:30
Krrish Dholakia
1e07f0fce8 fix(caching.py): hash the cache key to prevent key too long errors 2023-12-29 15:03:33 +05:30
Krrish Dholakia
6e68cd1125 docs(load_test.md): add litellm load test script to docs 2023-12-29 13:41:44 +05:30
ishaan-jaff
52a9696303 (docs) cloudflare 2023-12-29 12:10:32 +05:30
Krrish Dholakia
a351211d03 docs(users.md): add user rate limits to docs 2023-12-28 19:28:32 +05:30
ishaan-jaff
a1484171b5 (docs) voyage ai embeddings 2023-12-28 17:15:16 +05:30
ishaan-jaff
aa2bd93166 (docs) add voyage ai 2023-12-28 17:12:58 +05:30
ishaan-jaff
01f7e85057 (docs) add mistral embeddings 2023-12-28 16:54:26 +05:30
ishaan-jaff
7f74a0331c (docs) add mistral-embed 2023-12-28 16:50:52 +05:30
ishaan-jaff
ab306ad5d4 (docs) deploy on railway 2023-12-28 16:35:18 +05:30
Krrish Dholakia
2f012a5088 docs(streaming_logging.md): custom streaming logging tutorial 2023-12-28 13:49:41 +05:30
ishaan-jaff
cf236a4141 (docs) add link to swagger docs 2023-12-28 12:06:46 +05:30
ishaan-jaff
b03c985a4c (docs) proxy - add link to swagger docs 2023-12-28 12:06:46 +05:30
Krrish Dholakia
7ce7516621 docs(user_keys.md): improve user keys docs 2023-12-28 07:02:28 +05:30
Krrish Dholakia
3026e5aa58 docs(image_generation.md): fix typo 2023-12-27 20:33:22 +05:30
Krrish Dholakia
b437260ece docs(users.md): set budgets per user docs 2023-12-27 20:30:27 +05:30
ishaan-jaff
0bf2b56c0f (docs) proxy 2023-12-27 17:14:42 +05:30
ishaan-jaff
eb2fc42b4c (docs) - use vertex ai with proxy cli 2023-12-27 17:12:51 +05:30
Krrish Dholakia
f8180c351f docs(image_generation.md): add image generation to docs 2023-12-27 11:59:57 +05:30
Prateek Sachan
940c33680e updating anyscale link to latest json present in main branch 2023-12-27 01:41:17 +05:30
Prateek Sachan
2acafb7d31 updating anyscale link to latest json present in main branch 2023-12-27 01:37:21 +05:30
Krrish Dholakia
31fbb095c2 docs(user_keys.md): update code example 2023-12-26 22:16:18 +05:30
Krrish Dholakia
1b837e9601 docs(caching.md): add cache controls to docs 2023-12-26 17:54:14 +05:30
ishaan-jaff
a5f998375c (docs) use latest ghcr image 2023-12-26 17:28:39 +05:30
ishaan-jaff
112ffa3596 (docs) add logprobs, top_logprobs 2023-12-26 14:53:30 +05:30
ishaan-jaff
f3844b309f (docs) input params - add logprobs, top_logprobs 2023-12-26 14:41:33 +05:30
ishaan-jaff
b2e69cbc24 (docs) input params 2023-12-26 14:36:19 +05:30
Krrish Dholakia
871f207124 docs(user_keys.md): docs on passing user keys to litellm proxy 2023-12-26 13:55:28 +05:30
ishaan-jaff
08ed509b76 (docs) azure gpt-4 vision 2023-12-26 13:18:38 +05:30
ishaan-jaff
05b9b3aacd (docs) bump langfuse to >= 2.0.0 2023-12-26 09:23:45 +05:30
ishaan-jaff
0db0652ad3 (docs) ollama api/chat 2023-12-26 00:05:16 +05:30
Krrish Dholakia
b3a98d8400 fix(proxy_server.py): accept keys with none duration 2023-12-25 13:46:24 +05:30
ishaan-jaff
485f05ea02 (docs) ollama/json mode 2023-12-25 13:31:01 +05:30
Krrish Dholakia
c568bb6cac docs(virtual_keys.md): add budget manager docs to proxy 2023-12-23 09:48:53 +05:30
Krrish Dholakia
97f6475035 docs(health.md): add docs on health checks for embedding models 2023-12-21 07:54:04 +05:30
ishaan-jaff
f6407aaf74 (docs) add metadata keys/generate 2023-12-21 07:43:53 +05:30
ishaan-jaff
fbab7371dc (docs) proxy - virtual keys 2023-12-21 07:36:32 +05:30
ishaan-jaff
bab8f3350d (docs) openrouter 2023-12-20 13:42:49 +05:30
ishaan-jaff
7d20ea23d1 (docs) set openrouter params 2023-12-20 13:42:49 +05:30
Ishaan Jaff
9fa2fe0c37
Merge pull request #1185 from navidre/prevent_key_log_documentation
Sample code to prevent logging API key in callback to Slack
2023-12-20 09:09:10 +05:30
ishaan-jaff
cd34b859df (docs) swagger endpoint 2023-12-20 05:49:45 +05:30
navidre
b8d7cafb8d
Sample code to prevent logging API key
Sample code in documentation to prevent logging API key. Ideally should be implemented in the codebase if not already
2023-12-19 14:04:20 -06:00
ishaan-jaff
9eb487efb3 (docs) exception mapping 2023-12-19 19:29:05 +05:30
ishaan-jaff
8b0fa2322c (docs) exception mapping azure openai 2023-12-19 19:23:52 +05:30
ishaan-jaff
dbcff752b3 (docs) exception mapping - add more details 2023-12-19 19:22:51 +05:30
ishaan-jaff
84fde01461 (fix) docs proxy + auth curl request 2023-12-19 19:11:35 +05:30
ishaan-jaff
b82fcd51d7 (docs) ollama/llava 2023-12-19 11:32:28 +05:30
Krrish Dholakia
f73c4b494c docs(model_management.md): adding docs on how to add model metadata in the config.yaml 2023-12-18 17:57:29 -08:00
Krish Dholakia
6edc7cc2b3
Merge pull request #1178 from speedyankur/langfuse-doc-update
doc: updated langfuse ver 1.14 in pip install cmd
2023-12-18 17:33:29 -08:00
Ankur Garha
d6ed13fa4f doc: updated langfuse ver 1.14 in pip install cmd 2023-12-18 22:56:08 +01:00
Eric Ma
8ec7e25c06
Update mistral.md
Eliminated typo with extra quotation mark.
2023-12-17 23:51:02 -05:00
Krish Dholakia
c703fb2f2c
Merge pull request #1162 from nirga/patch-2
clarify the need to set an exporter
2023-12-16 21:31:56 -08:00
Yusuke Kawabata
de8a3d5369
fix curl example
Remove unnecessary `,` from curl example
2023-12-17 12:00:06 +09:00
Nir Gazit
4dc774ab8e
clarify the need to set an exporter 2023-12-16 22:19:07 +01:00
Krrish Dholakia
4e828ff541 fix(health.md): add background health check details to docs 2023-12-16 10:31:59 -08:00
Krish Dholakia
50f61bcea4
Merge pull request #1157 from nanowell/patch-1
Update mistral.md
2023-12-16 08:56:39 -08:00
ishaan-jaff
c33cbbe068 (docs) - gemini-pro-visio n 2023-12-16 22:18:30 +05:30
nanowell
9f762bbd5b
Update mistral.md
Incorrect syntax
2023-12-16 17:51:41 +03:00
ishaan-jaff
cb34c3c3f3 (docs) gemini pro vison 2023-12-16 19:20:57 +05:30
ishaan-jaff
6f643a6107 (docs) add gemini-pro-vision 2023-12-16 19:07:36 +05:30
ishaan-jaff
7b851a3870 (docs) cache params 2023-12-16 14:45:19 +05:30
ishaan-jaff
80bf99b1af (docs) proxy - advanced caching 2023-12-16 13:52:58 +05:30
ishaan-jaff
a04f43ef38 (docs) proxy: embeddings 2023-12-16 13:29:26 +05:30
ishaan-jaff
cc483ad69d (docs) embedding config yaml 2023-12-16 13:14:26 +05:30
ishaan-jaff
4316477276 (docs) embedding 2023-12-16 12:44:21 +05:30
Krrish Dholakia
5b4ca42de6 docs(routing.md): add docs on using caching groups across deployments 2023-12-15 21:51:59 -08:00
ishaan-jaff
bb930b6660 (docs) dynamodb 2023-12-15 21:39:12 +05:30
ishaan-jaff
ae10299058 (docs) dynamo 2023-12-15 18:20:15 +05:30
ishaan-jaff
0f4fa487a5 (docs) dynamodb 2023-12-15 17:32:21 +05:30
ishaan-jaff
eaf4182966 (docs) log proxy i/o to dynamoDB 2023-12-15 15:59:06 +05:30
ishaan-jaff
e170d66991 docs - caching 2023-12-15 14:16:34 +05:30
ishaan-jaff
b9ff8d74ea (docs) deploy on gcp cloud run 2023-12-15 08:50:00 +05:30
Janaka Abeywardhana
53eedbf0ee docs(projects): add Docq.AI to side bar nav 2023-12-15 07:54:34 +05:30
Ishaan Jaff
624d00c5a8
Merge pull request #1142 from janaka/janaka/docs/add-docqai-to-projects
add Docq to projects section.
2023-12-15 07:38:54 +05:30
ishaan-jaff
ca0d8139ec (docs) proxy - deploy on GCP cloud run 2023-12-15 07:29:35 +05:30
Krrish Dholakia
7df9c8e4d8 docs(proxy_server.md): fix old doc links 2023-12-14 12:07:51 -08:00
Krrish Dholakia
52564b685c docs(openai_compatible.md): add docs on calling openai compatible endpoints via litellm pkg 2023-12-14 12:03:29 -08:00
Krrish Dholakia
d7b49dbc41 docs(call_hooks.md): add docs on pre-call hooks 2023-12-14 11:34:37 -08:00
Krrish Dholakia
589a6ca863 docs(redis_cache.md-+-custom_callbacks.md): add cache hit logging info in docs 2023-12-14 11:07:00 -08:00
Krrish Dholakia
0f14fb3797 docs(custom_callback.md): add async failure + streaming logging events to docs
https://github.com/BerriAI/litellm/issues/1125
2023-12-14 10:46:53 -08:00
ishaan-jaff
72a665591d (docs) cache init params 2023-12-14 22:41:25 +05:30
ishaan-jaff
a033016a63 (docs) mistral ai api 2023-12-14 18:49:37 +05:30
Janaka Abeywardhana
aee1f3143d add Docq to projects section. 2023-12-14 17:32:58 +05:30
ishaan-jaff
43fc152a91 (docs) caching - proxy 2023-12-14 16:33:56 +05:30
Krrish Dholakia
73ecc012a9 docs(embedding.md): add embedding docs to proxy 2023-12-13 18:58:46 -08:00
Krish Dholakia
03d6dcefbb
Merge pull request #1123 from nirga/patch-1
fix: traceloop links
2023-12-13 14:52:11 -08:00
Krrish Dholakia
88d09fc5a7 fix(vertex.md): adding gemini-pro support to docs 2023-12-13 14:38:55 -08:00
Nir Gazit
590f0173bc
fix: traceloop links 2023-12-13 22:23:29 +01:00
ishaan-jaff
7856d65d44 (docs) proxy dockerfile 2023-12-12 19:44:55 -08:00
ishaan-jaff
03edba5ff5 (docs) router on config 2023-12-12 19:41:11 -08:00
ishaan-jaff
c294d2c506 (docs) proxy - how to set router_settings 2023-12-12 19:35:21 -08:00
Cam Parry
30faef5052
rebase and docs 2023-12-13 09:30:14 +10:00
Krrish Dholakia
80821f62d1 docs(logging.md): add sentry logging to proxy docs 2023-12-09 23:03:48 -08:00
Krrish Dholakia
149c1b3557 docs(configs.md): added docs on how to configure routing strategy on proxy 2023-12-09 16:31:31 -08:00
ishaan-jaff
adbdb31b9d (docs) proxy caching 2023-12-09 15:56:57 -08:00
ishaan-jaff
9e9781d193 (Docs) Proxy,remove traceloop api key req 2023-12-08 19:26:05 -08:00
ishaan-jaff
dface6a36f (docs) traceloop 2023-12-08 18:47:18 -08:00