Commit Graph

1827 Commits

Author SHA1 Message Date
Kihaya Sugiura
c550357199
docs: Fix import 2024-01-20 19:13:33 +09:00
ishaan-jaff
5295168bda (docs) router 2024-01-19 20:46:43 -08:00
ishaan-jaff
6bc7cc46b4 (docs) router debugging 2024-01-19 15:18:00 -08:00
Tim Asp
315fbcd09f update docs 2024-01-19 11:39:39 -08:00
Krrish Dholakia
62e35f6a14 docs(users.md): add tpm rpm rate limits to docs 2024-01-19 08:56:47 -08:00
Krrish Dholakia
c5e144af23 docs(health.md): add /health/readiness and /health/liveliness to docs 2024-01-19 08:45:23 -08:00
ishaan-jaff
cdede8836f (docs)virtual keys 2024-01-18 15:16:40 -08:00
ishaan-jaff
0e3e8050d7 (docs) /key/info 2024-01-18 14:54:11 -08:00
ishaan-jaff
d5e720e161 (docs) /key/update 2024-01-18 14:45:49 -08:00
ishaan-jaff
f405a827e3 (docs) virtual_keys 2024-01-18 13:55:32 -08:00
ishaan-jaff
1c987a436e (docs) virtual_keys 2024-01-18 13:34:33 -08:00
Krrish Dholakia
37e6c6a59f docs(sidebars.js): simplify docs nav 2024-01-18 11:38:02 -08:00
Krrish Dholakia
354a0b2497 docs(sidebar.js): add link to all endpoints in sidebar 2024-01-18 11:21:55 -08:00
Duarte OC
5d0654e6f6 docs 2024-01-18 17:32:42 +01:00
Krrish Dholakia
a6cd068c49 docs(virtual_keys.md): add model access groups to docs 2024-01-17 20:38:41 -08:00
Krrish Dholakia
70c4227f5e docs(bedrock.md): add sts based auth to docs 2024-01-17 12:17:09 -08:00
ishaan-jaff
5bb4fdc7e4 (docs) using azure gpt4 vision enhancements 2024-01-17 11:04:38 -08:00
ishaan-jaff
3c52fec28b (docs) using azure with vision enhancements on litellm 2024-01-17 10:59:25 -08:00
ishaan-jaff
ffc655e768 (docs) proxy /key/gen 2024-01-16 20:09:43 -08:00
ishaan-jaff
4929a6c95c (docs) proxy - key management, show correct code 2024-01-16 12:02:04 -08:00
ishaan-jaff
a84c86562c (docs) controlling num_workers using env variables 2024-01-16 08:46:41 -08:00
ishaan-jaff
ab7531b6c1 (docs) failing rules 2024-01-15 21:07:16 -08:00
ishaan-jaff
2b3cc694af (docs) proxy - fail requests with custom error message 2024-01-15 17:16:56 -08:00
ishaan-jaff
07a60c19ac (docs) dynamoDB + Key management 2024-01-15 14:20:29 -08:00
Chris Mungall
2bdd35245d
Update image_generation.md
Fixed two typos
2024-01-15 11:54:01 -08:00
Ishaan Jaff
ad06b08a5e
Merge pull request #1442 from BerriAI/litellm_bedrock_provisioned_throughput
[Feat] Support Bedrock provisioned throughput LLMs
2024-01-14 10:51:28 +05:30
ishaan-jaff
7af3fe68e4 (docs) provisioned throughput bedrock models 2024-01-13 21:12:59 -08:00
ishaan-jaff
0648226c48 (docs) azure with vision enhancements 2024-01-13 15:13:37 -08:00
Krrish Dholakia
8a7a745549 Merge branch 'litellm_dynamo_db_keys' 2024-01-13 18:38:43 +05:30
ishaan-jaff
0ae8ab1b13 (docs) sso login + bedrock 2024-01-12 16:51:15 -08:00
Krrish Dholakia
b6a9274baa docs(virtual_keys.md): clearer example for /key/generate 2024-01-13 01:39:03 +05:30
Krrish Dholakia
cbdb8d68a3 docs(health.md): add text completion health check tutorial to docs 2024-01-12 00:32:06 +05:30
ishaan-jaff
c46a370919 (docs) logging proxy input / output 2024-01-11 15:37:03 +05:30
ishaan-jaff
aef2dfbf55 (docs) proxy - s3 logging 2024-01-11 10:01:52 +05:30
ishaan-jaff
cf8dd063cf (docs) add s3 logging to proxy 2024-01-11 09:45:42 +05:30
Krrish Dholakia
8394315173 docs(deploy.md): update docker version tags to main-latest 2024-01-11 02:36:25 +05:30
Krrish Dholakia
b8de5636d4 docs(quick_start.md): update docs to use correct docker image 2024-01-10 23:31:51 +05:30
ishaan-jaff
9e4449a072 (docs) bedrock - show bedrock/ prefix 2024-01-10 23:07:05 +05:30
ishaan-jaff
6e19bb87e2 (docs) proxy config - show how to set seed, temp on config.yaml 2024-01-10 22:16:04 +05:30
ishaan-jaff
03a0e04b0d (docs) proxy - we now use gunicorn default 2024-01-10 22:09:25 +05:30
ishaan-jaff
59669b4c2a (docs) key/gen link to Deploy instructions 2024-01-10 22:07:14 +05:30
Krrish Dholakia
e44d3e51aa ci(config.yml): run prisma generate before testing 2024-01-10 21:26:38 +05:30
Krrish Dholakia
0ed54ddc7f docs(virtual_keys.md): add dynamodb docs 2024-01-09 23:26:45 +05:30
Ishaan Jaff
4cfa010dbd
Merge pull request #1381 from BerriAI/litellm_content_policy_violation_exception
[Feat] Add litellm.ContentPolicyViolationError
2024-01-09 17:18:29 +05:30
ishaan-jaff
75d44fad66 (docs) add ContentPolicyViolationError 2024-01-09 17:16:35 +05:30
ishaan-jaff
248e5f3d92 (chore) remove deprecated completion_with_config() tests 2024-01-09 17:13:06 +05:30
ishaan-jaff
cc07ba1d6a (docs) move tutorials 2024-01-09 17:09:41 +05:30
ishaan-jaff
e8987d9b67 (docs) remove outdated tutorials 2024-01-09 17:06:35 +05:30
ishaan-jaff
4713309b0b (docs) using /key/generate 2024-01-09 16:21:58 +05:30
dependabot[bot]
6b548c04e4
build(deps): bump follow-redirects in /docs/my-website
Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.15.2 to 1.15.4.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases)
- [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.15.2...v1.15.4)

---
updated-dependencies:
- dependency-name: follow-redirects
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-01-09 10:24:25 +00:00
Krrish Dholakia
a4e51362b5 docs(streaming_logging.md): fix tutorial 2024-01-09 13:40:37 +05:30
Krrish Dholakia
d6361e155a docs(deploy.md): update docs for deploying proxy with connected db 2024-01-09 13:34:47 +05:30
Krrish Dholakia
11b6c66609 docs(gemini.md): fix docs 2024-01-09 09:38:04 +05:30
HeavenHM
fa9d0faf13
Update gemini.md
Added example for Gemini Vision Pro
2024-01-09 08:00:51 +05:30
ishaan-jaff
fa74831d79 (docs) control proxy debug using env vars 2024-01-08 16:15:33 +05:30
Ishaan Jaff
a70626d6e9
Merge pull request #1356 from BerriAI/litellm_improve_proxy_logs
[Feat] Improve Proxy Logging
2024-01-08 14:41:01 +05:30
ishaan-jaff
c5589e71e7 (docs) proxy, show users how to use detailed_debug 2024-01-08 12:58:23 +05:30
Krrish Dholakia
c720870f80 docs(gemini.md,-deploy.md): doc updates 2024-01-08 11:02:12 +05:30
Krish Dholakia
4ea3e778f7
Merge pull request #1315 from spdustin/feature_allow_claude_prefill
Adds "pre-fill" support for Claude
2024-01-08 10:48:15 +05:30
ishaan-jaff
7611081d55 (docs) caching + proxy 2024-01-06 15:46:53 +05:30
Krrish Dholakia
b51d98c6e3 docs: fix pip install litellm[proxy] instruction 2024-01-06 13:49:15 +05:30
Krrish Dholakia
e9350ad010 docs(quick_start.md): add ollama to proxy docs 2024-01-06 10:56:25 +05:30
spdustin@gmail.com
ccc0722a80 Add Claude 2.1 to Bedrock support table 2024-01-05 23:08:23 +00:00
spdustin@gmail.com
767679ffcf Add/fix samples for Claude pre-fill and system messages 2024-01-05 23:04:17 +00:00
spdustin@gmail.com
5d074f5b56 Adds tests and updates docs for Claude "pre-fill" 2024-01-05 22:58:41 +00:00
Krrish Dholakia
b0827a87b2 fix(caching.py): support s-maxage param for cache controls 2024-01-04 11:41:23 +05:30
Krrish Dholakia
4946b1ef6d docs(docs/index.md): add proxy details to docs 2024-01-04 11:20:43 +05:30
Krrish Dholakia
0f7d03f761 fix(proxy/rules.md): add docs on setting post-call rules on the proxy 2024-01-04 11:16:50 +05:30
ishaan-jaff
b103ab1f0b (docs) proxy - caching 2024-01-03 18:02:14 +05:30
ishaan-jaff
30c6d164d2 (docs) use s3 Cache on litellm proxy 2024-01-03 17:56:44 +05:30
ishaan-jaff
f9139e05e8 (docs) proxy - cachig 2024-01-03 17:56:44 +05:30
ishaan-jaff
64a0c175d5 (docs) simplify caching docs 2024-01-03 16:21:23 +05:30
ishaan-jaff
8bfaee9654 (docs) simplify caching docs 2024-01-03 16:20:19 +05:30
ishaan-jaff
344e8d8508 (docs) s3 cache 2024-01-03 16:16:18 +05:30
ishaan-jaff
cc29860785 (docs) s3 Cache 2024-01-03 15:42:23 +05:30
Krrish Dholakia
6c8cc33d02 docs(caching.md): fix typo 2024-01-03 12:47:16 +05:30
Krrish Dholakia
8cee267a5b fix(caching.py): support ttl, s-max-age, and no-cache cache controls
https://github.com/BerriAI/litellm/issues/1306
2024-01-03 12:42:43 +05:30
Krrish Dholakia
5055aeb254 docs(alerting.md): add alerting thresholds to docs 2024-01-03 11:21:56 +05:30
Krrish Dholakia
ff4eb5a5d4 docs(alerting.md): add slack alerting to docs 2024-01-02 22:47:01 +05:30
Krrish Dholakia
d17ffdbc83 docs(ui.md): update ui docs to for smtp server hosting 2024-01-02 22:30:17 +05:30
ishaan-jaff
8186af64c7 (docs) xinference on proxy 2024-01-02 16:57:25 +05:30
ishaan-jaff
8f8ac03961 (docs) proxy - using xinference 2024-01-02 16:55:10 +05:30
ishaan-jaff
fdd4e72503 (docs) xinference embedding 2024-01-02 15:39:25 +05:30
ishaan-jaff
0d0ee9e108 (docs) passing user config 2024-01-02 14:43:02 +05:30
ishaan-jaff
1efd1cb30f (docs) passing user_config to completion 2024-01-02 14:19:44 +05:30
ishaan-jaff
60164cd5e4 (docs) pass user config to proxy / router 2024-01-02 14:14:14 +05:30
ishaan-jaff
11f92c0074 (docs) router- init params 2024-01-02 12:14:32 +05:30
Krrish Dholakia
95f850fecc docs(ui.md): add docs on self serve ui flow 2024-01-01 18:25:52 +05:30
Krrish Dholakia
61cd800b9f fix(ui/admin.py): handles trailing '/' case 2024-01-01 17:49:54 +05:30
ishaan-jaff
20236c1c69 (docs) proxy 2024-01-01 12:40:12 +05:30
ishaan-jaff
a98d752f7b (docs) use embeddings with proxy 2024-01-01 12:31:24 +05:30
ishaan-jaff
cf902a53b4 (docs) using /embeddings with Proxy 2024-01-01 12:31:13 +05:30
ishaan-jaff
21cccd02e8 (docs) langfuse + langchain log metadata 2024-01-01 11:53:38 +05:30
ishaan-jaff
a549962f14 (docs) request/response format 2024-01-01 11:52:47 +05:30
ishaan-jaff
76f9c8cc8f (docs) request/response format proxy 2024-01-01 11:52:30 +05:30
ishaan-jaff
8b29f9a48b (docs) pass metatadata to proxy + openai client 2024-01-01 11:12:31 +05:30
ishaan-jaff
5b9973136e (docs) langfuse + proxy - log metadata 2024-01-01 11:03:00 +05:30
Krrish Dholakia
d0d08b4dce docs(routing.md): adding latency-based routing to docs 2024-01-01 08:36:40 +05:30
ishaan-jaff
c269c65371 (docs) langfuse log trace id, trace user id 2023-12-30 20:25:23 +05:30
ishaan-jaff
bf4a9f40e8 (docs) cache context manager 2023-12-30 19:50:22 +05:30
ishaan-jaff
1c93642951 (docs) caching use context manager 2023-12-30 19:43:26 +05:30
ishaan-jaff
231148ed73 (docs) caching 2023-12-30 19:04:36 +05:30
ishaan-jaff
7ecd7b3e8d (docs) proxy - timeout per request 2023-12-30 11:18:03 +05:30
ishaan-jaff
6252987798 (docs) proxy - set timeout per request 2023-12-30 11:17:31 +05:30
Krrish Dholakia
1f76b0e721 docs(routing.md): add retry_after to docs 2023-12-29 15:22:12 +05:30
Krrish Dholakia
1e07f0fce8 fix(caching.py): hash the cache key to prevent key too long errors 2023-12-29 15:03:33 +05:30
Krrish Dholakia
6e68cd1125 docs(load_test.md): add litellm load test script to docs 2023-12-29 13:41:44 +05:30
ishaan-jaff
52a9696303 (docs) cloudflare 2023-12-29 12:10:32 +05:30
Krrish Dholakia
a351211d03 docs(users.md): add user rate limits to docs 2023-12-28 19:28:32 +05:30
ishaan-jaff
a1484171b5 (docs) voyage ai embeddings 2023-12-28 17:15:16 +05:30
ishaan-jaff
aa2bd93166 (docs) add voyage ai 2023-12-28 17:12:58 +05:30
ishaan-jaff
01f7e85057 (docs) add mistral embeddings 2023-12-28 16:54:26 +05:30
ishaan-jaff
7f74a0331c (docs) add mistral-embed 2023-12-28 16:50:52 +05:30
ishaan-jaff
ab306ad5d4 (docs) deploy on railway 2023-12-28 16:35:18 +05:30
Krrish Dholakia
2f012a5088 docs(streaming_logging.md): custom streaming logging tutorial 2023-12-28 13:49:41 +05:30
ishaan-jaff
cf236a4141 (docs) add link to swagger docs 2023-12-28 12:06:46 +05:30
ishaan-jaff
b03c985a4c (docs) proxy - add link to swagger docs 2023-12-28 12:06:46 +05:30
Krrish Dholakia
7ce7516621 docs(user_keys.md): improve user keys docs 2023-12-28 07:02:28 +05:30
Krrish Dholakia
3026e5aa58 docs(image_generation.md): fix typo 2023-12-27 20:33:22 +05:30
Krrish Dholakia
b437260ece docs(users.md): set budgets per user docs 2023-12-27 20:30:27 +05:30
ishaan-jaff
0bf2b56c0f (docs) proxy 2023-12-27 17:14:42 +05:30
ishaan-jaff
eb2fc42b4c (docs) - use vertex ai with proxy cli 2023-12-27 17:12:51 +05:30
Krrish Dholakia
f8180c351f docs(image_generation.md): add image generation to docs 2023-12-27 11:59:57 +05:30
Prateek Sachan
940c33680e updating anyscale link to latest json present in main branch 2023-12-27 01:41:17 +05:30
Prateek Sachan
2acafb7d31 updating anyscale link to latest json present in main branch 2023-12-27 01:37:21 +05:30
Krrish Dholakia
31fbb095c2 docs(user_keys.md): update code example 2023-12-26 22:16:18 +05:30
Krrish Dholakia
1b837e9601 docs(caching.md): add cache controls to docs 2023-12-26 17:54:14 +05:30
ishaan-jaff
a5f998375c (docs) use latest ghcr image 2023-12-26 17:28:39 +05:30
ishaan-jaff
112ffa3596 (docs) add logprobs, top_logprobs 2023-12-26 14:53:30 +05:30
ishaan-jaff
f3844b309f (docs) input params - add logprobs, top_logprobs 2023-12-26 14:41:33 +05:30
ishaan-jaff
b2e69cbc24 (docs) input params 2023-12-26 14:36:19 +05:30
Krrish Dholakia
871f207124 docs(user_keys.md): docs on passing user keys to litellm proxy 2023-12-26 13:55:28 +05:30
ishaan-jaff
08ed509b76 (docs) azure gpt-4 vision 2023-12-26 13:18:38 +05:30
ishaan-jaff
05b9b3aacd (docs) bump langfuse to >= 2.0.0 2023-12-26 09:23:45 +05:30
ishaan-jaff
0db0652ad3 (docs) ollama api/chat 2023-12-26 00:05:16 +05:30
Krrish Dholakia
b3a98d8400 fix(proxy_server.py): accept keys with none duration 2023-12-25 13:46:24 +05:30
ishaan-jaff
485f05ea02 (docs) ollama/json mode 2023-12-25 13:31:01 +05:30
Krrish Dholakia
c568bb6cac docs(virtual_keys.md): add budget manager docs to proxy 2023-12-23 09:48:53 +05:30
Krrish Dholakia
97f6475035 docs(health.md): add docs on health checks for embedding models 2023-12-21 07:54:04 +05:30
ishaan-jaff
f6407aaf74 (docs) add metadata keys/generate 2023-12-21 07:43:53 +05:30
ishaan-jaff
fbab7371dc (docs) proxy - virtual keys 2023-12-21 07:36:32 +05:30
ishaan-jaff
bab8f3350d (docs) openrouter 2023-12-20 13:42:49 +05:30
ishaan-jaff
7d20ea23d1 (docs) set openrouter params 2023-12-20 13:42:49 +05:30
Ishaan Jaff
9fa2fe0c37
Merge pull request #1185 from navidre/prevent_key_log_documentation
Sample code to prevent logging API key in callback to Slack
2023-12-20 09:09:10 +05:30
ishaan-jaff
cd34b859df (docs) swagger endpoint 2023-12-20 05:49:45 +05:30
navidre
b8d7cafb8d
Sample code to prevent logging API key
Sample code in documentation to prevent logging API key. Ideally should be implemented in the codebase if not already
2023-12-19 14:04:20 -06:00
ishaan-jaff
9eb487efb3 (docs) exception mapping 2023-12-19 19:29:05 +05:30
ishaan-jaff
8b0fa2322c (docs) exception mapping azure openai 2023-12-19 19:23:52 +05:30
ishaan-jaff
dbcff752b3 (docs) exception mapping - add more details 2023-12-19 19:22:51 +05:30
ishaan-jaff
84fde01461 (fix) docs proxy + auth curl request 2023-12-19 19:11:35 +05:30
ishaan-jaff
b82fcd51d7 (docs) ollama/llava 2023-12-19 11:32:28 +05:30
Krrish Dholakia
f73c4b494c docs(model_management.md): adding docs on how to add model metadata in the config.yaml 2023-12-18 17:57:29 -08:00
Krish Dholakia
6edc7cc2b3
Merge pull request #1178 from speedyankur/langfuse-doc-update
doc: updated langfuse ver 1.14 in pip install cmd
2023-12-18 17:33:29 -08:00
Ankur Garha
d6ed13fa4f doc: updated langfuse ver 1.14 in pip install cmd 2023-12-18 22:56:08 +01:00
Eric Ma
8ec7e25c06
Update mistral.md
Eliminated typo with extra quotation mark.
2023-12-17 23:51:02 -05:00
Krish Dholakia
c703fb2f2c
Merge pull request #1162 from nirga/patch-2
clarify the need to set an exporter
2023-12-16 21:31:56 -08:00
Yusuke Kawabata
de8a3d5369
fix curl example
Remove unnecessary `,` from curl example
2023-12-17 12:00:06 +09:00
Nir Gazit
4dc774ab8e
clarify the need to set an exporter 2023-12-16 22:19:07 +01:00
Krrish Dholakia
4e828ff541 fix(health.md): add background health check details to docs 2023-12-16 10:31:59 -08:00
Krish Dholakia
50f61bcea4
Merge pull request #1157 from nanowell/patch-1
Update mistral.md
2023-12-16 08:56:39 -08:00
ishaan-jaff
c33cbbe068 (docs) - gemini-pro-visio n 2023-12-16 22:18:30 +05:30
nanowell
9f762bbd5b
Update mistral.md
Incorrect syntax
2023-12-16 17:51:41 +03:00
ishaan-jaff
cb34c3c3f3 (docs) gemini pro vison 2023-12-16 19:20:57 +05:30
ishaan-jaff
6f643a6107 (docs) add gemini-pro-vision 2023-12-16 19:07:36 +05:30
ishaan-jaff
7b851a3870 (docs) cache params 2023-12-16 14:45:19 +05:30
ishaan-jaff
80bf99b1af (docs) proxy - advanced caching 2023-12-16 13:52:58 +05:30
ishaan-jaff
a04f43ef38 (docs) proxy: embeddings 2023-12-16 13:29:26 +05:30
ishaan-jaff
cc483ad69d (docs) embedding config yaml 2023-12-16 13:14:26 +05:30
ishaan-jaff
4316477276 (docs) embedding 2023-12-16 12:44:21 +05:30
Krrish Dholakia
5b4ca42de6 docs(routing.md): add docs on using caching groups across deployments 2023-12-15 21:51:59 -08:00
ishaan-jaff
bb930b6660 (docs) dynamodb 2023-12-15 21:39:12 +05:30
ishaan-jaff
ae10299058 (docs) dynamo 2023-12-15 18:20:15 +05:30
ishaan-jaff
0f4fa487a5 (docs) dynamodb 2023-12-15 17:32:21 +05:30
ishaan-jaff
eaf4182966 (docs) log proxy i/o to dynamoDB 2023-12-15 15:59:06 +05:30
ishaan-jaff
e170d66991 docs - caching 2023-12-15 14:16:34 +05:30
ishaan-jaff
b9ff8d74ea (docs) deploy on gcp cloud run 2023-12-15 08:50:00 +05:30
Janaka Abeywardhana
53eedbf0ee docs(projects): add Docq.AI to side bar nav 2023-12-15 07:54:34 +05:30
Ishaan Jaff
624d00c5a8
Merge pull request #1142 from janaka/janaka/docs/add-docqai-to-projects
add Docq to projects section.
2023-12-15 07:38:54 +05:30
ishaan-jaff
ca0d8139ec (docs) proxy - deploy on GCP cloud run 2023-12-15 07:29:35 +05:30
Krrish Dholakia
7df9c8e4d8 docs(proxy_server.md): fix old doc links 2023-12-14 12:07:51 -08:00
Krrish Dholakia
52564b685c docs(openai_compatible.md): add docs on calling openai compatible endpoints via litellm pkg 2023-12-14 12:03:29 -08:00
Krrish Dholakia
d7b49dbc41 docs(call_hooks.md): add docs on pre-call hooks 2023-12-14 11:34:37 -08:00
Krrish Dholakia
589a6ca863 docs(redis_cache.md-+-custom_callbacks.md): add cache hit logging info in docs 2023-12-14 11:07:00 -08:00
Krrish Dholakia
0f14fb3797 docs(custom_callback.md): add async failure + streaming logging events to docs
https://github.com/BerriAI/litellm/issues/1125
2023-12-14 10:46:53 -08:00
ishaan-jaff
72a665591d (docs) cache init params 2023-12-14 22:41:25 +05:30
ishaan-jaff
a033016a63 (docs) mistral ai api 2023-12-14 18:49:37 +05:30
Janaka Abeywardhana
aee1f3143d add Docq to projects section. 2023-12-14 17:32:58 +05:30
ishaan-jaff
43fc152a91 (docs) caching - proxy 2023-12-14 16:33:56 +05:30
Krrish Dholakia
73ecc012a9 docs(embedding.md): add embedding docs to proxy 2023-12-13 18:58:46 -08:00
Krish Dholakia
03d6dcefbb
Merge pull request #1123 from nirga/patch-1
fix: traceloop links
2023-12-13 14:52:11 -08:00
Krrish Dholakia
88d09fc5a7 fix(vertex.md): adding gemini-pro support to docs 2023-12-13 14:38:55 -08:00
Nir Gazit
590f0173bc
fix: traceloop links 2023-12-13 22:23:29 +01:00
ishaan-jaff
7856d65d44 (docs) proxy dockerfile 2023-12-12 19:44:55 -08:00
ishaan-jaff
03edba5ff5 (docs) router on config 2023-12-12 19:41:11 -08:00
ishaan-jaff
c294d2c506 (docs) proxy - how to set router_settings 2023-12-12 19:35:21 -08:00
Cam Parry
30faef5052
rebase and docs 2023-12-13 09:30:14 +10:00
Krrish Dholakia
80821f62d1 docs(logging.md): add sentry logging to proxy docs 2023-12-09 23:03:48 -08:00
Krrish Dholakia
149c1b3557 docs(configs.md): added docs on how to configure routing strategy on proxy 2023-12-09 16:31:31 -08:00
ishaan-jaff
adbdb31b9d (docs) proxy caching 2023-12-09 15:56:57 -08:00
ishaan-jaff
9e9781d193 (Docs) Proxy,remove traceloop api key req 2023-12-08 19:26:05 -08:00
ishaan-jaff
dface6a36f (docs) traceloop 2023-12-08 18:47:18 -08:00
ishaan-jaff
0dc7d538b5 (docs) proxy - OTEL + traceloop 2023-12-08 18:39:52 -08:00
ishaan-jaff
b84f6670ea (docs) custom callbacks proxy 2023-12-08 18:00:58 -08:00
ishaan-jaff
34428a8e67 (docs) fix 2023-12-08 17:25:05 -08:00
ishaan-jaff
977bfaaab9 (docs) proxy - get model_info,server_request 2023-12-08 14:57:29 -08:00
Krrish Dholakia
2ede903f0b docs: fix imports 2023-12-08 07:39:13 -08:00
Krrish Dholakia
d548836903 docs: add proxy req/s 2023-12-08 07:33:33 -08:00
Krrish Dholakia
0406e01c6d docs(deploy.md): add proxy perf to docs 2023-12-08 07:32:23 -08:00
Krrish Dholakia
e5638e2c5d fix(router.py): fix default caching response value 2023-12-07 13:44:31 -08:00
Krrish Dholakia
7585b58d2d docs: sagemaker embedding model added to docs 2023-12-07 11:42:51 -08:00
Krrish Dholakia
db12ca4ecb docs(bedrock.md): add cohere embeddings to bedrock docs 2023-12-07 11:35:08 -08:00
Krrish Dholakia
2134285523 docs(quick_start.md): adding gunicorn worker script to docs 2023-12-07 11:31:54 -08:00
Krrish Dholakia
d77e0cc716 docs(config.md): adding docs on parallel request rate limiting 2023-12-07 11:27:48 -08:00
Krrish Dholakia
c7aaa4adf8 docs(deploy.md): add docker instructions to deploy docs 2023-12-07 09:22:54 -08:00
Krrish Dholakia
d18a5e8a11 docs(quick_start.md): adding langchain embedding tutorials to docs 2023-12-06 23:14:02 -08:00
ishaan-jaff
8cd9f18b61 (docs) add async success + fail custom logger 2023-12-06 17:24:39 -08:00
Krrish Dholakia
caac4f1779 docs(virtual_keys.md): fix import line 2023-12-06 15:12:23 -08:00
ishaan-jaff
cf1df8204e (docs) proxy - custom async func 2023-12-06 15:04:24 -08:00
ishaan-jaff
0ea6241d3e (docs) use async callback functions 2023-12-06 15:00:16 -08:00
Krrish Dholakia
f6546076b0 docs(quick_start.md): add docs on calling openai-compatible endpoint on proxy 2023-12-06 11:06:09 -08:00
Krrish Dholakia
37251d327d docs(virtual_keys.md): add custom auth to docs 2023-12-06 10:29:52 -08:00
Ayush Somani
f0df1fade7
(docs) update docs 2023-12-06 10:38:52 +05:30
Ayush Somani
0bf3de0a01
(docs) update docker compose docs 2023-12-06 10:37:45 +05:30
Ayush Somani
b0fcc5af67
Merge branch 'main' into main 2023-12-06 10:32:59 +05:30
Krrish Dholakia
e4fae5a3e8 docs(aws_sagemaker.md): support for all huggingface/jumpstart modelsn 2023-12-05 16:59:37 -08:00
Krrish Dholakia
1addaecf48 docs(aws_sagemaker.md): add hf_model_name to sagemaker docs 2023-12-05 16:58:19 -08:00
Krrish Dholakia
ff949490de docs(input.md): add hf_model_name to docs 2023-12-05 16:56:18 -08:00
Krrish Dholakia
68ca2a28d4 docs: adds redis url to router + proxy docs 2023-12-05 15:08:00 -08:00
ishaan-jaff
4f9f53f7dc (docs) proxy: config example with langchain 2023-12-05 12:20:42 -08:00
ishaan-jaff
e615f2670a (docs) proxy + configs 2023-12-05 12:02:35 -08:00
ishaan-jaff
a85a9d7e00 (docs) using proxy with curl, OpenAI, langchain 2023-12-05 11:55:02 -08:00
ishaan-jaff
41075dc977 (docs) litellm proxy + langchain 2023-12-05 11:46:42 -08:00
ishaan-jaff
f0c704f3c2 (docs) add example on using proxy with OpenAI 2023-12-05 11:45:35 -08:00
ishaan-jaff
05f585153f (docs) add health check on load balancing 2023-12-04 18:01:21 -08:00
ishaan-jaff
acd1678d14 (docs) router 2023-12-04 17:51:31 -08:00
ishaan-jaff
3f541fe999 (docs) custom timeouts proxy 2023-12-04 17:37:09 -08:00
Krrish Dholakia
7adb8f493d docs(custom_callback.md): add async callbacks to docs 2023-12-04 17:01:46 -08:00
Krish Dholakia
b90fcbdac4
Merge pull request #970 from nbaldwin98/fixing-replicate-sys-prompt
fix system prompts for replicate
2023-12-04 16:39:44 -08:00
ishaan-jaff
bbdfd143b8 (docs) input 2023-12-04 15:47:27 -08:00
ishaan-jaff
74d520b1b5 (docs) sagemaker - clarify max tokens 2023-12-04 15:15:39 -08:00
ishaan-jaff
6f8765125b (docs) embedding: add api_base for HF 2023-12-04 11:57:41 -08:00
ishaan-jaff
333e77d161 (docs) custom logger 2023-12-04 11:44:12 -08:00
ishaan-jaff
533b5bcc44 (docs) clean up proxy logging 2023-12-04 11:37:15 -08:00
ishaan-jaff
85ac2b179a (docs) custom logger: proxy 2023-12-04 11:30:09 -08:00
ishaan-jaff
c5b92837c2 (docs) custom callbacks proxy 2023-12-04 11:20:27 -08:00
Krrish Dholakia
31d9762b50 fix(model_management.md): add docs on model management on proxy 2023-12-04 09:36:45 -08:00
ishaan-jaff
f2625bca24 (docs) quick start proxy 2023-12-04 08:07:05 -08:00
Ayush Somani
7d2078d89f
(docs) update docker compose guide 2023-12-03 12:29:18 +05:30
Ayush Somani
28bd076579
(docs) add docker compose guide 2023-12-03 12:28:28 +05:30
Krrish Dholakia
6b1b1b82cf fix(proxy_server.py): hash keys 2023-12-02 19:30:03 -08:00
ishaan-jaff
a4c9e18eb5 (docs) proxy quick start 2023-12-02 19:02:41 -08:00
ishaan-jaff
038433f0ad (docs) litellm 2023-12-02 18:58:24 -08:00
ishaan-jaff
a67240e67f (docs) proxy config with docker 2023-12-02 18:50:50 -08:00
ishaan-jaff
deb6162e78 (docs) proxy 2023-12-02 14:41:17 -08:00
ishaan-jaff
a8e351e195 (docs) proxy 2023-12-02 14:40:20 -08:00
ishaan-jaff
a286256d19 (docs) proxy 2023-12-02 14:36:14 -08:00
ishaan-jaff
d74d1707d4 (docs) proxy: logging 2023-12-02 14:27:16 -08:00
ishaan-jaff
2587749323 (docs) proxy 2023-12-02 14:24:40 -08:00
ishaan-jaff
278ef6bd83 (docs) refactor litellm proxy docs to use a hierarchy 2023-12-02 14:09:39 -08:00
David Manouchehri
7c974bdc57
(docs) Mention Neon as a database option. 2023-12-02 15:15:54 -05:00
ishaan-jaff
da78fd617c (docs) proxy: OTEL 2023-12-02 11:56:02 -08:00
ishaan-jaff
30e34e62d0 (docs) proxy otel 2023-12-02 11:11:16 -08:00
ishaan-jaff
7f28333ad8 (docs) simple proxy 2023-12-02 10:42:12 -08:00
ishaan-jaff
278ab7dcab (docs) otel collector 2023-12-01 21:46:37 -08:00
ishaan-jaff
8b6c4918fd (docs) OTEL simple proxy 2023-12-01 21:28:46 -08:00
Krrish Dholakia
47730da262 fix(proxy_server.py): fix linting errors 2023-12-01 20:40:49 -08:00
Krrish Dholakia
ccd10b07a8 docs(secret.md): add azure key vault support to docs 2023-12-01 20:07:20 -08:00
chabala98
c2e2e927fb fix system prompts for replicate 2023-12-01 13:16:35 +01:00
Frank Colson
6fb178dc94 Update docs 2023-11-30 16:43:09 -07:00
ishaan-jaff
8c1a9f1c4e (feat) add bedrock:llama2-70bchat 2023-11-30 14:41:19 -08:00
ishaan-jaff
cc0df56bd6 (chore) remove old doc -> this is now Router 2023-11-30 13:33:17 -08:00
ishaan-jaff
908c32c9c1 (docs) librechat + proxy 2023-11-30 10:47:16 -08:00
ishaan-jaff
fe6ff7cf10 (docs) proxy + librechat 2023-11-30 10:46:48 -08:00
Krrish Dholakia
aea74758e6 docs(simple_proxy.md): improve librechat tutorial 2023-11-30 10:19:18 -08:00
Krrish Dholakia
3d850337a2 docs(routing.md): shoutout sweep on load balancing docs 2023-11-30 09:35:28 -08:00
ishaan-jaff
cbc358ef77 (docs) proxy: Render deploys 2023-11-30 09:21:07 -08:00
Rishab Mallick
5693626ba5 docs: adds gpt-3.5-turbo-1106 in supported models 2023-11-30 13:32:51 +05:30
ishaan-jaff
9331f67c69 (docs) add pplx-online 2023-11-29 21:18:42 -08:00
Krrish Dholakia
03fb143a87 docs(simple_proxy.md): adding librechat tutorial to docs 2023-11-29 21:03:17 -08:00
ishaan-jaff
c1914a01bc (docs) routing 2023-11-29 18:09:39 -08:00
ishaan-jaff
f299120394 (docs) router 2023-11-29 18:08:00 -08:00
ishaan-jaff
69eca78000 (docs) simple proxy 2023-11-29 16:44:40 -08:00
ishaan-jaff
4b78481fbd (docs) simple proxy 2023-11-29 16:38:36 -08:00
ishaan-jaff
2d0432c5b7 (docs) simple proxy 2023-11-29 16:36:07 -08:00
ishaan-jaff
3b89cff65e (docs) simple proxy 2023-11-29 16:33:00 -08:00
ishaan-jaff
032cd0121b (docs) simple proxy 2023-11-29 16:31:08 -08:00
Krrish Dholakia
cd2883065a docs(stream.md): add stream chunk builder helper function to docs 2023-11-28 08:58:35 -08:00
ishaan-jaff
30b80afe31 (docs) fix local debugging 2023-11-28 08:49:14 -08:00
ishaan-jaff
d7dd9f0307 (docs) health check proxy llms 2023-11-27 12:20:15 -08:00
ishaan-jaff
f54c4ee4b8 (docs) sagemaker add chat llms 2023-11-27 10:24:32 -08:00
Krrish Dholakia
59ba1560e5 fix(router.py): fix fallbacks 2023-11-25 19:34:20 -08:00
Krrish Dholakia
ec81b393e2 fix(utils.py): fix linting erros 2023-11-25 14:14:46 -08:00
Krrish Dholakia
69a3b6b8cf docs(simple_proxy.md): improve loading key from vault example 2023-11-25 12:18:35 -08:00
Krrish Dholakia
f9ac71a45a docs(simple_proxy.md): add loading api keys from key vault to proxy docs 2023-11-25 12:15:11 -08:00
ishaan-jaff
c9fdf25c94 (docs) proxy embedding config 2023-11-25 12:14:19 -08:00
ishaan-jaff
f3fff173d2 (docs) custom openai embedding model config 2023-11-25 12:11:25 -08:00
ishaan-jaff
62d8f9ad2a (docs) simple proxy - reorder configs 2023-11-25 11:59:57 -08:00
ishaan-jaff
c12d6c3fe8 (docs) custom openai embedding 2023-11-25 11:52:59 -08:00
Krrish Dholakia
7cf029d677 docs(simple_proxy.md): update simple proxy docs 2023-11-25 10:18:40 -08:00
ishaan-jaff
1c5b3ad764 (docs) proxy 2023-11-24 17:09:38 -08:00
ishaan-jaff
111c7afaca (docs) proxy performance 2023-11-24 17:07:46 -08:00
Krrish Dholakia
fe900966c1 docs(simple_proxy.md): adding tracking spend via proxy to docs 2023-11-24 15:41:52 -08:00
Krrish Dholakia
2b52e6995c docs(perplexity.md): fix model list
https://github.com/BerriAI/litellm/issues/908
2023-11-24 14:14:47 -08:00
Krrish Dholakia
f1dbdb58bb docs(simple_proxy.md): add cooldown to docs 2023-11-24 13:37:16 -08:00
Krrish Dholakia
12dbdc4c15 docs(simple_proxy.md): add tutorial for doing fallbacks + retries + timeouts on the proxy 2023-11-24 12:20:38 -08:00
Kumaran Rajendhiran
79569e4f2c Fix wrong model mentioned in simple proxy doc page 2023-11-24 19:46:35 +05:30
Krrish Dholakia
f24786095a fix(vertex_ai.py): fix exception mapping for vertex ai 2023-11-23 17:35:33 -08:00
Krrish Dholakia
2cc6acdeec docs(routing.md): add docs on fallbacks, caching, retries, timeouts for router 2023-11-23 17:17:18 -08:00
Krrish Dholakia
abe2a009f9 test(test_completion.py): fix azure read from env variable test 2023-11-23 16:58:07 -08:00
ishaan-jaff
65d978622d (docs) proxy 2023-11-23 11:46:59 -08:00
Krrish Dholakia
276041e3bb docs(routing.md): updating routing docs to include cooldown info 2023-11-23 11:27:22 -08:00
Krrish Dholakia
61fc76a8c4 fix(router.py): fix caching for tracking cooldowns + usage 2023-11-23 11:13:32 -08:00
ishaan-jaff
94c1d71b2c (docs) proxy server 2023-11-23 11:13:26 -08:00
ishaan-jaff
28a192df3a (docs) simple proxy 2023-11-23 11:10:50 -08:00
ishaan-jaff
71042ee345 (docs) caching 2023-11-23 10:40:32 -08:00
ishaan-jaff
efe6fb8831 (docs) proxy server caching 2023-11-23 10:35:34 -08:00
ishaan-jaff
b15b723567 (docs) proxy server: add caching 2023-11-23 08:08:12 -08:00
ishaan-jaff
44e867499f (docs) proxy 2023-11-23 07:55:12 -08:00
ishaan-jaff
1af7575c86 (docs) rename reliability -> Fallbacks, num retries 2023-11-22 20:55:53 -08:00
ishaan-jaff
4ece219ec5 (docs) simple proxy 2023-11-22 15:01:26 -08:00
ishaan-jaff
d0f11e7a13 (docs) input params for litellm.embedding() 2023-11-22 14:40:52 -08:00
Krrish Dholakia
b0801f61e6 test(test_caching.py): cleaning up tests 2023-11-22 13:43:48 -08:00
ishaan-jaff
7a4be44805 (docs) request q 2023-11-22 08:10:30 -08:00
ishaan-jaff
898f15af2b (docs) update routing with api.litellm.ai 2023-11-21 19:54:29 -08:00
Krrish Dholakia
826f56a6a0 docs(routing.md): update routing docs 2023-11-21 19:32:50 -08:00
Krrish Dholakia
9d97082eed docs(routing.md): add queueing to docs 2023-11-21 18:01:02 -08:00
ishaan-jaff
dcc60ae31a (docs) routing 2023-11-21 17:22:06 -08:00
ishaan-jaff
8b8e5890e3 (docs) routing 2023-11-21 17:20:24 -08:00
ishaan-jaff
da90d01d04 (docs) proxy 2023-11-21 16:59:33 -08:00
ishaan-jaff
ab75654e0d (docs) queue server 2023-11-21 14:54:03 -08:00
ishaan-jaff
93ec24710b (docs) exception mapping 2023-11-21 14:09:51 -08:00
ishaan-jaff
34886a99cc (docs) fix exception mapping 2023-11-21 14:05:04 -08:00
ishaan-jaff
a2e2889d88 (docs) catch streaming exceptions 2023-11-21 13:45:54 -08:00
ishaan-jaff
f18a64f6a4 (docs) catching timeout exceptions 2023-11-21 13:39:59 -08:00
ishaan-jaff
20b129b7ad (docs) update timeout variable name 2023-11-21 13:14:55 -08:00
ishaan-jaff
5dabcc21c9 (docs) update migration 2023-11-21 11:22:54 -08:00
ishaan-jaff
3aebc46ebf (docs) update streaming 2023-11-21 11:20:53 -08:00
ishaan-jaff
bb44fc8f9d (docs) anthropic 2023-11-21 09:58:02 -08:00
ishaan-jaff
f4dcff2864 (docs) add claude2.1 2023-11-21 09:54:32 -08:00
ishaan-jaff
b752ba8a46 (docs) router 2023-11-20 19:29:58 -08:00
Krrish Dholakia
311b4f9d2c docs(rules.md): adding rules to docs 2023-11-20 19:14:07 -08:00
Krrish Dholakia
53743f2124 docs(simple_proxy.md): add model alias tutorial to docs 2023-11-20 17:05:17 -08:00
Guspan Tanadi
7cd7bed89c
docs: cleaning hyphen Reference link Together AI 2023-11-20 08:58:23 +07:00
Krrish Dholakia
e308fcdb8e docs(routing.md): update with link to code 2023-11-18 19:05:45 -08:00
Krrish Dholakia
9e88014ff4 docs(routing.md): updating docs for managing multiple deployments 2023-11-18 19:02:50 -08:00
Krrish Dholakia
eefa66e8f0 docs(simple_proxy.md): adding token based auth to docs 2023-11-18 17:34:11 -08:00
ishaan-jaff
e6aafb50dc (docs) langfuse 2023-11-18 15:35:29 -08:00
ishaan-jaff
468da13fe1 (docs) callbacks 2023-11-18 15:28:41 -08:00
ishaan-jaff
180591cdda (docs) callbacks 2023-11-18 14:56:16 -08:00
ishaan-jaff
0b171bb810 (docs) add parallel function calling to azure.md 2023-11-18 14:49:57 -08:00
ishaan-jaff
3e70d2149e (docs) add parallel function calling to openai.md 2023-11-18 14:49:37 -08:00
ishaan-jaff
b7eb2527ff (docs) add parallel function calling on azure openai 2023-11-18 14:42:43 -08:00
ishaan-jaff
7a8fbb6da3 (docs) function calling on openai 2023-11-18 14:21:26 -08:00
ishaan-jaff
25d76cdc9d (docs) parallel function calling 2023-11-18 14:09:20 -08:00
ishaan-jaff
e9e1d69814 (docs) parallel function calling 2023-11-18 14:07:10 -08:00
ishaan-jaff
32f8551357 (docs) parallel function calling 2023-11-18 13:45:19 -08:00
ishaan-jaff
a08b8581f8 (docs) new dockerfile for litellm proxy 2023-11-17 17:39:07 -08:00
ishaan-jaff
fdbaceab8e (docs) input params 2023-11-17 16:07:25 -08:00
ishaan-jaff
30a95a7823 (docs) input params 2023-11-17 16:06:12 -08:00
ishaan-jaff
65ae7127be (docs) optional fields - tools, tool_choice 2023-11-17 16:04:40 -08:00
ishaan-jaff
3c03e82f98 (docs) update migration guide 2023-11-17 10:48:21 -08:00
ishaan-jaff
aa2a9fff99 (docs) get_max_tokens returns int not dict now 2023-11-17 10:39:13 -08:00
ishaan-jaff
79e93ee7aa (docs) proxy - aws sagemaker jumpstart 2023-11-17 10:04:35 -08:00
Ishaan Jaff
1a09b93214
Merge pull request #832 from BerriAI/dependabot/npm_and_yarn/docs/my-website/sharp-0.32.6
build(deps): bump sharp from 0.32.5 to 0.32.6 in /docs/my-website
2023-11-17 09:05:34 -08:00
Krrish Dholakia
a27c2961dc docs(migration.md): new base case exception - apiconnectionerror 2023-11-16 22:04:14 -08:00
Krrish Dholakia
7456c26940 docs(routing.md): update tutorial on deploying router 2023-11-16 21:46:43 -08:00
ishaan-jaff
5fd4376802 (docs) lm harness 2023-11-16 14:30:33 -08:00
ishaan-jaff
8d0f4bfc74 (docs) lm harness 2023-11-16 14:21:37 -08:00
dependabot[bot]
6ead640637
build(deps): bump sharp from 0.32.5 to 0.32.6 in /docs/my-website
Bumps [sharp](https://github.com/lovell/sharp) from 0.32.5 to 0.32.6.
- [Release notes](https://github.com/lovell/sharp/releases)
- [Changelog](https://github.com/lovell/sharp/blob/main/docs/changelog.md)
- [Commits](https://github.com/lovell/sharp/compare/v0.32.5...v0.32.6)

---
updated-dependencies:
- dependency-name: sharp
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-16 18:59:28 +00:00
Krrish Dholakia
fcc250b312 docs(simple_proxy.md): add tutorial on handling multiple instances of 1 model 2023-11-16 09:14:15 -08:00
Ishaan Jaff
d6ad62d793
Merge pull request #811 from dchristian3188/bedrock-llama
Bedrock llama
2023-11-16 07:57:50 -08:00
ishaan-jaff
63b2b6c9a2 (docs) remove bloat gpt cache 2023-11-15 17:30:47 -08:00
ishaan-jaff
cc955fca89 (docs) config 2023-11-15 16:48:01 -08:00
ishaan-jaff
77394e7987 (docs) using litellm proxy + langfuse 2023-11-15 14:29:14 -08:00
ishaan-jaff
e9dfea887c (docs) using litellm proxy + Langfuse 2023-11-15 13:52:47 -08:00
ishaan-jaff
b7859f0dd1 (docs) show how to debug proxy logs 2023-11-15 13:44:17 -08:00
ishaan-jaff
8cced8eabc (docs) proxy cli settings 2023-11-15 13:33:29 -08:00
ishaan-jaff
ae7731b4dc (docs) using litellm with curl, OpenAI v1.0.0+ 2023-11-15 13:29:20 -08:00
Krrish Dholakia
33d823a18d docs(routing.md): add contributor s/o 2023-11-15 13:20:02 -08:00
Krrish Dholakia
8c104e9c6a fix(azure.py-+-proxy_server.py): fix function calling response object + support router on proxy 2023-11-15 13:15:16 -08:00
ishaan-jaff
f3bbedbbbc (docs) proxy add example on using local hf llm 2023-11-15 13:00:43 -08:00
ishaan-jaff
5963d9d283 (docs) config for azure ad 2023-11-14 15:47:37 -08:00
ishaan-jaff
0e9446f213 (docs) proxy 2023-11-14 15:42:23 -08:00
ishaan-jaff
255c0fab1d (docs) passing azure_ad_token to config 2023-11-14 15:27:59 -08:00
ishaan-jaff
952ab1a401 (docs) azure ad 2023-11-14 14:38:33 -08:00
ishaan-jaff
1a73913766 (docs) azure passing azure_ad_token 2023-11-14 13:49:39 -08:00
ishaan-jaff
ede03af21d (docs) pass azure_ad_token 2023-11-14 13:44:03 -08:00
Krrish Dholakia
7ef8611952 fix(simple_proxy.md): enable setting a master key to protect proxy endpoints 2023-11-14 12:44:33 -08:00
Krrish Dholakia
17b02c0753 fix(migration.md): migration guide for new litellm MAJOR release 2023-11-14 12:02:53 -08:00
ishaan-jaff
3280a8e2e2 (docs) eval suites 2023-11-13 20:33:25 -08:00
David Christian
404d4e8737 updated docs 2023-11-13 15:43:52 -08:00
ishaan-jaff
cf0ab7155e (fix) proxy + docs: use openai.chat.completions.create instead of openai.ChatCompletions 2023-11-13 08:24:26 -08:00
Ishaan Jaff
60770e1eec
Merge pull request #806 from BerriAI/dependabot/npm_and_yarn/docs/my-website/babel/traverse-7.23.3
build(deps): bump @babel/traverse from 7.22.10 to 7.23.3 in /docs/my-website
2023-11-13 08:15:20 -08:00
dependabot[bot]
6c9b3e2e71
build(deps): bump @babel/traverse in /docs/my-website
Bumps [@babel/traverse](https://github.com/babel/babel/tree/HEAD/packages/babel-traverse) from 7.22.10 to 7.23.3.
- [Release notes](https://github.com/babel/babel/releases)
- [Changelog](https://github.com/babel/babel/blob/main/CHANGELOG.md)
- [Commits](https://github.com/babel/babel/commits/v7.23.3/packages/babel-traverse)

---
updated-dependencies:
- dependency-name: "@babel/traverse"
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-13 16:11:42 +00:00
dependabot[bot]
4e30b81eaf
build(deps): bump postcss from 8.4.27 to 8.4.31 in /docs/my-website
Bumps [postcss](https://github.com/postcss/postcss) from 8.4.27 to 8.4.31.
- [Release notes](https://github.com/postcss/postcss/releases)
- [Changelog](https://github.com/postcss/postcss/blob/main/CHANGELOG.md)
- [Commits](https://github.com/postcss/postcss/compare/8.4.27...8.4.31)

---
updated-dependencies:
- dependency-name: postcss
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-13 16:11:38 +00:00
ishaan-jaff
ecc6790a23 (docs) fast eval with proxy 2023-11-11 12:08:10 -08:00
ishaan-jaff
b6e6c7bb86 (docs) use fast eval 2023-11-11 12:06:17 -08:00
ishaan-jaff
0cee50f66d (docs) openai 2023-11-10 21:00:37 -08:00
ishaan-jaff
71da9d0d63 (docs) add gpt-4 vision 2023-11-10 17:34:20 -08:00
ishaan-jaff
5da6fb84fa (docs) simple proxy 2023-11-10 15:59:12 -08:00
ishaan-jaff
5fcf9fc799 (docs) proxy setting default models 2023-11-10 13:06:22 -08:00
ishaan-jaff
ebcd29b1ec (docs) proxy pass headers 2023-11-10 12:59:34 -08:00
ishaan-jaff
9d4cbf1d22 (docs) pass headers in config 2023-11-10 12:56:53 -08:00
ishaan-jaff
bf2cb91841 (docs) add replicate cold boots info 2023-11-10 12:46:33 -08:00
Krrish Dholakia
84460b8222 docs(input.md): adding anyscale supported params 2023-11-10 09:26:57 -08:00
ishaan-jaff
76d8ea674e (docs) replicate 2023-11-09 18:16:21 -08:00
ishaan-jaff
6f639f30c5 (docs) replicate deployments 2023-11-09 18:10:38 -08:00
ishaan-jaff
e355a0674f (docs) using auto evals 2023-11-09 17:31:50 -08:00
ishaan-jaff
7ddd29da93 (docs) litellm eval suites 2023-11-09 17:22:42 -08:00
ishaan-jaff
108336aeef (docs) using proxy with mlfow eval 2023-11-09 17:21:43 -08:00
ishaan-jaff
953593e137 (docs) add mlflow 2023-11-09 17:18:32 -08:00
ishaan-jaff
88111fbb36 (docs) auto evals 2023-11-09 17:18:32 -08:00
ishaan-jaff
bba62b56d3 (docs) auto eval tutorial 2023-11-09 15:43:55 -08:00
ishaan-jaff
87328a973e (docs) add tutorial on using litellm with autoeval 2023-11-09 15:42:12 -08:00
ishaan-jaff
40e7e2ce48 (docs) cleanup 2023-11-09 13:24:13 -08:00
ishaan-jaff
9fd51f66d0 (docs) cleanup 2023-11-09 13:20:15 -08:00
ishaan-jaff
376dae73f9 (docs) openai proxy configs 2023-11-09 13:18:35 -08:00
ishaan-jaff
d48ed083ab (docs) cleanup 2023-11-09 11:51:55 -08:00
ishaan-jaff
4bc70329a4 (docs) proxy with config 2023-11-09 11:50:13 -08:00
ishaan-jaff
e2a380b832 (docs) deprecated proxy 2023-11-09 10:55:28 -08:00
ishaan-jaff
fbebb28970 (docs) simple proxy 2023-11-09 10:46:16 -08:00
ishaan-jaff
2c67bda137 (docs) proxy 2023-11-09 10:38:19 -08:00
ishaan-jaff
db0e032d53 (docs) simple proxy 2023-11-08 17:55:11 -08:00
ishaan-jaff
fc05510a5d (docs) call specific model 2023-11-08 17:52:42 -08:00
ishaan-jaff
fc45f41818 (docs) add instructions on running with FLASK 2023-11-08 17:48:14 -08:00
ishaan-jaff
da1451e493 (docs) use FLASK benchmarks with proxy 2023-11-08 17:25:59 -08:00
ishaan-jaff
68e668df13 (docs) lm harness 2023-11-08 17:21:12 -08:00
ishaan-jaff
b102489f49 (docs) replicate input params 2023-11-08 14:23:37 -08:00
ishaan-jaff
3498e881af (docs) proxy server 2023-11-08 13:27:17 -08:00
ishaan-jaff
50a1c55ce1 (docs) proxy 2023-11-08 13:24:21 -08:00
ishaan-jaff
57c78cebb9 (docs) proxy cli args 2023-11-08 13:19:25 -08:00
ishaan-jaff
c6e4ea8558 (docs) proxy cli add params supported 2023-11-08 13:11:49 -08:00
ishaan-jaff
3239ec80c9 (docs) embedding models 2023-11-07 21:43:02 -08:00
ishaan-jaff
4ca4038246 (docs) proxy server 2023-11-07 17:27:58 -08:00
ishaan-jaff
febb163850 (docs) proxy server openai api base 2023-11-07 17:24:47 -08:00
ishaan-jaff
83ef369871 (docs) proxy server 2023-11-07 15:39:59 -08:00
ishaan-jaff
c972e4acf2 (docs) proxy server 2023-11-07 15:30:29 -08:00
ishaan-jaff
adf7539be2 (docs) proxy server 2023-11-07 15:27:29 -08:00
ishaan-jaff
7c37d24b46 (docs) proxy 2023-11-07 15:16:28 -08:00
ishaan-jaff
4c31045cee (docs) proxy 2023-11-07 15:14:06 -08:00
ishaan-jaff
813da8ec04 (docs) proxy 2023-11-07 15:11:47 -08:00
ishaan-jaff
ff482f2eb9 (docs) proxy server 2023-11-07 12:16:30 -08:00
ishaan-jaff
3ef75029cb (docs) proxy server 2023-11-07 12:06:25 -08:00
ishaan-jaff
a16707fc1a (docs) proxy 2023-11-07 11:49:40 -08:00
ishaan-jaff
10b94c8a0a (docs) proxy 2023-11-07 11:39:10 -08:00
ishaan-jaff
0f23f04d06 (docs) cleanup 2023-11-07 11:34:02 -08:00
ishaan-jaff
87d0b72a4a (docs) proxy 2023-11-07 09:48:58 -08:00
Krrish Dholakia
50564ab38e docs(routing.md): adding comparison to docs 2023-11-06 18:57:50 -08:00
Krrish Dholakia
ba66294a3d fix(router.py): fix linting issues 2023-11-06 18:50:09 -08:00
ishaan-jaff
f7990525ff (docs) add gpt-4 turbo 2023-11-06 13:32:08 -08:00
ishaan-jaff
deddb48683 (docs) litelm custom openai server 2023-11-06 09:24:35 -08:00
ishaan-jaff
7e9c635186 (docs) custom openai proxy 2023-11-06 09:20:20 -08:00
Kyle
067e5c3d91 Merge branch 'main' of github.com:kylehh/litellm into main 2023-11-05 02:58:32 -08:00
Kyle
fb1205f143 name change 2023-11-05 02:58:19 -08:00
kYLe
99d241d2d5
Merge branch 'BerriAI:main' into main 2023-11-05 04:56:18 -06:00
Kyle
256d8d1a7f change name 2023-11-05 02:55:09 -08:00
ishaan-jaff
5da47688ef (docs) litellm playground fix 2023-11-04 22:28:01 -07:00
ishaan-jaff
6e4a575b0f (docs) lm eval harness 2023-11-04 17:55:32 -07:00
ishaan-jaff
44ee34529b (docs) lm harness 2023-11-04 17:51:50 -07:00
ishaan-jaff
45d681107d (docs) lm harness tutorial 2023-11-04 17:51:16 -07:00
ishaan-jaff
53c2ada9e3 (docs) index.md 2023-11-04 17:23:36 -07:00
Krrish Dholakia
37fd895692 docs(custom_callback.md): adding callback class to docs 2023-11-04 17:14:42 -07:00
ishaan-jaff
53371d37b7 (docs) lm eval harness 2023-11-03 18:11:07 -07:00
Krrish Dholakia
4e1885734a refactor(proxy_server.py): print statement showing how to add debug for logs 2023-11-03 17:41:14 -07:00
Krrish Dholakia
432520ffcf docs(simple_proxy.md): improving tutorial 2023-11-03 14:06:08 -07:00
Krrish Dholakia
22fd8953c1 docs(simple_proxy.md): adding docs 2023-11-03 14:03:48 -07:00
Krrish Dholakia
9f180831fe docs(simple_proxy.md): doc cleanup 2023-11-03 13:07:07 -07:00
Krrish Dholakia
f6486b9df9 docs(simple_proxy.md): adding bedrock tutorial 2023-11-03 12:58:48 -07:00
Krrish Dholakia
6b3671b593 fix(proxy_server.py): accept config.yaml 2023-11-03 12:50:52 -07:00
ishaan-jaff
9484d19920 (docs) caching 2023-11-02 14:51:07 -07:00
ishaan-jaff
764ba41224 (docs) embedding 2023-11-02 10:57:57 -07:00
ishaan-jaff
f24e1cb133 (docs) embedding cohere 2023-11-02 10:56:24 -07:00
ishaan-jaff
4dfefc475d (docs) cohere embedding 2023-11-02 10:45:56 -07:00
ishaan-jaff
fdc88cc0ee (docs) cohere embedding models 2023-11-02 10:35:46 -07:00
ishaan-jaff
8ea2270058 (feat) cohere embedding 2023-11-02 10:26:02 -07:00
ishaan-jaff
33350c7c41 (docs) cohere 2023-11-02 10:23:52 -07:00
Krrish Dholakia
73cd0f3778 docs(proxy_server.md): cleanup 2023-11-01 18:13:22 -07:00
Krrish Dholakia
82065716de docs(lm_evaluation_harness.md): adding github link to docs 2023-11-01 17:46:21 -07:00
Krrish Dholakia
9afd3c8bfa docs(lm_evaluation_harness.md): tutorial showing how to use lm evaluation harness with tgi 2023-11-01 17:45:16 -07:00
ishaan-jaff
9cfd218101 (feat) detect amazon.titan-embed-text-v1 as bedrock embedding model 2023-11-01 14:46:33 -07:00
ishaan-jaff
f4a45ec35b (docs) bedrock 2023-11-01 14:17:53 -07:00
ishaan-jaff
dc5a50d20e (docs) bedrock 2023-11-01 14:16:13 -07:00
ishaan-jaff
5c92cca9a4 (docs) add bedrock embedding 2023-11-01 14:15:08 -07:00
ishaan-jaff
59b3a64e64 (docs) add bedrock embeddings() 2023-11-01 14:12:48 -07:00
Krrish Dholakia
8deeb52f7c docs(function_call.md): cleanup 2023-11-01 13:55:00 -07:00
Krrish Dholakia
fb4be198ee docs(routing.md): adding context window fallback dict and num retries 2023-11-01 13:52:18 -07:00
ishaan-jaff
270fc02578 (docs) add litellm.api_version 2023-11-01 11:52:20 -07:00
Krish Dholakia
d898b1c412
Merge pull request #734 from morgendigital/patch-1
Docker Hub image is built for ARM64 only
2023-11-01 08:21:45 -07:00
ishaan-jaff
522f1ac7c8 (docs) bedrock 2023-10-31 22:32:41 -07:00
ishaan-jaff
cedc756d2e (docs) hf viewing log probs 2023-10-31 18:37:18 -07:00
ishaan-jaff
c0e6596395 (docs) hf 2023-10-31 18:25:44 -07:00
Krrish Dholakia
847de09308 docs(simple_proxy.md): add model alias to docs 2023-10-31 17:30:02 -07:00
ishaan-jaff
b32cedeb28 (docs) function calling for non openai llms 2023-10-31 17:15:35 -07:00
Morgendigital
3c49949e0b
Docker Hub image is built for ARM64 only
When trying to run it on a x64 Linux machine, I get the following error:

```
WARNING: The requested image's platform (linux/arm64) does not match the detected host platform (linux/amd64/v3) and no specific platform was requested
```

The Docker image was apparently built for ARM64 only.
2023-10-31 23:28:38 +01:00
ishaan-jaff
7578716adc (docs) openai set - org + api base 2023-10-30 18:03:53 -07:00
ishaan-jaff
5f47c8d310 (docs) update calling ft gpt3.5 2023-10-30 17:56:01 -07:00
ishaan-jaff
80d3fd845f (docs) example on setting organization param for openai 2023-10-30 17:43:32 -07:00
ishaan-jaff
d61e4cab19 (docs) openai.md 2023-10-30 17:33:23 -07:00
ishaan-jaff
d32f354bb2 (docs) openai supported models 2023-10-30 17:31:03 -07:00
Krish Dholakia
9b84a4c8bd
(docs) updates 2023-10-30 16:51:38 -07:00
ishaan-jaff
47ac4fa58f (docs) update encode/decode doc 2023-10-30 14:13:06 -07:00
ishaan-jaff
c61fa70ba0 (docs) encode docstring 2023-10-30 14:10:29 -07:00
ishaan-jaff
313eee17e3 (docs) validate keys 2023-10-30 14:07:35 -07:00
ishaan-jaff
370b6be52a (docs) update model alias 2023-10-30 13:58:07 -07:00
ishaan-jaff
689c14525c (docs) update token trimming 2023-10-30 13:56:23 -07:00
ishaan-jaff
359f40d483 (docs) getting started 2023-10-30 13:39:50 -07:00
Krrish Dholakia
ee2e186c62 docs(routing.md): clean up title 2023-10-29 21:13:45 -07:00
Krrish Dholakia
7304c75f9c docs(simple_proxy.md): updating copy 2023-10-28 19:21:19 -07:00
Krrish Dholakia
ffd80ca850 docs(input.md): updating litellm-specific params for completion 2023-10-28 19:17:07 -07:00
Krrish Dholakia
585f7b0434 docs(input.md): add litellm params to docs 2023-10-28 19:13:55 -07:00
Krrish Dholakia
758b75cb8d docs(simple_proxy.md): updating titles 2023-10-28 16:18:56 -07:00
Krrish Dholakia
23f03f7e6f docs(simple_proxy.md): add llama index tutorial to docs 2023-10-28 16:14:51 -07:00
ishaan-jaff
b76304246e (docs) reliability with fallbacks + router 2023-10-28 15:28:03 -07:00
Krrish Dholakia
b18b9d6380 docs(simple_proxy.md): add arize ai llm evals to docs 2023-10-28 15:14:27 -07:00
Krrish Dholakia
59e47fac78 docs(simple_proxy.md): prompt tools tutorials 2023-10-28 14:52:17 -07:00
Ishaan Jaff
914067227a
Merge pull request #713 from josearangos/main
refactor Contributing to documentation steps
2023-10-28 12:39:40 -07:00
ishaan-jaff
2272a5d1fa (docs) cleanup remove bload - ab test lllms 2023-10-28 12:34:40 -07:00
josearangos
cc7b06f8e4 refactor Contributing to documentation steps 2023-10-28 14:25:01 -05:00
Krrish Dholakia
347a5c46e2 docs(simple_proxy.md): adding NeMO Guardrails tutorial to docs 2023-10-28 12:17:16 -07:00
ishaan-jaff
bdc96d6390 (docs) improve sentry callback 2023-10-27 16:33:12 -07:00
ishaan-jaff
1d955e7b07 (docs) use sentry DSN to send data 2023-10-27 16:25:02 -07:00
Krrish Dholakia
afe14c8a96 fix(utils.py/completion_with_fallbacks): accept azure deployment name in rotations 2023-10-27 16:00:42 -07:00
ishaan-jaff
895cb5d0f9 (docs) add LiteLLM Server - deploy liteLLM 2023-10-26 20:18:51 -07:00
ishaan-jaff
7f90f400c3 (docs) add 1 click deploy to index.md 2023-10-26 20:12:29 -07:00
ishaan-jaff
13ff7cd429 (docs) add deploy button to index.md 2023-10-26 20:10:58 -07:00
ishaan-jaff
3563ae81a8 (docs) improve async + streaming completion 2023-10-26 12:10:37 -07:00
Krrish Dholakia
8d2a4a597a doc cleanup 2023-10-26 11:33:40 -07:00
ishaan-jaff
758628a621 (docs) litellm server deploy aws 2023-10-25 19:05:53 -07:00
ishaan-jaff
63fc276a2b (docs) litellm server deploy on aws 2023-10-25 19:04:37 -07:00
ishaan-jaff
0b0556cfd7 (docs) litellm server deploy on app runner 2023-10-25 18:58:55 -07:00
ishaan-jaff
913262fd99 (docs) litellm server instructions on deploying to aws app runner 2023-10-25 18:33:43 -07:00
ishaan-jaff
ae54db8c84 (docs) proxy server deploy to AWS 2023-10-25 17:07:53 -07:00
Krrish Dholakia
96068a2031 docs(routing.md): renaming docs for simplicity 2023-10-25 14:23:17 -07:00
Ishaan Jaff
628e52e9ab
Merge pull request #700 from josearangos/main
docs error ==> openai.error instead of openai.errors
2023-10-25 14:23:02 -07:00
ishaan-jaff
aa4d049a48 (docs) proxy server add caching flip per completion request 2023-10-25 14:17:21 -07:00
Krrish Dholakia
aec4de68a7 docs(routing.md): fix deployment tutorial 2023-10-25 14:02:11 -07:00
josearangos
203aa24aed docs error openai.error instead of openai.errors 2023-10-25 15:57:26 -05:00
ishaan-jaff
e7eb495a3a (docs) proxy add info on testing caching 2023-10-25 11:29:48 -07:00
ishaan-jaff
f208a1231b (docs) proxy server add info on caching 2023-10-25 10:38:58 -07:00
Krrish Dholakia
edfa4d550a docs(anyscale.md): adding anyscale documentation
n
2023-10-25 09:12:29 -07:00
ishaan-jaff
7b76a7ed25 (docs) on deploying render 2023-10-24 21:28:37 -07:00
ishaan-jaff
e897a75887 (docs) simple proxy testing 2023-10-24 21:13:41 -07:00
ishaan-jaff
923bc706fd (docs) simple proxy server 2023-10-24 21:00:01 -07:00
ishaan-jaff
70fcf351d8 (docs) simple proxy updates 2023-10-24 20:55:15 -07:00
ishaan-jaff
55b9fb6bfb (docs) add deploy to render litellm 2023-10-24 20:40:52 -07:00
Krrish Dholakia
046e1384c3 docs(huggingface.md): adding huggingface text-embedding-inference to docs 2023-10-24 17:53:39 -07:00
ishaan-jaff
e5c6f512f9 (docs) show how to set custom input_callback 2023-10-24 17:40:59 -07:00
Krish Dholakia
b86c679e71
Merge pull request #647 from nirga/traceloop-bug
fix: bugs in traceloop integration
2023-10-24 17:38:30 -07:00
ishaan-jaff
30dd0b5c6b (docs) proxy server title 2023-10-24 17:14:57 -07:00
Krrish Dholakia
59ddda5c4b docs(token_usage.md): adding registering model via url to docs 2023-10-24 16:21:38 -07:00
Krrish Dholakia
24c1207451 docs(proxy_server.md): cli tool deprecation notice 2023-10-24 16:01:05 -07:00
ishaan-jaff
f9ff8cbfb1 (docs) update cloud run deploy link 2023-10-24 12:53:23 -07:00
ishaan-jaff
ea0c65d146 (docs) add async embeddings 2023-10-23 15:23:23 -07:00
ishaan-jaff
fbac910436 (fix) openai proxy set langfuse as callback 2023-10-23 14:42:04 -07:00
ishaan-jaff
98100be5b6 (docs) proxy server auth 2023-10-23 11:56:35 -07:00
ishaan-jaff
07b2dec580 (docs) proxy server 2023-10-23 11:45:18 -07:00
ishaan-jaff
a89e40df5e (docs) testing proxy with anthropic 2023-10-23 11:28:46 -07:00
ishaan-jaff
d37dc4a891 (docs) update sidebar 2023-10-23 11:25:57 -07:00
ishaan-jaff
42cae96a36 (docs) add azure example for testing 2023-10-23 11:25:08 -07:00
ishaan-jaff
31e44aa87e (docs) gcloud run proxy 2023-10-23 11:20:00 -07:00
ishaan-jaff
b32c211669 (docs) proxy server 2023-10-23 11:10:24 -07:00
ishaan-jaff
c33fab924f (docs) update testing proxy 2023-10-23 10:58:38 -07:00
Ishaan Jaff
e1b873a2a0
Merge pull request #673 from kevinjyee/main
Update function calling docs
2023-10-23 10:42:34 -07:00
ishaan-jaff
0b7cc4b419 (docs) testing gcp proxy 2023-10-23 10:31:01 -07:00
ishaan-jaff
af5685ba5e (docs) proxy server instructions 2023-10-23 10:10:55 -07:00
Kevin Yee
54cd10db15 Update function calling docs 2023-10-23 13:03:39 -04:00
ishaan-jaff
5b88363433 (docs) proxy server 2023-10-23 09:50:09 -07:00
ishaan-jaff
0903cdd088 (docs) proxy server 2023-10-23 09:47:06 -07:00
ishaan-jaff
c07cae58f1 (docs) proxy server 2023-10-23 09:38:09 -07:00
ishaan-jaff
98a7f37d5f (docs) set env variables on google cloud run 2023-10-23 09:36:11 -07:00
Ishaan Jaff
3c5fb92a14
Merge pull request #671 from shrikant14/aws-client-docs
Incorrect boto3 parameter name
2023-10-23 08:53:31 -07:00
ishaan-jaff
cc1ea6e3c8 (docs) proxy server 2023-10-23 08:45:42 -07:00
ishaan-jaff
d68f50785a (docs) deploy on Google cloud run 2023-10-23 08:41:50 -07:00
ishaan-jaff
959d44e8a4 (docs) add deploy to cloud run 2023-10-23 08:40:15 -07:00
shrikant
59b139f8d2 incorrect boto3 parameter name 2023-10-23 10:12:20 -05:00
Krrish Dholakia
1c2883a928 docs(simple_proxy.md): adding docs on simple deployed proxy server
n
2023-10-23 07:57:03 -07:00
Krrish Dholakia
a05e3d2d8b docs(token_usage.md): fix docs 2023-10-21 16:16:20 -07:00
Krrish Dholakia
c300ab45d4 docs(token_usage.md): fix completion cost docs 2023-10-21 16:15:11 -07:00
Krrish Dholakia
3fac512b74 docs(caching): add custom key value pairs to caching docs
b
2023-10-21 12:37:17 -07:00
ishaan-jaff
d9bba09f5d (docs) perplexity 2023-10-21 10:27:34 -07:00
Pratik date
0b51f1ecb9
Update index.md 2023-10-21 12:22:41 +05:30
ishaan-jaff
9884bbd196 (docs) perplexity ai api 2023-10-20 14:47:16 -07:00
Krrish Dholakia
0b94e968e1 docs(multiple_deployments.md): docs on how to route between multiple deployments 2023-10-20 14:30:29 -07:00
Krrish Dholakia
62d9ce6e66 docs(token_usage.md): add docs on token encoding and decoding 2023-10-20 12:10:18 -07:00
ishaan-jaff
9e25e6e6b4 (docs) add timeout param 2023-10-20 11:55:42 -07:00
Krrish Dholakia
4198901a2d docs(token_usage.md): adding new register model function 2023-10-19 18:33:53 -07:00
Prasad Chalasani
4e9b690460 proxy server: fix langroid part 2023-10-19 17:20:20 -04:00
Krrish Dholakia
41b7237c8a docs(gradio): fixing twitter handle for contributor 2023-10-19 11:37:32 -07:00
ishaan-jaff
8f13f376e4 (docs) perplexity ai provider 2023-10-19 10:02:39 -07:00
ishaan-jaff
ba0fa553b4 (docs) cleanup integrations 2023-10-19 09:40:51 -07:00
Krrish Dholakia
7967f2a82e docs(proxy_server.md): clean up docs 2023-10-19 09:33:58 -07:00
ishaan-jaff
49097c5a3d (docs) add slack callback for litellm 2023-10-19 09:32:29 -07:00
ishaan-jaff
32e1bbb793 (docs) fix sidebar js 2023-10-19 09:14:21 -07:00
Krrish Dholakia
52ff9054e4 docs(proxy_server.md): refactor docs to improve docker image tutorial 2023-10-19 09:10:07 -07:00
Krish Dholakia
5cb27d4580
Merge pull request #645 from dcruiz01/add-gradio-integration-tutorial
Tutorial for using LiteLLM within Gradio Chatbot Application
2023-10-19 08:36:46 -07:00
Nir Gazit
c21e86faec fix: bugs in traceloop integration 2023-10-19 17:23:51 +02:00
Krrish Dholakia
e0350bd0cb docs(routing.md): improve readability 2023-10-18 17:52:56 -07:00
Krrish Dholakia
8e982fcda6 docs(routing.md): cleanup 2023-10-18 17:48:11 -07:00
Krrish Dholakia
985dffe54b docs(routing.md): add proxy with multiple azure deployments to docs 2023-10-18 17:47:14 -07:00
ishaan-jaff
d59491f704 (docs) calculate cost for streaming responses 2023-10-18 17:46:37 -07:00
ishaan-jaff
0a83d1a924 (docs) add how to track costs for streaming responses 2023-10-18 17:42:55 -07:00
ZQ
47cfae618e
Update sidebars.js 2023-10-18 17:37:59 -07:00
ishaan-jaff
c8f8686d7c (docs) fix traceloop pip 2023-10-18 17:35:38 -07:00
Krrish Dholakia
2e5db47ad0 docs(routing.md): make title more clear 2023-10-18 16:39:05 -07:00
dcruiz01
b0e2992244 Added Gradio integration tutorial 2023-10-18 15:31:59 -07:00
Krrish Dholakia
07b6b2f44e docs(proxy_server.md): add librechat and smart-chatbot-ui tutorials 2023-10-18 15:30:14 -07:00
Krrish Dholakia
1ba4297d09 docs(routing.md): redis cache
n
2023-10-18 14:39:01 -07:00
Krrish Dholakia
64eeb0d421 docs(routing.md): rename routing file 2023-10-18 14:26:59 -07:00
Krrish Dholakia
bace883dcf docs(routing.md): adding router to docs 2023-10-18 14:20:53 -07:00
ishaan-jaff
44991629ab (docs) langsmith callbacks 2023-10-18 12:59:06 -07:00
ishaan-jaff
d135abbf86 (docs) advanced lagsmith usage 2023-10-18 12:56:43 -07:00
ishaan-jaff
556d3af09e (docs) add langsmith callback docs 2023-10-18 12:13:39 -07:00
Krrish Dholakia
91efd2b85f docs(index.md): show that you can iterate over streaming response 2023-10-18 11:30:11 -07:00
Krrish Dholakia
c528880021 docs(redis_cache.md): create a separate file for redis cache docs 2023-10-18 11:27:28 -07:00
Nir Gazit
4602a61c58 fixed typo in Traceloop docs 2023-10-18 19:47:19 +02:00
Nir Gazit
c5da6f36be fix: updates to traceloop docs 2023-10-18 19:37:12 +02:00
ishaan-jaff
0aa3563ccf (docs) add wandb callback 2023-10-17 18:15:58 -07:00
Krrish Dholakia
ebc34ddeb6 docs(proxy_server.md): adding perf details 2023-10-17 14:33:43 -07:00
ishaan-jaff
efe04cab5a (docs) add support & talk to founders to all docs for logging & obs 2023-10-17 14:14:46 -07:00
ishaan-jaff
cbd2c5816a (docs) add logging & observability to docs 2023-10-17 14:08:51 -07:00
Krrish Dholakia
8d56e6dad2 docs(proxy_server.md): cleanup 2023-10-17 13:30:16 -07:00
Krrish Dholakia
e2248e27e5 docs(proxy_server.md): adding chatdev tutorial to docs 2023-10-17 12:38:40 -07:00
ishaan-jaff
38671ff740 (docs) langfuse 2023-10-17 12:10:26 -07:00
ishaan-jaff
53e6ef62e7 (docs) langfuse logger 2023-10-17 12:05:30 -07:00
ishaan-jaff
e4397e7e2a (docs) langfuse callback 2023-10-17 11:59:13 -07:00
Krrish Dholakia
bf5fd640ab docs(proxy_server.md): fix docs 2023-10-17 09:28:52 -07:00
Krrish Dholakia
dcb866b353 docs(proxy_server.md): update proxy server docs to include multi-agent autogen tutorial 2023-10-17 09:22:34 -07:00
Toni Engelhardt
ff198ccce3
Verbose warning 2023-10-17 09:23:06 +01:00
ishaan-jaff
8fa9dab9fe (docs) function calling 2023-10-16 21:58:18 -07:00
ishaan-jaff
d8a5339c0b (docs) updated langfuse docs, set langfuse generation 2023-10-16 21:41:45 -07:00
Krrish Dholakia
1df487a45d docs(proxy_server): cleanup docs 2023-10-16 15:38:57 -07:00
Krrish Dholakia
529834fdf8 docs(proxy_server.md): add docs on how to self host proxy with docker image 2023-10-16 15:19:13 -07:00
ishaan-jaff
02085671a6 (docs) function calling for Non OpenAI LLMs 2023-10-16 11:27:14 -07:00
Krrish Dholakia
d0dec2f2ed docs(proxy_server.md): add perplexityai api key to docs 2023-10-15 22:53:29 -07:00
ishaan-jaff
b6aa9cb82d (docs) add function calling examples and function_to_dict 2023-10-14 18:39:30 -07:00
Krrish Dholakia
2a111cfb58 docs(custom_callback.md): improve example 2023-10-14 12:30:49 -07:00
Krrish Dholakia
087b67d753 docs(custom_callback.md): add details for how to pass additional metadata to completion call 2023-10-14 12:24:45 -07:00
Krrish Dholakia
d6f2d9b9bb docs(custom_callback.md): add details on what kwargs are passed to custom callbacks 2023-10-14 11:29:26 -07:00
Krrish Dholakia
fc757dc1b4 docs(proxy_server.md): add logs, save keys, model fallbacks, config file template to proxy server docs 2023-10-14 10:52:01 -07:00
ishaan-jaff
7641729657 (docs) update embedding docs 2023-10-14 10:27:22 -07:00
ishaan-jaff
8251e71a2a (docs) add deepinfra models + pricing 2023-10-14 10:05:06 -07:00
ishaan-jaff
81becfa2ec (docs) fix formatting 2023-10-13 21:48:24 -07:00
ishaan-jaff
680bf6f110 (docs) add example of using Azure with passing api_key, api_base, api_version 2023-10-13 21:27:01 -07:00
Krrish Dholakia
d9ddd7b338 fix(proxy_server): cleaning up print statements 2023-10-13 20:16:31 -07:00
Krrish Dholakia
d0e7c3016e docs(model_config_proxy.md): add tutorial on saving custom prompt templates for openai-compatible server 2023-10-13 16:31:02 -07:00
ishaan-jaff
3cec7fb77c (docs) langchain 2023-10-13 14:38:45 -07:00
ishaan-jaff
672ba7db14 (docs) continue dev integration 2023-10-13 14:36:40 -07:00
ishaan-jaff
ab59e250d6 (docs) add replit embedding langfuse docs 2023-10-13 14:33:29 -07:00
ishaan-jaff
cc9b0b440a (docs) proxy_server - example using continue dev 2023-10-13 14:15:43 -07:00
Krrish Dholakia
c09104e577 docs(docs): cleanup 2023-10-13 13:04:22 -07:00