Commit Graph

1276 Commits

Author SHA1 Message Date
ishaan-jaff
5295168bda (docs) router 2024-01-19 20:46:43 -08:00
ishaan-jaff
6bc7cc46b4 (docs) router debugging 2024-01-19 15:18:00 -08:00
Tim Asp
315fbcd09f update docs 2024-01-19 11:39:39 -08:00
Krrish Dholakia
62e35f6a14 docs(users.md): add tpm rpm rate limits to docs 2024-01-19 08:56:47 -08:00
Krrish Dholakia
c5e144af23 docs(health.md): add /health/readiness and /health/liveliness to docs 2024-01-19 08:45:23 -08:00
ishaan-jaff
cdede8836f (docs)virtual keys 2024-01-18 15:16:40 -08:00
ishaan-jaff
0e3e8050d7 (docs) /key/info 2024-01-18 14:54:11 -08:00
ishaan-jaff
d5e720e161 (docs) /key/update 2024-01-18 14:45:49 -08:00
ishaan-jaff
f405a827e3 (docs) virtual_keys 2024-01-18 13:55:32 -08:00
ishaan-jaff
1c987a436e (docs) virtual_keys 2024-01-18 13:34:33 -08:00
Krrish Dholakia
37e6c6a59f docs(sidebars.js): simplify docs nav 2024-01-18 11:38:02 -08:00
Krrish Dholakia
354a0b2497 docs(sidebar.js): add link to all endpoints in sidebar 2024-01-18 11:21:55 -08:00
Duarte OC
5d0654e6f6 docs 2024-01-18 17:32:42 +01:00
Krrish Dholakia
a6cd068c49 docs(virtual_keys.md): add model access groups to docs 2024-01-17 20:38:41 -08:00
Krrish Dholakia
70c4227f5e docs(bedrock.md): add sts based auth to docs 2024-01-17 12:17:09 -08:00
ishaan-jaff
5bb4fdc7e4 (docs) using azure gpt4 vision enhancements 2024-01-17 11:04:38 -08:00
ishaan-jaff
3c52fec28b (docs) using azure with vision enhancements on litellm 2024-01-17 10:59:25 -08:00
ishaan-jaff
ffc655e768 (docs) proxy /key/gen 2024-01-16 20:09:43 -08:00
ishaan-jaff
4929a6c95c (docs) proxy - key management, show correct code 2024-01-16 12:02:04 -08:00
ishaan-jaff
a84c86562c (docs) controlling num_workers using env variables 2024-01-16 08:46:41 -08:00
ishaan-jaff
ab7531b6c1 (docs) failing rules 2024-01-15 21:07:16 -08:00
ishaan-jaff
2b3cc694af (docs) proxy - fail requests with custom error message 2024-01-15 17:16:56 -08:00
ishaan-jaff
07a60c19ac (docs) dynamoDB + Key management 2024-01-15 14:20:29 -08:00
Chris Mungall
2bdd35245d
Update image_generation.md
Fixed two typos
2024-01-15 11:54:01 -08:00
Ishaan Jaff
ad06b08a5e
Merge pull request #1442 from BerriAI/litellm_bedrock_provisioned_throughput
[Feat] Support Bedrock provisioned throughput LLMs
2024-01-14 10:51:28 +05:30
ishaan-jaff
7af3fe68e4 (docs) provisioned throughput bedrock models 2024-01-13 21:12:59 -08:00
ishaan-jaff
0648226c48 (docs) azure with vision enhancements 2024-01-13 15:13:37 -08:00
Krrish Dholakia
8a7a745549 Merge branch 'litellm_dynamo_db_keys' 2024-01-13 18:38:43 +05:30
ishaan-jaff
0ae8ab1b13 (docs) sso login + bedrock 2024-01-12 16:51:15 -08:00
Krrish Dholakia
b6a9274baa docs(virtual_keys.md): clearer example for /key/generate 2024-01-13 01:39:03 +05:30
Krrish Dholakia
cbdb8d68a3 docs(health.md): add text completion health check tutorial to docs 2024-01-12 00:32:06 +05:30
ishaan-jaff
c46a370919 (docs) logging proxy input / output 2024-01-11 15:37:03 +05:30
ishaan-jaff
aef2dfbf55 (docs) proxy - s3 logging 2024-01-11 10:01:52 +05:30
ishaan-jaff
cf8dd063cf (docs) add s3 logging to proxy 2024-01-11 09:45:42 +05:30
Krrish Dholakia
8394315173 docs(deploy.md): update docker version tags to main-latest 2024-01-11 02:36:25 +05:30
Krrish Dholakia
b8de5636d4 docs(quick_start.md): update docs to use correct docker image 2024-01-10 23:31:51 +05:30
ishaan-jaff
9e4449a072 (docs) bedrock - show bedrock/ prefix 2024-01-10 23:07:05 +05:30
ishaan-jaff
6e19bb87e2 (docs) proxy config - show how to set seed, temp on config.yaml 2024-01-10 22:16:04 +05:30
ishaan-jaff
03a0e04b0d (docs) proxy - we now use gunicorn default 2024-01-10 22:09:25 +05:30
ishaan-jaff
59669b4c2a (docs) key/gen link to Deploy instructions 2024-01-10 22:07:14 +05:30
Krrish Dholakia
e44d3e51aa ci(config.yml): run prisma generate before testing 2024-01-10 21:26:38 +05:30
Krrish Dholakia
0ed54ddc7f docs(virtual_keys.md): add dynamodb docs 2024-01-09 23:26:45 +05:30
Ishaan Jaff
4cfa010dbd
Merge pull request #1381 from BerriAI/litellm_content_policy_violation_exception
[Feat] Add litellm.ContentPolicyViolationError
2024-01-09 17:18:29 +05:30
ishaan-jaff
75d44fad66 (docs) add ContentPolicyViolationError 2024-01-09 17:16:35 +05:30
ishaan-jaff
248e5f3d92 (chore) remove deprecated completion_with_config() tests 2024-01-09 17:13:06 +05:30
ishaan-jaff
cc07ba1d6a (docs) move tutorials 2024-01-09 17:09:41 +05:30
ishaan-jaff
e8987d9b67 (docs) remove outdated tutorials 2024-01-09 17:06:35 +05:30
ishaan-jaff
4713309b0b (docs) using /key/generate 2024-01-09 16:21:58 +05:30
dependabot[bot]
6b548c04e4
build(deps): bump follow-redirects in /docs/my-website
Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.15.2 to 1.15.4.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases)
- [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.15.2...v1.15.4)

---
updated-dependencies:
- dependency-name: follow-redirects
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-01-09 10:24:25 +00:00
Krrish Dholakia
a4e51362b5 docs(streaming_logging.md): fix tutorial 2024-01-09 13:40:37 +05:30
Krrish Dholakia
d6361e155a docs(deploy.md): update docs for deploying proxy with connected db 2024-01-09 13:34:47 +05:30
Krrish Dholakia
11b6c66609 docs(gemini.md): fix docs 2024-01-09 09:38:04 +05:30
HeavenHM
fa9d0faf13
Update gemini.md
Added example for Gemini Vision Pro
2024-01-09 08:00:51 +05:30
ishaan-jaff
fa74831d79 (docs) control proxy debug using env vars 2024-01-08 16:15:33 +05:30
Ishaan Jaff
a70626d6e9
Merge pull request #1356 from BerriAI/litellm_improve_proxy_logs
[Feat] Improve Proxy Logging
2024-01-08 14:41:01 +05:30
ishaan-jaff
c5589e71e7 (docs) proxy, show users how to use detailed_debug 2024-01-08 12:58:23 +05:30
Krrish Dholakia
c720870f80 docs(gemini.md,-deploy.md): doc updates 2024-01-08 11:02:12 +05:30
Krish Dholakia
4ea3e778f7
Merge pull request #1315 from spdustin/feature_allow_claude_prefill
Adds "pre-fill" support for Claude
2024-01-08 10:48:15 +05:30
ishaan-jaff
7611081d55 (docs) caching + proxy 2024-01-06 15:46:53 +05:30
Krrish Dholakia
b51d98c6e3 docs: fix pip install litellm[proxy] instruction 2024-01-06 13:49:15 +05:30
Krrish Dholakia
e9350ad010 docs(quick_start.md): add ollama to proxy docs 2024-01-06 10:56:25 +05:30
spdustin@gmail.com
ccc0722a80 Add Claude 2.1 to Bedrock support table 2024-01-05 23:08:23 +00:00
spdustin@gmail.com
767679ffcf Add/fix samples for Claude pre-fill and system messages 2024-01-05 23:04:17 +00:00
spdustin@gmail.com
5d074f5b56 Adds tests and updates docs for Claude "pre-fill" 2024-01-05 22:58:41 +00:00
Krrish Dholakia
b0827a87b2 fix(caching.py): support s-maxage param for cache controls 2024-01-04 11:41:23 +05:30
Krrish Dholakia
4946b1ef6d docs(docs/index.md): add proxy details to docs 2024-01-04 11:20:43 +05:30
Krrish Dholakia
0f7d03f761 fix(proxy/rules.md): add docs on setting post-call rules on the proxy 2024-01-04 11:16:50 +05:30
ishaan-jaff
b103ab1f0b (docs) proxy - caching 2024-01-03 18:02:14 +05:30
ishaan-jaff
30c6d164d2 (docs) use s3 Cache on litellm proxy 2024-01-03 17:56:44 +05:30
ishaan-jaff
f9139e05e8 (docs) proxy - cachig 2024-01-03 17:56:44 +05:30
ishaan-jaff
64a0c175d5 (docs) simplify caching docs 2024-01-03 16:21:23 +05:30
ishaan-jaff
8bfaee9654 (docs) simplify caching docs 2024-01-03 16:20:19 +05:30
ishaan-jaff
344e8d8508 (docs) s3 cache 2024-01-03 16:16:18 +05:30
ishaan-jaff
cc29860785 (docs) s3 Cache 2024-01-03 15:42:23 +05:30
Krrish Dholakia
6c8cc33d02 docs(caching.md): fix typo 2024-01-03 12:47:16 +05:30
Krrish Dholakia
8cee267a5b fix(caching.py): support ttl, s-max-age, and no-cache cache controls
https://github.com/BerriAI/litellm/issues/1306
2024-01-03 12:42:43 +05:30
Krrish Dholakia
5055aeb254 docs(alerting.md): add alerting thresholds to docs 2024-01-03 11:21:56 +05:30
Krrish Dholakia
ff4eb5a5d4 docs(alerting.md): add slack alerting to docs 2024-01-02 22:47:01 +05:30
Krrish Dholakia
d17ffdbc83 docs(ui.md): update ui docs to for smtp server hosting 2024-01-02 22:30:17 +05:30
ishaan-jaff
8186af64c7 (docs) xinference on proxy 2024-01-02 16:57:25 +05:30
ishaan-jaff
8f8ac03961 (docs) proxy - using xinference 2024-01-02 16:55:10 +05:30
ishaan-jaff
fdd4e72503 (docs) xinference embedding 2024-01-02 15:39:25 +05:30
ishaan-jaff
0d0ee9e108 (docs) passing user config 2024-01-02 14:43:02 +05:30
ishaan-jaff
1efd1cb30f (docs) passing user_config to completion 2024-01-02 14:19:44 +05:30
ishaan-jaff
60164cd5e4 (docs) pass user config to proxy / router 2024-01-02 14:14:14 +05:30
ishaan-jaff
11f92c0074 (docs) router- init params 2024-01-02 12:14:32 +05:30
Krrish Dholakia
95f850fecc docs(ui.md): add docs on self serve ui flow 2024-01-01 18:25:52 +05:30
Krrish Dholakia
61cd800b9f fix(ui/admin.py): handles trailing '/' case 2024-01-01 17:49:54 +05:30
ishaan-jaff
20236c1c69 (docs) proxy 2024-01-01 12:40:12 +05:30
ishaan-jaff
a98d752f7b (docs) use embeddings with proxy 2024-01-01 12:31:24 +05:30
ishaan-jaff
cf902a53b4 (docs) using /embeddings with Proxy 2024-01-01 12:31:13 +05:30
ishaan-jaff
21cccd02e8 (docs) langfuse + langchain log metadata 2024-01-01 11:53:38 +05:30
ishaan-jaff
a549962f14 (docs) request/response format 2024-01-01 11:52:47 +05:30
ishaan-jaff
76f9c8cc8f (docs) request/response format proxy 2024-01-01 11:52:30 +05:30
ishaan-jaff
8b29f9a48b (docs) pass metatadata to proxy + openai client 2024-01-01 11:12:31 +05:30
ishaan-jaff
5b9973136e (docs) langfuse + proxy - log metadata 2024-01-01 11:03:00 +05:30
Krrish Dholakia
d0d08b4dce docs(routing.md): adding latency-based routing to docs 2024-01-01 08:36:40 +05:30
ishaan-jaff
c269c65371 (docs) langfuse log trace id, trace user id 2023-12-30 20:25:23 +05:30
ishaan-jaff
bf4a9f40e8 (docs) cache context manager 2023-12-30 19:50:22 +05:30
ishaan-jaff
1c93642951 (docs) caching use context manager 2023-12-30 19:43:26 +05:30