ishaan-jaff
25bbb73ce3
(docs) add claude-3
2024-03-04 07:40:18 -08:00
Krrish Dholakia
b283588eb8
refactor(budget_alerts.md): add spacing in doc
2024-03-02 23:12:49 -08:00
Krrish Dholakia
53326da1c9
refactor(budget_alerts.md): add spacing in doc
2024-03-02 23:12:34 -08:00
Krrish Dholakia
922b38301f
docs(budget_alerts.md): doc cleanup
2024-03-02 23:11:04 -08:00
ishaan-jaff
fa2c6fdebb
(docs) alerting slack budgets
2024-03-02 17:55:49 -08:00
ishaan-jaff
b2389a9b1d
(feat) improve test slack alert
2024-03-02 17:33:18 -08:00
ishaan-jaff
b7416fc946
(fix) improve example test slack alert
2024-03-02 17:33:07 -08:00
ishaan-jaff
0b85061086
(docs)
2024-03-02 16:32:33 -08:00
ishaan-jaff
fd9f8b7010
(docs) setting soft budgets
2024-03-02 13:05:00 -08:00
Krrish Dholakia
468995b288
docs(supported_embeddings.md): add vertex ai embeddings to docs
2024-03-02 09:34:01 -08:00
Ishaan Jaff
d494941dcc
Merge pull request #2285 from Linutux/patch-1
...
Update deploy.md / Update path to docker-compose.yml
2024-03-01 21:02:32 -08:00
Krrish Dholakia
d3a742efc8
docs(supported_embedding.md): add vertex ai embeddings to docs
2024-03-01 20:57:23 -08:00
Tim Xia
dc84e28c41
update docs for supported models
2024-03-01 23:34:04 -05:00
ishaan-jaff
d1465ed57e
(feat) add gpt-3.5-turbo-instruct-0914
2024-03-01 20:02:12 -08:00
Krrish Dholakia
5e516522fb
docs(azure.md): improve azure docs
2024-03-01 19:40:55 -08:00
Simon Zöllner
57bde371d6
Update deploy.md / Update path to docker-compose.yml
...
The file seems to have been moved
2024-03-01 23:32:47 +01:00
Vince Loewe
05c0fa8b9b
Merge branch 'main' into main
2024-03-01 13:37:17 -08:00
ishaan-jaff
edab94c0a6
(docs) load balancing on proxy
2024-03-01 12:28:59 -08:00
ishaan-jaff
295d36a383
(docs) load balancing
2024-03-01 11:46:42 -08:00
ishaan-jaff
4bfefd2b08
(feat) add groq api pricing, models
2024-02-29 16:11:22 -08:00
Ishaan Jaff
d2115d5a17
Merge pull request #2263 from BerriAI/litellm_gpt_gemini_base_64
...
[FEAT] Use Base64 images with vertex_ai/gemini-pro-vision
2024-02-29 16:01:19 -08:00
ishaan-jaff
02c3955c51
(docs) using gemini vision with base64
2024-02-29 15:55:56 -08:00
Ishaan Jaff
e044d6332f
Merge pull request #2255 from BerriAI/litellm_admin_ui_user_panel_load_time_high
...
[FEAT] proxy add pagination on /user/info endpoint (Admin UI does not load all users)
2024-02-29 13:22:00 -08:00
ishaan-jaff
2415dc7927
(docs) /user/info
2024-02-29 13:05:07 -08:00
ishaan-jaff
ed85d2de95
(docs) /user/info
2024-02-29 13:04:41 -08:00
Ishaan Jaff
3d2150afcc
Merge pull request #2247 from BerriAI/litellm_mistral_azure_ai_fixes
...
[FEAT] mistral azure - use with env vars + added pricing
2024-02-29 12:22:53 -08:00
ishaan-jaff
3fea348e4e
(docs) enterprise update
2024-02-29 11:42:19 -08:00
ishaan-jaff
817fa2483a
(docs) mistral on azure ai studio
2024-02-29 08:28:19 -08:00
ishaan-jaff
46134d3fba
(docs) using mistral azure ai studio
2024-02-29 08:14:24 -08:00
Vince Loewe
f98619e6f2
Merge branch 'BerriAI:main' into main
2024-02-28 22:18:14 -08:00
Krrish Dholakia
f120f94cc9
docs(ui.md): update
2024-02-28 21:25:39 -08:00
ishaan-jaff
76e7f8831f
(docs) check if supports function calling
2024-02-28 17:41:54 -08:00
Krrish Dholakia
a042092faa
test: removing bedrock claude-v1 testing - bedrock removed this
2024-02-28 11:08:17 -08:00
Vince Loewe
a9648613dc
feat: LLMonitor is now Lunary
2024-02-27 22:07:13 -08:00
Ishaan Jaff
990439c49c
Merge branch 'main' into litellm_daily_metrics
2024-02-27 20:33:35 -08:00
ishaan-jaff
4fb723f119
(docs) show /daily_metrics
2024-02-27 19:34:47 -08:00
ishaan-jaff
d19370083d
(feat) update /daily metrics
2024-02-27 18:33:59 -08:00
ishaan-jaff
7cabc6ac56
(docs) show daily metrics tab
2024-02-27 18:03:15 -08:00
ishaan-jaff
7485fa797c
(docs) vertex ai litellm proxy
2024-02-27 17:55:05 -08:00
ishaan-jaff
f3144dd9cf
(docs) vertex ai
2024-02-27 17:44:35 -08:00
ishaan-jaff
8075746078
(docs) fix clickhouse link
2024-02-26 18:35:33 -08:00
ishaan-jaff
9bb55a0671
add clickhouse docs
2024-02-26 18:31:10 -08:00
ishaan-jaff
c627ce6631
(docs) use azure ai studio + mistral litellm
2024-02-26 14:33:21 -08:00
ishaan-jaff
da4832d5a2
(feat) add mistral-large-latest
2024-02-26 09:25:44 -08:00
Krrish Dholakia
577a0f9440
docs: add gemini-1.5 to docs
2024-02-26 08:01:30 -08:00
Krish Dholakia
61d69b1efa
Merge pull request #2183 from BerriAI/litellm_team_rate_limits
...
fix(proxy_server.py): allow user to set team tpm/rpm limits/budget/models
2024-02-25 01:12:39 -08:00
ishaan-jaff
7c19783d32
(docs) writing custo add
2024-02-24 18:54:46 -08:00
Ishaan Jaff
c8daf61592
Merge pull request #2188 from BerriAI/litellm_fix_health_checks
...
[Fix] Fix health check when API base set for OpenAI compatible models
2024-02-24 18:47:13 -08:00
ishaan-jaff
a4d2d1c4e6
(docs) using openai compatible endpoints
2024-02-24 18:46:20 -08:00
ishaan-jaff
bf403dc02e
(docs) health
2024-02-24 18:38:39 -08:00
ishaan-jaff
986babfeaa
(docs) open router
2024-02-24 18:30:41 -08:00
ishaan-jaff
7c032fcc05
(docs) open router
2024-02-24 18:28:32 -08:00
Krrish Dholakia
0b77420087
docs(users.md): add team budgets to docs
2024-02-24 11:41:42 -08:00
Krrish Dholakia
edaf20b60a
docs(enterprise.md): add end user opt out to docs
2024-02-24 09:28:41 -08:00
Krrish Dholakia
308c73fca9
docs(contributing.md): add docs for contributing to litellm ui
2024-02-23 13:01:34 -08:00
ishaan-jaff
602b25972d
(docs) add groq ai
2024-02-23 10:40:33 -08:00
Krrish Dholakia
44b8270bf6
docs(enterprise.md): add banned keywords to docs
2024-02-23 10:07:31 -08:00
ishaan-jaff
c2325539e7
(docs) fix athina docs
2024-02-23 09:56:10 -08:00
Ishaan Jaff
9594ceae55
Merge pull request #2164 from BerriAI/litellm_support_extra_headers
...
[FEAT] Support extra headers - OpenAI / Azure
2024-02-23 09:42:09 -08:00
Ishaan Jaff
5ec3075fb1
Merge pull request #2163 from vivek-athina/feature/athina
...
Support for Athina logging
2024-02-23 09:39:06 -08:00
ishaan-jaff
c9567c8652
(docs) passing extra_headers to OpenAI
2024-02-23 09:27:48 -08:00
Vivek Aditya
0d3046dcc9
added athina to logging doc
2024-02-23 22:33:09 +05:30
ishaan-jaff
aa9164e2ce
(docs) setting extra_headers
2024-02-23 08:56:09 -08:00
Krrish Dholakia
d1a40ecacf
docs(load_balancing.md): have proxy routing docs point to sdk routing docs
2024-02-23 08:34:15 -08:00
Vivek Aditya
244fa1c4ab
Support for Athina logging
2024-02-23 21:49:40 +05:30
Krish Dholakia
e7cce90c3a
Merge pull request #2144 from BerriAI/litellm_blocked_user_list
...
feat(proxy_server.py): add support for blocked user lists (enterprise-only)
2024-02-22 21:34:07 -08:00
ishaan-jaff
21e1c2dc21
(docs) admin ui with proxy_base_url
2024-02-22 21:18:26 -08:00
ishaan-jaff
2122a7cf1e
(docs) set user tpm/rpm limits
2024-02-22 19:23:16 -08:00
Krrish Dholakia
6ad450396b
docs(enterprise.md): add Enable Blocked User Lists for docs
2024-02-22 18:04:29 -08:00
ishaan-jaff
b6886b8714
(docs) set hosted image for custom branding
2024-02-22 15:40:15 -08:00
ishaan-jaff
6a48fa64ce
(docs) set generic user attributes
2024-02-22 14:25:07 -08:00
Ishaan Jaff
b603d9784d
Merge pull request #2129 from adrien-f/sso
...
update generic SSO login
2024-02-22 13:21:53 -08:00
ishaan-jaff
580f9e3097
(docs) setting cache paras on proxy + Openai client
2024-02-22 13:17:32 -08:00
ishaan-jaff
5c888853c7
(docs) litellm proxy server
2024-02-22 07:55:23 -08:00
Adrien Fillon
90f0062fc6
update generic SSO login
...
During implementation for Okta, noticed a few things:
- Some providers require a state parameter to be sent
- Some providers require that the client_id is not included in the body
Moreover, the OpenID response converter was not implemented which
was returning an empty response.
Finally, there was an order where there's a fetch of user information
but on first usage, it is not created yet.
2024-02-22 14:34:18 +01:00
ishaan-jaff
f04b67c433
(docs) custom ui branding
2024-02-21 22:07:40 -08:00
ishaan-jaff
7419547ba1
(docs) model max budgets
2024-02-20 21:11:17 -08:00
ishaan-jaff
2b2e62477b
(docs) use correct base model for cost
2024-02-20 21:00:43 -08:00
Krrish Dholakia
987cb38976
docs(pii_masking.md): docs for ad-hoc recognizers for pii masking
2024-02-20 16:08:34 -08:00
Krrish Dholakia
1227964155
docs(enterprise.md): clarify what's in enterprise
2024-02-20 08:43:28 -08:00
Krrish Dholakia
fde478f70b
docs(enterprise.md): add llm guard to docs
2024-02-19 21:05:01 -08:00
Krrish Dholakia
54e9b5b99a
docs(enterprise.md): add customizing llama guard prompt to docs
2024-02-19 15:22:09 -08:00
Krrish Dholakia
7348956bf2
docs(enterprise.md): add google text moderations to the docs
2024-02-19 14:17:52 -08:00
Krish Dholakia
6f77a4a31e
Merge pull request #2037 from BerriAI/litellm_request_level_pii_masking
...
feat(presidio_pii_masking.py): allow request level controls for turning on/off pii masking
2024-02-17 19:05:14 -08:00
Krrish Dholakia
045d84e167
fix(proxy_cli.py): allow user to control db connection pool + timeouts from config
2024-02-17 19:03:43 -08:00
Krish Dholakia
ad81e19282
Merge pull request #2013 from afbarbaro/litellm_gemini_safety_settings
...
Add safety_settings parameter to gemini generate_content calls
2024-02-17 16:47:29 -08:00
Ishaan Jaff
35af2d666b
Merge pull request #2022 from BerriAI/litellm_budgets_per_llm
...
[FEAT] Track spend per model (for Key, User and Team)
2024-02-17 15:35:31 -08:00
ishaan-jaff
1652e894c1
(docs) set budget per model
2024-02-17 15:34:55 -08:00
Andres Barbaro
b10bf2083c
Update gemini documentation
2024-02-17 17:31:37 -06:00
ishaan-jaff
c5891c3ee8
(fix) docs - incorrect title
2024-02-17 13:26:45 -08:00
Ishaan Jaff
ab8df9c284
Merge pull request #2039 from BerriAI/litellm_customizationroot_path
...
[FEAT] Set FastAPI root path
2024-02-17 13:23:31 -08:00
Ishaan Jaff
3fe762b8b1
Merge pull request #2018 from Lunik/feat/refresh-helm-chart
...
✨ Refresh Helm chart structure
2024-02-17 13:19:11 -08:00
ishaan-jaff
67932dccbc
(docs) setting server root path
2024-02-17 13:12:06 -08:00
Krrish Dholakia
448537e684
feat(presidio_pii_masking.py): allow request level controls for turning on/off pii masking
...
https://github.com/BerriAI/litellm/issues/2003
2024-02-17 11:04:56 -08:00
Krrish Dholakia
e3fab50853
docs(call_hooks.md): add async_moderation_hook to docs
2024-02-17 09:40:34 -08:00
Krrish Dholakia
0cd2deee63
docs(call_hooks.md): add async_moderation_hooks to docs
2024-02-17 09:38:36 -08:00
Krrish Dholakia
3565f74338
docs(enterprise.md): add llama guard tutorial to enterprise docs
2024-02-17 09:25:49 -08:00
Ishaan Jaff
4d4653b619
Merge branch 'main' into litellm_fix_generic_sso
2024-02-16 14:51:46 -08:00
ishaan-jaff
4ab697c6c2
(Docs) generic sso provider
2024-02-16 14:47:15 -08:00
Ishaan Jaff
e6b9e5b46f
Merge pull request #2020 from Lunik/feat/generic-sso-scopes
...
✨ Allow to configure scopes in generic SSO
2024-02-16 14:45:09 -08:00
Lunik
21552620ed
📝 Clarify GENERIC_SCOPE usage
...
Signed-off-by: Lunik <lunik@tiwabbit.fr>
2024-02-16 23:40:59 +01:00
Lunik
af4537e421
✨ Allow to configure scopes in generic SSO
...
Signed-off-by: Lunik <lunik@tiwabbit.fr>
2024-02-16 23:24:58 +01:00
ishaan-jaff
6e1708f595
(docs) use litellm ghcr as base image
2024-02-16 14:02:46 -08:00
Lunik
880213d4a6
✨ Refresh Helm chart structure
...
Signed-off-by: Lunik <lunik@tiwabbit.fr>
2024-02-16 22:59:14 +01:00
ishaan-jaff
d574bfc297
(docs) view spend per tag
2024-02-16 10:47:33 -08:00
Krrish Dholakia
a938b296a3
docs(pii_masking.md): allow keys to turn off pii masking
2024-02-16 00:04:24 -08:00
ishaan-jaff
92612c0d4e
(docs) custom callback apis
2024-02-15 17:16:36 -08:00
ishaan-jaff
b6b5e0e7c2
(docs) use async callback APIs
2024-02-15 17:06:16 -08:00
Krish Dholakia
57654f4533
Merge branch 'main' into litellm_aioboto3_sagemaker
2024-02-14 21:46:58 -08:00
ishaan-jaff
3d03f65b08
(docs) generic sso
2024-02-14 15:07:03 -08:00
Ishaan Jaff
ed8f507536
Merge pull request #1974 from BerriAI/litellm_proxy_add_moderations_endpoint
...
[FEAT] Proxy Add /moderations endpoint
2024-02-14 13:07:34 -08:00
Krrish Dholakia
a61b0bf9e5
docs(pii_masking.md): add output parsing to docs
2024-02-14 12:09:05 -08:00
Krrish Dholakia
e7666d3908
docs(custom_callback.md): link to proxy docs for custom logging there
2024-02-14 11:42:13 -08:00
ishaan-jaff
f1dc656491
(docs) add moderations to docs
2024-02-14 11:34:06 -08:00
Krrish Dholakia
e590f47a44
docs(health.md): add docs on image generation health checks
2024-02-13 23:31:05 -08:00
ishaan-jaff
b81f8ec8ca
(docs) fix docker run command
2024-02-13 21:47:23 -08:00
Ishaan Jaff
003feda33f
Merge branch 'main' into litellm_dynamo_use_arn
2024-02-13 21:27:38 -08:00
Krrish Dholakia
f09c09ace4
docs(pii_masking.md): fix presidio tutorial
2024-02-13 07:42:27 -08:00
Krrish Dholakia
f3a950705c
docs(pii_masking.md): add pii masking to proxy docs
2024-02-12 21:40:34 -08:00
Krrish Dholakia
ad7e856a02
docs(pii_masking.md): add pii masking to proxy docs
2024-02-12 11:36:52 -08:00
deena
2d62353309
docs to include langfuse trace tags feature
2024-02-12 20:26:32 +02:00
ishaan-jaff
7d67096756
(docs) virtual keys
2024-02-12 08:54:18 -08:00
ishaan-jaff
ef89144eaf
(docs) caching proxy server
2024-02-12 08:32:00 -08:00
ishaan-jaff
fb7958dc40
(docs) caching
2024-02-12 08:27:52 -08:00
ishaan-jaff
60de5ce643
(docs) Restrict models by team_id
2024-02-10 21:26:16 -08:00
ishaan-jaff
e0cd109d28
(docs) ssl_settings for litellm proxy
2024-02-10 18:17:15 -08:00
Krrish Dholakia
7bd4737018
docs(ui.md): update ui docs
2024-02-10 17:26:04 -08:00
Krrish Dholakia
d1893129f7
docs(custom_pricing.md): add disclaimer on pricing in custom pricing docs
2024-02-10 07:40:19 -08:00
ishaan-jaff
5078ed1ace
(docs) llamaindex + proxy
2024-02-09 17:06:49 -08:00
ishaan-jaff
e3f5579091
(docs) use llama index with litellm proxy
2024-02-09 16:57:48 -08:00
ishaan-jaff
cf16687509
(docs) litellm
2024-02-09 10:27:46 -08:00
ishaan-jaff
694f0d6af5
(docs) proxy quickstart
2024-02-09 10:21:39 -08:00
ishaan-jaff
854eee3785
(docs) getting started
2024-02-09 09:42:37 -08:00
David Leen
140d915adf
Add support for AWS credentials from profile file
...
https://boto3.amazonaws.com/v1/documentation/api/latest/guide/credentials.html#aws-config-file
2024-02-08 15:10:50 -08:00
Krrish Dholakia
9be5e2f7e3
docs(enterprise.md): adding enterprise support to docs
2024-02-08 10:02:40 -08:00
Ishaan Jaff
98b0ace2e9
Merge pull request #1874 from BerriAI/litellm_azure_base_model_pricing
...
[FEAT] Azure Pricing - based on base_model in model_info
2024-02-07 18:37:55 -08:00
ishaan-jaff
c98e247b0f
(docs) azure/gpt-4-0125-preview
2024-02-07 18:22:38 -08:00
ishaan-jaff
206a6845ac
(docs) pricing base_model
2024-02-07 16:54:24 -08:00
Krrish Dholakia
66913222a1
docs(langfuse_integration.md): docs for showing how to log errors to langfuse
2024-02-07 12:07:11 -08:00
Krrish Dholakia
048acc8e68
docs(ui.md): add more help to docs
2024-02-07 11:46:57 -08:00
Krrish Dholakia
2fcbe06af8
docs(ui.md): add proxy admin view to docs
2024-02-07 11:38:27 -08:00
Krrish Dholakia
e165ec40d4
docs(ui.md): ui doc updates
2024-02-07 11:38:27 -08:00
ishaan-jaff
5f4b06fb19
(docs) caching
2024-02-06 19:39:32 -08:00
ishaan-jaff
8208ebd9db
(docs) budget per end_user
2024-02-06 15:39:45 -08:00
Krrish Dholakia
fa5f4b9774
test(test_completion.py): fix test
2024-02-06 13:29:47 -08:00
Ishaan Jaff
7cb69c72c8
Merge branch 'main' into litellm_add_semantic_cache
2024-02-06 11:18:43 -08:00
ishaan-jaff
54c920c299
(docs) litellm semantic caching
2024-02-06 10:54:55 -08:00
ishaan-jaff
93504915d7
(docs) redis cache
2024-02-06 10:53:28 -08:00
ishaan-jaff
bdc2091838
(docs) using semantic caching on proxy
2024-02-06 10:32:07 -08:00
TanaroSch
b69cb2c773
change max_tokens float to int
2024-02-06 11:19:28 +01:00
ishaan-jaff
d4fd287617
(docs) upperbound_key_generate_params
2024-02-05 22:37:05 -08:00
David Manouchehri
c77deb12b3
(docs) Add session_id to Langfuse doc
2024-02-05 15:21:05 -05:00
ishaan-jaff
7e43d22da4
(docs) update ui
2024-02-03 20:43:43 -08:00
Krish Dholakia
6408af11b6
Merge pull request #1799 from BerriAI/litellm_bedrock_stable_diffusion_support
...
feat(bedrock.py): add stable diffusion image generation support
2024-02-03 12:59:00 -08:00
Krrish Dholakia
269866edc9
docs(bedrock.md): add image generation docs to bedrock file
2024-02-03 12:17:30 -08:00
ishaan-jaff
3f2f864cc8
(docs) /user/new
2024-02-03 10:59:06 -08:00
Krrish Dholakia
6cdb9aede0
docs(logging.md): add team-based logging to docs
2024-02-02 20:15:49 -08:00
Krrish Dholakia
aac8106c37
docs(vertex.md): adding vertex ai model garden support to docs
2024-02-02 18:42:56 -08:00
ishaan-jaff
662d5e8b85
(docs) set ssl_verify for OpenAI
2024-02-01 21:07:58 -08:00
Krrish Dholakia
1a1b929a4e
docs(token_usage.md): add LITELLM_LOCAL_MODEL_COST_MAP to docs
2024-02-01 18:05:13 -08:00
ishaan-jaff
bfdc3f6205
(docs) ui
2024-02-01 16:17:35 -08:00
ishaan-jaff
631657ba5e
(docs) remove PROXYBASEURL
2024-02-01 13:09:03 -08:00
ishaan-jaff
deecf13bdc
(docs) use bedrock + aws_region on proxy
2024-02-01 10:10:51 -08:00
Krrish Dholakia
ee50e97c98
docs(configs.md): add aws routing to proxy docs
2024-02-01 08:50:20 -08:00
ishaan-jaff
dbd947a366
(docs) update proxy ui docs
2024-01-31 19:54:04 -08:00
ishaan-jaff
cfa69c3184
(docs) UI - no sso
2024-01-30 17:05:36 -08:00
ishaan-jaff
693c6ec40e
(docs) ui + sso callbacks
2024-01-30 15:41:01 -08:00
ishaan-jaff
5c0f9f421c
(docs) setting organization on config.yaml
2024-01-30 11:08:52 -08:00
Krrish Dholakia
5531fd014a
docs(configs.md): add complete proxy config in docs
2024-01-30 07:48:56 -08:00
ishaan-jaff
56214b7971
(docs) default /key/generate params
2024-01-29 17:06:11 -08:00
Ishaan Jaff
1102863ca8
Merge pull request #1673 from BerriAI/litellm_version_health_readiness
...
[Feat] return litellm version in health/readiness
2024-01-29 15:36:18 -08:00
Krrish Dholakia
f7320834af
docs(debugging.md): add docs for debugging on the proxy
2024-01-29 15:21:12 -08:00
ishaan-jaff
d974e5971a
(docs) /healthreadiness
2024-01-29 15:21:08 -08:00
ishaan-jaff
45dacc5336
(docs) Default /key/generate params
2024-01-29 14:35:22 -08:00
ishaan-jaff
29babdcc48
(docs) use admin UI
2024-01-29 12:20:18 -08:00
ishaan-jaff
1499c2ad62
(docs) hosted ui litellm
2024-01-29 09:43:55 -08:00
Krrish Dholakia
0c9e56aff1
docs(virtual_keys.md): add key alias and key name to docs
2024-01-27 20:03:07 -08:00
ishaan-jaff
950c753429
(docs) on callbacks tracking api_key, base etc
2024-01-27 08:31:50 -08:00
ishaan-jaff
21a6698a39
(docs) alerting
2024-01-26 15:22:50 -08:00
ishaan-jaff
eda2c08dd4
(docs) alerts - key, proxy budgets
2024-01-26 15:22:50 -08:00
ishaan-jaff
65fd405bd4
(docs) dimensions embedding param
2024-01-26 13:33:11 -08:00
ishaan-jaff
42270258d1
(docs) new gpt-4-0125-preview
2024-01-25 14:48:56 -08:00
ishaan-jaff
b3853c3a53
(docs) new OpenAI embedding models
2024-01-25 14:38:03 -08:00
Krrish Dholakia
fdb28407bc
docs(custom_pricing.md): fix tutorial
2024-01-25 09:36:15 -08:00
Krrish Dholakia
01a84837a7
docs(vertex.md): add vertex ai proxy tutorial to docs
2024-01-25 09:11:11 -08:00
Krrish Dholakia
389347250f
docs(users.md): add proxy budget to docs
2024-01-25 09:04:23 -08:00
ishaan-jaff
3ca82fb458
(docs) spend per user
2024-01-24 12:17:23 -08:00
ishaan-jaff
9b39893980
v0 set arn number on dynamoDB /key/gen
2024-01-24 10:29:28 -08:00
Krrish Dholakia
d9fd8f28d6
docs(users.md): add docs on resetting budget at the end of duration
2024-01-24 08:34:48 -08:00
ishaan-jaff
19af0cd3ed
(docs) admin ui
2024-01-23 19:41:40 -08:00
Krrish Dholakia
9327d76379
docs(users.md): add key budgets to docs
2024-01-23 06:42:13 -08:00
Krish Dholakia
bedb08bdef
Merge pull request #1557 from BerriAI/litellm_emit_spend_logs
...
feat(utils.py): emit response cost as part of logs
2024-01-22 21:02:40 -08:00
Krrish Dholakia
3e8c8ef507
fix(openai.py): fix linting issue
2024-01-22 18:20:15 -08:00
Ishaan Jaff
db68774d60
Merge branch 'main' into litellm_budget_per_key
2024-01-22 15:49:57 -08:00
Krrish Dholakia
82bbf336d5
docs(sidebars.js): add custom pricing to docs
2024-01-22 15:15:34 -08:00
Ishaan Jaff
5700d60e1a
Merge pull request #1538 from BerriAI/litellm_use_custom_key_gen
...
[Feat] Proxy Auth - Use custom_key_generate
2024-01-22 14:21:19 -08:00
ishaan-jaff
76214baab9
(docs) budget per key
2024-01-22 13:18:07 -08:00
Krrish Dholakia
265f5ef6da
docs(routing.md): add timeouts per model
2024-01-22 08:55:17 -08:00
ishaan-jaff
6b7fd172a3
(docs) Custom /key/generate
2024-01-20 10:12:47 -08:00
Kihaya Sugiura
82449ffcfd
docs: Fix import
2024-01-20 19:15:07 +09:00
Kihaya Sugiura
c550357199
docs: Fix import
2024-01-20 19:13:33 +09:00
ishaan-jaff
5295168bda
(docs) router
2024-01-19 20:46:43 -08:00
ishaan-jaff
6bc7cc46b4
(docs) router debugging
2024-01-19 15:18:00 -08:00
Tim Asp
315fbcd09f
update docs
2024-01-19 11:39:39 -08:00
Krrish Dholakia
62e35f6a14
docs(users.md): add tpm rpm rate limits to docs
2024-01-19 08:56:47 -08:00
Krrish Dholakia
c5e144af23
docs(health.md): add /health/readiness and /health/liveliness to docs
2024-01-19 08:45:23 -08:00
ishaan-jaff
cdede8836f
(docs)virtual keys
2024-01-18 15:16:40 -08:00
ishaan-jaff
0e3e8050d7
(docs) /key/info
2024-01-18 14:54:11 -08:00
ishaan-jaff
d5e720e161
(docs) /key/update
2024-01-18 14:45:49 -08:00
ishaan-jaff
f405a827e3
(docs) virtual_keys
2024-01-18 13:55:32 -08:00
ishaan-jaff
1c987a436e
(docs) virtual_keys
2024-01-18 13:34:33 -08:00
Krrish Dholakia
37e6c6a59f
docs(sidebars.js): simplify docs nav
2024-01-18 11:38:02 -08:00
Krrish Dholakia
354a0b2497
docs(sidebar.js): add link to all endpoints in sidebar
2024-01-18 11:21:55 -08:00
Duarte OC
5d0654e6f6
docs
2024-01-18 17:32:42 +01:00
Krrish Dholakia
a6cd068c49
docs(virtual_keys.md): add model access groups to docs
2024-01-17 20:38:41 -08:00
Krrish Dholakia
70c4227f5e
docs(bedrock.md): add sts based auth to docs
2024-01-17 12:17:09 -08:00
ishaan-jaff
5bb4fdc7e4
(docs) using azure gpt4 vision enhancements
2024-01-17 11:04:38 -08:00
ishaan-jaff
3c52fec28b
(docs) using azure with vision enhancements on litellm
2024-01-17 10:59:25 -08:00
ishaan-jaff
ffc655e768
(docs) proxy /key/gen
2024-01-16 20:09:43 -08:00
ishaan-jaff
4929a6c95c
(docs) proxy - key management, show correct code
2024-01-16 12:02:04 -08:00
ishaan-jaff
a84c86562c
(docs) controlling num_workers using env variables
2024-01-16 08:46:41 -08:00
ishaan-jaff
ab7531b6c1
(docs) failing rules
2024-01-15 21:07:16 -08:00
ishaan-jaff
2b3cc694af
(docs) proxy - fail requests with custom error message
2024-01-15 17:16:56 -08:00
ishaan-jaff
07a60c19ac
(docs) dynamoDB + Key management
2024-01-15 14:20:29 -08:00
Chris Mungall
2bdd35245d
Update image_generation.md
...
Fixed two typos
2024-01-15 11:54:01 -08:00
Ishaan Jaff
ad06b08a5e
Merge pull request #1442 from BerriAI/litellm_bedrock_provisioned_throughput
...
[Feat] Support Bedrock provisioned throughput LLMs
2024-01-14 10:51:28 +05:30
ishaan-jaff
7af3fe68e4
(docs) provisioned throughput bedrock models
2024-01-13 21:12:59 -08:00
ishaan-jaff
0648226c48
(docs) azure with vision enhancements
2024-01-13 15:13:37 -08:00
Krrish Dholakia
8a7a745549
Merge branch 'litellm_dynamo_db_keys'
2024-01-13 18:38:43 +05:30
ishaan-jaff
0ae8ab1b13
(docs) sso login + bedrock
2024-01-12 16:51:15 -08:00
Krrish Dholakia
b6a9274baa
docs(virtual_keys.md): clearer example for /key/generate
2024-01-13 01:39:03 +05:30
Krrish Dholakia
cbdb8d68a3
docs(health.md): add text completion health check tutorial to docs
2024-01-12 00:32:06 +05:30
ishaan-jaff
c46a370919
(docs) logging proxy input / output
2024-01-11 15:37:03 +05:30
ishaan-jaff
aef2dfbf55
(docs) proxy - s3 logging
2024-01-11 10:01:52 +05:30
ishaan-jaff
cf8dd063cf
(docs) add s3 logging to proxy
2024-01-11 09:45:42 +05:30
Krrish Dholakia
8394315173
docs(deploy.md): update docker version tags to main-latest
2024-01-11 02:36:25 +05:30
Krrish Dholakia
b8de5636d4
docs(quick_start.md): update docs to use correct docker image
2024-01-10 23:31:51 +05:30
ishaan-jaff
9e4449a072
(docs) bedrock - show bedrock/ prefix
2024-01-10 23:07:05 +05:30
ishaan-jaff
6e19bb87e2
(docs) proxy config - show how to set seed, temp on config.yaml
2024-01-10 22:16:04 +05:30
ishaan-jaff
03a0e04b0d
(docs) proxy - we now use gunicorn default
2024-01-10 22:09:25 +05:30
ishaan-jaff
59669b4c2a
(docs) key/gen link to Deploy instructions
2024-01-10 22:07:14 +05:30
Krrish Dholakia
e44d3e51aa
ci(config.yml): run prisma generate before testing
2024-01-10 21:26:38 +05:30
Krrish Dholakia
0ed54ddc7f
docs(virtual_keys.md): add dynamodb docs
2024-01-09 23:26:45 +05:30
Ishaan Jaff
4cfa010dbd
Merge pull request #1381 from BerriAI/litellm_content_policy_violation_exception
...
[Feat] Add litellm.ContentPolicyViolationError
2024-01-09 17:18:29 +05:30
ishaan-jaff
75d44fad66
(docs) add ContentPolicyViolationError
2024-01-09 17:16:35 +05:30
ishaan-jaff
248e5f3d92
(chore) remove deprecated completion_with_config() tests
2024-01-09 17:13:06 +05:30
ishaan-jaff
cc07ba1d6a
(docs) move tutorials
2024-01-09 17:09:41 +05:30
ishaan-jaff
e8987d9b67
(docs) remove outdated tutorials
2024-01-09 17:06:35 +05:30
ishaan-jaff
4713309b0b
(docs) using /key/generate
2024-01-09 16:21:58 +05:30
dependabot[bot]
6b548c04e4
build(deps): bump follow-redirects in /docs/my-website
...
Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects ) from 1.15.2 to 1.15.4.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases )
- [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.15.2...v1.15.4 )
---
updated-dependencies:
- dependency-name: follow-redirects
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-01-09 10:24:25 +00:00
Krrish Dholakia
a4e51362b5
docs(streaming_logging.md): fix tutorial
2024-01-09 13:40:37 +05:30
Krrish Dholakia
d6361e155a
docs(deploy.md): update docs for deploying proxy with connected db
2024-01-09 13:34:47 +05:30
Krrish Dholakia
11b6c66609
docs(gemini.md): fix docs
2024-01-09 09:38:04 +05:30
HeavenHM
fa9d0faf13
Update gemini.md
...
Added example for Gemini Vision Pro
2024-01-09 08:00:51 +05:30
ishaan-jaff
fa74831d79
(docs) control proxy debug using env vars
2024-01-08 16:15:33 +05:30
Ishaan Jaff
a70626d6e9
Merge pull request #1356 from BerriAI/litellm_improve_proxy_logs
...
[Feat] Improve Proxy Logging
2024-01-08 14:41:01 +05:30
ishaan-jaff
c5589e71e7
(docs) proxy, show users how to use detailed_debug
2024-01-08 12:58:23 +05:30
Krrish Dholakia
c720870f80
docs(gemini.md,-deploy.md): doc updates
2024-01-08 11:02:12 +05:30
Krish Dholakia
4ea3e778f7
Merge pull request #1315 from spdustin/feature_allow_claude_prefill
...
Adds "pre-fill" support for Claude
2024-01-08 10:48:15 +05:30
ishaan-jaff
7611081d55
(docs) caching + proxy
2024-01-06 15:46:53 +05:30
Krrish Dholakia
b51d98c6e3
docs: fix pip install litellm[proxy] instruction
2024-01-06 13:49:15 +05:30
Krrish Dholakia
e9350ad010
docs(quick_start.md): add ollama to proxy docs
2024-01-06 10:56:25 +05:30
spdustin@gmail.com
ccc0722a80
Add Claude 2.1 to Bedrock support table
2024-01-05 23:08:23 +00:00
spdustin@gmail.com
767679ffcf
Add/fix samples for Claude pre-fill and system messages
2024-01-05 23:04:17 +00:00
spdustin@gmail.com
5d074f5b56
Adds tests and updates docs for Claude "pre-fill"
2024-01-05 22:58:41 +00:00
Krrish Dholakia
b0827a87b2
fix(caching.py): support s-maxage param for cache controls
2024-01-04 11:41:23 +05:30
Krrish Dholakia
4946b1ef6d
docs(docs/index.md): add proxy details to docs
2024-01-04 11:20:43 +05:30
Krrish Dholakia
0f7d03f761
fix(proxy/rules.md): add docs on setting post-call rules on the proxy
2024-01-04 11:16:50 +05:30
ishaan-jaff
b103ab1f0b
(docs) proxy - caching
2024-01-03 18:02:14 +05:30
ishaan-jaff
30c6d164d2
(docs) use s3 Cache on litellm proxy
2024-01-03 17:56:44 +05:30
ishaan-jaff
f9139e05e8
(docs) proxy - cachig
2024-01-03 17:56:44 +05:30
ishaan-jaff
64a0c175d5
(docs) simplify caching docs
2024-01-03 16:21:23 +05:30
ishaan-jaff
8bfaee9654
(docs) simplify caching docs
2024-01-03 16:20:19 +05:30
ishaan-jaff
344e8d8508
(docs) s3 cache
2024-01-03 16:16:18 +05:30
ishaan-jaff
cc29860785
(docs) s3 Cache
2024-01-03 15:42:23 +05:30
Krrish Dholakia
6c8cc33d02
docs(caching.md): fix typo
2024-01-03 12:47:16 +05:30
Krrish Dholakia
8cee267a5b
fix(caching.py): support ttl, s-max-age, and no-cache cache controls
...
https://github.com/BerriAI/litellm/issues/1306
2024-01-03 12:42:43 +05:30
Krrish Dholakia
5055aeb254
docs(alerting.md): add alerting thresholds to docs
2024-01-03 11:21:56 +05:30
Krrish Dholakia
ff4eb5a5d4
docs(alerting.md): add slack alerting to docs
2024-01-02 22:47:01 +05:30
Krrish Dholakia
d17ffdbc83
docs(ui.md): update ui docs to for smtp server hosting
2024-01-02 22:30:17 +05:30
ishaan-jaff
8186af64c7
(docs) xinference on proxy
2024-01-02 16:57:25 +05:30
ishaan-jaff
8f8ac03961
(docs) proxy - using xinference
2024-01-02 16:55:10 +05:30
ishaan-jaff
fdd4e72503
(docs) xinference embedding
2024-01-02 15:39:25 +05:30
ishaan-jaff
0d0ee9e108
(docs) passing user config
2024-01-02 14:43:02 +05:30
ishaan-jaff
1efd1cb30f
(docs) passing user_config to completion
2024-01-02 14:19:44 +05:30
ishaan-jaff
60164cd5e4
(docs) pass user config to proxy / router
2024-01-02 14:14:14 +05:30
ishaan-jaff
11f92c0074
(docs) router- init params
2024-01-02 12:14:32 +05:30
Krrish Dholakia
95f850fecc
docs(ui.md): add docs on self serve ui flow
2024-01-01 18:25:52 +05:30
Krrish Dholakia
61cd800b9f
fix(ui/admin.py): handles trailing '/' case
2024-01-01 17:49:54 +05:30
ishaan-jaff
20236c1c69
(docs) proxy
2024-01-01 12:40:12 +05:30
ishaan-jaff
a98d752f7b
(docs) use embeddings with proxy
2024-01-01 12:31:24 +05:30
ishaan-jaff
cf902a53b4
(docs) using /embeddings with Proxy
2024-01-01 12:31:13 +05:30
ishaan-jaff
21cccd02e8
(docs) langfuse + langchain log metadata
2024-01-01 11:53:38 +05:30
ishaan-jaff
a549962f14
(docs) request/response format
2024-01-01 11:52:47 +05:30
ishaan-jaff
76f9c8cc8f
(docs) request/response format proxy
2024-01-01 11:52:30 +05:30
ishaan-jaff
8b29f9a48b
(docs) pass metatadata to proxy + openai client
2024-01-01 11:12:31 +05:30
ishaan-jaff
5b9973136e
(docs) langfuse + proxy - log metadata
2024-01-01 11:03:00 +05:30
Krrish Dholakia
d0d08b4dce
docs(routing.md): adding latency-based routing to docs
2024-01-01 08:36:40 +05:30
ishaan-jaff
c269c65371
(docs) langfuse log trace id, trace user id
2023-12-30 20:25:23 +05:30
ishaan-jaff
bf4a9f40e8
(docs) cache context manager
2023-12-30 19:50:22 +05:30
ishaan-jaff
1c93642951
(docs) caching use context manager
2023-12-30 19:43:26 +05:30
ishaan-jaff
231148ed73
(docs) caching
2023-12-30 19:04:36 +05:30
ishaan-jaff
7ecd7b3e8d
(docs) proxy - timeout per request
2023-12-30 11:18:03 +05:30
ishaan-jaff
6252987798
(docs) proxy - set timeout per request
2023-12-30 11:17:31 +05:30
Krrish Dholakia
1f76b0e721
docs(routing.md): add retry_after to docs
2023-12-29 15:22:12 +05:30
Krrish Dholakia
1e07f0fce8
fix(caching.py): hash the cache key to prevent key too long errors
2023-12-29 15:03:33 +05:30
Krrish Dholakia
6e68cd1125
docs(load_test.md): add litellm load test script to docs
2023-12-29 13:41:44 +05:30
ishaan-jaff
52a9696303
(docs) cloudflare
2023-12-29 12:10:32 +05:30
Krrish Dholakia
a351211d03
docs(users.md): add user rate limits to docs
2023-12-28 19:28:32 +05:30
ishaan-jaff
a1484171b5
(docs) voyage ai embeddings
2023-12-28 17:15:16 +05:30
ishaan-jaff
aa2bd93166
(docs) add voyage ai
2023-12-28 17:12:58 +05:30
ishaan-jaff
01f7e85057
(docs) add mistral embeddings
2023-12-28 16:54:26 +05:30
ishaan-jaff
7f74a0331c
(docs) add mistral-embed
2023-12-28 16:50:52 +05:30
ishaan-jaff
ab306ad5d4
(docs) deploy on railway
2023-12-28 16:35:18 +05:30
Krrish Dholakia
2f012a5088
docs(streaming_logging.md): custom streaming logging tutorial
2023-12-28 13:49:41 +05:30
ishaan-jaff
cf236a4141
(docs) add link to swagger docs
2023-12-28 12:06:46 +05:30
ishaan-jaff
b03c985a4c
(docs) proxy - add link to swagger docs
2023-12-28 12:06:46 +05:30
Krrish Dholakia
7ce7516621
docs(user_keys.md): improve user keys docs
2023-12-28 07:02:28 +05:30
Krrish Dholakia
3026e5aa58
docs(image_generation.md): fix typo
2023-12-27 20:33:22 +05:30
Krrish Dholakia
b437260ece
docs(users.md): set budgets per user docs
2023-12-27 20:30:27 +05:30
ishaan-jaff
0bf2b56c0f
(docs) proxy
2023-12-27 17:14:42 +05:30
ishaan-jaff
eb2fc42b4c
(docs) - use vertex ai with proxy cli
2023-12-27 17:12:51 +05:30
Krrish Dholakia
f8180c351f
docs(image_generation.md): add image generation to docs
2023-12-27 11:59:57 +05:30
Prateek Sachan
940c33680e
updating anyscale link to latest json present in main branch
2023-12-27 01:41:17 +05:30
Prateek Sachan
2acafb7d31
updating anyscale link to latest json present in main branch
2023-12-27 01:37:21 +05:30
Krrish Dholakia
31fbb095c2
docs(user_keys.md): update code example
2023-12-26 22:16:18 +05:30
Krrish Dholakia
1b837e9601
docs(caching.md): add cache controls to docs
2023-12-26 17:54:14 +05:30
ishaan-jaff
a5f998375c
(docs) use latest ghcr image
2023-12-26 17:28:39 +05:30
ishaan-jaff
112ffa3596
(docs) add logprobs, top_logprobs
2023-12-26 14:53:30 +05:30
ishaan-jaff
f3844b309f
(docs) input params - add logprobs, top_logprobs
2023-12-26 14:41:33 +05:30
ishaan-jaff
b2e69cbc24
(docs) input params
2023-12-26 14:36:19 +05:30
Krrish Dholakia
871f207124
docs(user_keys.md): docs on passing user keys to litellm proxy
2023-12-26 13:55:28 +05:30
ishaan-jaff
08ed509b76
(docs) azure gpt-4 vision
2023-12-26 13:18:38 +05:30
ishaan-jaff
05b9b3aacd
(docs) bump langfuse to >= 2.0.0
2023-12-26 09:23:45 +05:30
ishaan-jaff
0db0652ad3
(docs) ollama api/chat
2023-12-26 00:05:16 +05:30
Krrish Dholakia
b3a98d8400
fix(proxy_server.py): accept keys with none duration
2023-12-25 13:46:24 +05:30
ishaan-jaff
485f05ea02
(docs) ollama/json mode
2023-12-25 13:31:01 +05:30
Krrish Dholakia
c568bb6cac
docs(virtual_keys.md): add budget manager docs to proxy
2023-12-23 09:48:53 +05:30
Krrish Dholakia
97f6475035
docs(health.md): add docs on health checks for embedding models
2023-12-21 07:54:04 +05:30
ishaan-jaff
f6407aaf74
(docs) add metadata keys/generate
2023-12-21 07:43:53 +05:30
ishaan-jaff
fbab7371dc
(docs) proxy - virtual keys
2023-12-21 07:36:32 +05:30
ishaan-jaff
bab8f3350d
(docs) openrouter
2023-12-20 13:42:49 +05:30
ishaan-jaff
7d20ea23d1
(docs) set openrouter params
2023-12-20 13:42:49 +05:30
Ishaan Jaff
9fa2fe0c37
Merge pull request #1185 from navidre/prevent_key_log_documentation
...
Sample code to prevent logging API key in callback to Slack
2023-12-20 09:09:10 +05:30
ishaan-jaff
cd34b859df
(docs) swagger endpoint
2023-12-20 05:49:45 +05:30
navidre
b8d7cafb8d
Sample code to prevent logging API key
...
Sample code in documentation to prevent logging API key. Ideally should be implemented in the codebase if not already
2023-12-19 14:04:20 -06:00
ishaan-jaff
9eb487efb3
(docs) exception mapping
2023-12-19 19:29:05 +05:30
ishaan-jaff
8b0fa2322c
(docs) exception mapping azure openai
2023-12-19 19:23:52 +05:30
ishaan-jaff
dbcff752b3
(docs) exception mapping - add more details
2023-12-19 19:22:51 +05:30
ishaan-jaff
84fde01461
(fix) docs proxy + auth curl request
2023-12-19 19:11:35 +05:30
ishaan-jaff
b82fcd51d7
(docs) ollama/llava
2023-12-19 11:32:28 +05:30
Krrish Dholakia
f73c4b494c
docs(model_management.md): adding docs on how to add model metadata in the config.yaml
2023-12-18 17:57:29 -08:00
Krish Dholakia
6edc7cc2b3
Merge pull request #1178 from speedyankur/langfuse-doc-update
...
doc: updated langfuse ver 1.14 in pip install cmd
2023-12-18 17:33:29 -08:00
Ankur Garha
d6ed13fa4f
doc: updated langfuse ver 1.14 in pip install cmd
2023-12-18 22:56:08 +01:00
Eric Ma
8ec7e25c06
Update mistral.md
...
Eliminated typo with extra quotation mark.
2023-12-17 23:51:02 -05:00
Krish Dholakia
c703fb2f2c
Merge pull request #1162 from nirga/patch-2
...
clarify the need to set an exporter
2023-12-16 21:31:56 -08:00
Yusuke Kawabata
de8a3d5369
fix curl example
...
Remove unnecessary `,` from curl example
2023-12-17 12:00:06 +09:00
Nir Gazit
4dc774ab8e
clarify the need to set an exporter
2023-12-16 22:19:07 +01:00
Krrish Dholakia
4e828ff541
fix(health.md): add background health check details to docs
2023-12-16 10:31:59 -08:00
Krish Dholakia
50f61bcea4
Merge pull request #1157 from nanowell/patch-1
...
Update mistral.md
2023-12-16 08:56:39 -08:00
ishaan-jaff
c33cbbe068
(docs) - gemini-pro-visio n
2023-12-16 22:18:30 +05:30
nanowell
9f762bbd5b
Update mistral.md
...
Incorrect syntax
2023-12-16 17:51:41 +03:00
ishaan-jaff
cb34c3c3f3
(docs) gemini pro vison
2023-12-16 19:20:57 +05:30
ishaan-jaff
6f643a6107
(docs) add gemini-pro-vision
2023-12-16 19:07:36 +05:30
ishaan-jaff
7b851a3870
(docs) cache params
2023-12-16 14:45:19 +05:30
ishaan-jaff
80bf99b1af
(docs) proxy - advanced caching
2023-12-16 13:52:58 +05:30
ishaan-jaff
a04f43ef38
(docs) proxy: embeddings
2023-12-16 13:29:26 +05:30
ishaan-jaff
cc483ad69d
(docs) embedding config yaml
2023-12-16 13:14:26 +05:30
ishaan-jaff
4316477276
(docs) embedding
2023-12-16 12:44:21 +05:30
Krrish Dholakia
5b4ca42de6
docs(routing.md): add docs on using caching groups across deployments
2023-12-15 21:51:59 -08:00
ishaan-jaff
bb930b6660
(docs) dynamodb
2023-12-15 21:39:12 +05:30
ishaan-jaff
ae10299058
(docs) dynamo
2023-12-15 18:20:15 +05:30
ishaan-jaff
0f4fa487a5
(docs) dynamodb
2023-12-15 17:32:21 +05:30
ishaan-jaff
eaf4182966
(docs) log proxy i/o to dynamoDB
2023-12-15 15:59:06 +05:30
ishaan-jaff
e170d66991
docs - caching
2023-12-15 14:16:34 +05:30
ishaan-jaff
b9ff8d74ea
(docs) deploy on gcp cloud run
2023-12-15 08:50:00 +05:30
Janaka Abeywardhana
53eedbf0ee
docs(projects): add Docq.AI to side bar nav
2023-12-15 07:54:34 +05:30
Ishaan Jaff
624d00c5a8
Merge pull request #1142 from janaka/janaka/docs/add-docqai-to-projects
...
add Docq to projects section.
2023-12-15 07:38:54 +05:30
ishaan-jaff
ca0d8139ec
(docs) proxy - deploy on GCP cloud run
2023-12-15 07:29:35 +05:30
Krrish Dholakia
7df9c8e4d8
docs(proxy_server.md): fix old doc links
2023-12-14 12:07:51 -08:00
Krrish Dholakia
52564b685c
docs(openai_compatible.md): add docs on calling openai compatible endpoints via litellm pkg
2023-12-14 12:03:29 -08:00
Krrish Dholakia
d7b49dbc41
docs(call_hooks.md): add docs on pre-call hooks
2023-12-14 11:34:37 -08:00
Krrish Dholakia
589a6ca863
docs(redis_cache.md-+-custom_callbacks.md): add cache hit logging info in docs
2023-12-14 11:07:00 -08:00
Krrish Dholakia
0f14fb3797
docs(custom_callback.md): add async failure + streaming logging events to docs
...
https://github.com/BerriAI/litellm/issues/1125
2023-12-14 10:46:53 -08:00
ishaan-jaff
72a665591d
(docs) cache init params
2023-12-14 22:41:25 +05:30
ishaan-jaff
a033016a63
(docs) mistral ai api
2023-12-14 18:49:37 +05:30
Janaka Abeywardhana
aee1f3143d
add Docq to projects section.
2023-12-14 17:32:58 +05:30
ishaan-jaff
43fc152a91
(docs) caching - proxy
2023-12-14 16:33:56 +05:30
Krrish Dholakia
73ecc012a9
docs(embedding.md): add embedding docs to proxy
2023-12-13 18:58:46 -08:00
Krish Dholakia
03d6dcefbb
Merge pull request #1123 from nirga/patch-1
...
fix: traceloop links
2023-12-13 14:52:11 -08:00
Krrish Dholakia
88d09fc5a7
fix(vertex.md): adding gemini-pro support to docs
2023-12-13 14:38:55 -08:00
Nir Gazit
590f0173bc
fix: traceloop links
2023-12-13 22:23:29 +01:00
ishaan-jaff
7856d65d44
(docs) proxy dockerfile
2023-12-12 19:44:55 -08:00
ishaan-jaff
03edba5ff5
(docs) router on config
2023-12-12 19:41:11 -08:00
ishaan-jaff
c294d2c506
(docs) proxy - how to set router_settings
2023-12-12 19:35:21 -08:00
Cam Parry
30faef5052
rebase and docs
2023-12-13 09:30:14 +10:00
Krrish Dholakia
80821f62d1
docs(logging.md): add sentry logging to proxy docs
2023-12-09 23:03:48 -08:00
Krrish Dholakia
149c1b3557
docs(configs.md): added docs on how to configure routing strategy on proxy
2023-12-09 16:31:31 -08:00
ishaan-jaff
adbdb31b9d
(docs) proxy caching
2023-12-09 15:56:57 -08:00
ishaan-jaff
9e9781d193
(Docs) Proxy,remove traceloop api key req
2023-12-08 19:26:05 -08:00
ishaan-jaff
dface6a36f
(docs) traceloop
2023-12-08 18:47:18 -08:00
ishaan-jaff
0dc7d538b5
(docs) proxy - OTEL + traceloop
2023-12-08 18:39:52 -08:00
ishaan-jaff
b84f6670ea
(docs) custom callbacks proxy
2023-12-08 18:00:58 -08:00
ishaan-jaff
34428a8e67
(docs) fix
2023-12-08 17:25:05 -08:00
ishaan-jaff
977bfaaab9
(docs) proxy - get model_info,server_request
2023-12-08 14:57:29 -08:00
Krrish Dholakia
2ede903f0b
docs: fix imports
2023-12-08 07:39:13 -08:00
Krrish Dholakia
d548836903
docs: add proxy req/s
2023-12-08 07:33:33 -08:00
Krrish Dholakia
0406e01c6d
docs(deploy.md): add proxy perf to docs
2023-12-08 07:32:23 -08:00
Krrish Dholakia
e5638e2c5d
fix(router.py): fix default caching response value
2023-12-07 13:44:31 -08:00
Krrish Dholakia
7585b58d2d
docs: sagemaker embedding model added to docs
2023-12-07 11:42:51 -08:00
Krrish Dholakia
db12ca4ecb
docs(bedrock.md): add cohere embeddings to bedrock docs
2023-12-07 11:35:08 -08:00
Krrish Dholakia
2134285523
docs(quick_start.md): adding gunicorn worker script to docs
2023-12-07 11:31:54 -08:00
Krrish Dholakia
d77e0cc716
docs(config.md): adding docs on parallel request rate limiting
2023-12-07 11:27:48 -08:00
Krrish Dholakia
c7aaa4adf8
docs(deploy.md): add docker instructions to deploy docs
2023-12-07 09:22:54 -08:00
Krrish Dholakia
d18a5e8a11
docs(quick_start.md): adding langchain embedding tutorials to docs
2023-12-06 23:14:02 -08:00
ishaan-jaff
8cd9f18b61
(docs) add async success + fail custom logger
2023-12-06 17:24:39 -08:00
Krrish Dholakia
caac4f1779
docs(virtual_keys.md): fix import line
2023-12-06 15:12:23 -08:00
ishaan-jaff
cf1df8204e
(docs) proxy - custom async func
2023-12-06 15:04:24 -08:00
ishaan-jaff
0ea6241d3e
(docs) use async callback functions
2023-12-06 15:00:16 -08:00
Krrish Dholakia
f6546076b0
docs(quick_start.md): add docs on calling openai-compatible endpoint on proxy
2023-12-06 11:06:09 -08:00
Krrish Dholakia
37251d327d
docs(virtual_keys.md): add custom auth to docs
2023-12-06 10:29:52 -08:00
Ayush Somani
f0df1fade7
(docs) update docs
2023-12-06 10:38:52 +05:30
Ayush Somani
0bf3de0a01
(docs) update docker compose docs
2023-12-06 10:37:45 +05:30
Ayush Somani
b0fcc5af67
Merge branch 'main' into main
2023-12-06 10:32:59 +05:30
Krrish Dholakia
e4fae5a3e8
docs(aws_sagemaker.md): support for all huggingface/jumpstart modelsn
2023-12-05 16:59:37 -08:00
Krrish Dholakia
1addaecf48
docs(aws_sagemaker.md): add hf_model_name to sagemaker docs
2023-12-05 16:58:19 -08:00
Krrish Dholakia
ff949490de
docs(input.md): add hf_model_name to docs
2023-12-05 16:56:18 -08:00
Krrish Dholakia
68ca2a28d4
docs: adds redis url to router + proxy docs
2023-12-05 15:08:00 -08:00
ishaan-jaff
4f9f53f7dc
(docs) proxy: config example with langchain
2023-12-05 12:20:42 -08:00
ishaan-jaff
e615f2670a
(docs) proxy + configs
2023-12-05 12:02:35 -08:00
ishaan-jaff
a85a9d7e00
(docs) using proxy with curl, OpenAI, langchain
2023-12-05 11:55:02 -08:00
ishaan-jaff
41075dc977
(docs) litellm proxy + langchain
2023-12-05 11:46:42 -08:00
ishaan-jaff
f0c704f3c2
(docs) add example on using proxy with OpenAI
2023-12-05 11:45:35 -08:00
ishaan-jaff
05f585153f
(docs) add health check on load balancing
2023-12-04 18:01:21 -08:00
ishaan-jaff
acd1678d14
(docs) router
2023-12-04 17:51:31 -08:00
ishaan-jaff
3f541fe999
(docs) custom timeouts proxy
2023-12-04 17:37:09 -08:00
Krrish Dholakia
7adb8f493d
docs(custom_callback.md): add async callbacks to docs
2023-12-04 17:01:46 -08:00
Krish Dholakia
b90fcbdac4
Merge pull request #970 from nbaldwin98/fixing-replicate-sys-prompt
...
fix system prompts for replicate
2023-12-04 16:39:44 -08:00
ishaan-jaff
bbdfd143b8
(docs) input
2023-12-04 15:47:27 -08:00
ishaan-jaff
74d520b1b5
(docs) sagemaker - clarify max tokens
2023-12-04 15:15:39 -08:00
ishaan-jaff
6f8765125b
(docs) embedding: add api_base for HF
2023-12-04 11:57:41 -08:00
ishaan-jaff
333e77d161
(docs) custom logger
2023-12-04 11:44:12 -08:00
ishaan-jaff
533b5bcc44
(docs) clean up proxy logging
2023-12-04 11:37:15 -08:00
ishaan-jaff
85ac2b179a
(docs) custom logger: proxy
2023-12-04 11:30:09 -08:00
ishaan-jaff
c5b92837c2
(docs) custom callbacks proxy
2023-12-04 11:20:27 -08:00
Krrish Dholakia
31d9762b50
fix(model_management.md): add docs on model management on proxy
2023-12-04 09:36:45 -08:00
ishaan-jaff
f2625bca24
(docs) quick start proxy
2023-12-04 08:07:05 -08:00
Ayush Somani
7d2078d89f
(docs) update docker compose guide
2023-12-03 12:29:18 +05:30
Ayush Somani
28bd076579
(docs) add docker compose guide
2023-12-03 12:28:28 +05:30
Krrish Dholakia
6b1b1b82cf
fix(proxy_server.py): hash keys
2023-12-02 19:30:03 -08:00
