Ishaan Jaff
a78ed81cd9
(docs) grafana metrics
2024-03-29 14:38:37 -07:00
Ishaan Jaff
24570bc075
(docs) grafana / prometheus
2024-03-29 14:25:45 -07:00
Ishaan Jaff
c2283235a1
(docs) /metrics endpoint
2024-03-29 13:36:24 -07:00
Ishaan Jaff
ffa29ddfef
(docs) cleanup
2024-03-29 13:10:26 -07:00
Krrish Dholakia
81b4f47140
docs: show how tool calling parsing works + how to get raw model response
2024-03-29 11:58:49 -07:00
Krrish Dholakia
d547944556
fix(sagemaker.py): support 'model_id' param for sagemaker
...
allow passing inference component param to sagemaker in the same format as we handle this for bedrock
2024-03-29 08:43:17 -07:00
Krrish Dholakia
cdb940d504
docs(prod.md): update prod docs with batch writing info
2024-03-28 23:42:43 -07:00
Krrish Dholakia
85a5291142
docs(prod.md): doc improvements
2024-03-28 19:04:24 -07:00
Krrish Dholakia
da7a00d6d2
docs(prod.md): fix docker run commands
2024-03-28 18:51:53 -07:00
Krrish Dholakia
7c44b32cc2
refactor(proxy/utils.py): add more debug logs
2024-03-28 18:44:35 -07:00
Krrish Dholakia
eb318afe52
docs(prod.md): cleanup doc
2024-03-28 18:34:09 -07:00
Krrish Dholakia
ced902f822
docs(prod.md): improve docs
2024-03-28 15:35:07 -07:00
Krrish Dholakia
eb3806feba
docs(prod.md): update docs with litellm spend logs server machine spec
2024-03-28 15:26:26 -07:00
Krrish Dholakia
c15df27c1e
docs(prod.md): add litellm spend logs server to docs
2024-03-28 15:15:10 -07:00
Krish Dholakia
934a9ac2b4
Merge pull request #2722 from BerriAI/litellm_db_perf_improvement
...
feat(proxy/utils.py): enable updating db in a separate server
2024-03-28 14:56:14 -07:00
Krrish Dholakia
a09818e72e
build(ghcr_deploy.yml): deploy spend logs server docker image
...
make it easy for user to deploy a separate spend logs server
2024-03-28 13:39:52 -07:00
Krrish Dholakia
746cd3da11
docs(gemini.md): add link to google ai studio api key
2024-03-28 10:12:59 -07:00
Ishaan Jaff
5e5f3d5fd2
Merge pull request #2729 from BerriAI/litellm_show_better_error_msg_with_role
...
(fix) show user their role when rejecting /team/new requests
2024-03-28 07:42:31 -07:00
Ishaan Jaff
d5f6fe4eff
(docs) update UI
2024-03-27 22:24:56 -07:00
Krrish Dholakia
526aa9230f
docs(call_hooks.md): show result in docs
2024-03-27 21:04:51 -07:00
Krrish Dholakia
e6b929fff3
docs(call_hooks.md): show admin how to enforce user param
2024-03-27 20:58:26 -07:00
Krrish Dholakia
d08da5b05a
docs(instructor.md): improve default example
2024-03-27 12:51:05 -07:00
Krrish Dholakia
90b859ebcb
docs(token_auth.md): cleanup docs
2024-03-26 21:42:07 -07:00
Krrish Dholakia
282176c502
docs(token_auth.md): update docs
2024-03-26 21:41:08 -07:00
Krrish Dholakia
ca84e7a8e8
docs(token_auth.md): update jwt auth docs with new info
2024-03-26 21:33:03 -07:00
Krrish Dholakia
bf7cc943fb
docs(enterprise.md): update docs to turn on/off llm guard per key
2024-03-26 18:02:44 -07:00
Krish Dholakia
0ab708e6f1
Merge pull request #2704 from BerriAI/litellm_jwt_auth_improvements_3
...
fix(handle_jwt.py): enable team-based jwt-auth access
2024-03-26 16:06:56 -07:00
Krrish Dholakia
752516df1b
fix(handle_jwt.py): support public key caching ttl param
2024-03-26 14:32:55 -07:00
Ishaan Jaff
da503eab18
Merge branch 'main' into litellm_remove_litellm_telemetry
2024-03-26 11:35:02 -07:00
Ishaan Jaff
4d81df3d6f
(docs) switch of litellm telemetry
2024-03-26 11:19:55 -07:00
Ishaan Jaff
995c379a63
(fix) prod.md
2024-03-25 22:30:22 -07:00
Krrish Dholakia
16ade7e556
docs(proxy/caching.md): add ttl param to proxy/caching.md
2024-03-25 13:46:52 -07:00
dependabot[bot]
9323f1439f
build(deps): bump express from 4.18.2 to 4.19.2 in /docs/my-website
...
Bumps [express](https://github.com/expressjs/express ) from 4.18.2 to 4.19.2.
- [Release notes](https://github.com/expressjs/express/releases )
- [Changelog](https://github.com/expressjs/express/blob/master/History.md )
- [Commits](https://github.com/expressjs/express/compare/4.18.2...4.19.2 )
---
updated-dependencies:
- dependency-name: express
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-03-25 20:31:36 +00:00
Krrish Dholakia
03b8444d3c
docs(token_auth.md): add renaming jwt scope string to docs
2024-03-25 12:49:44 -07:00
Krrish Dholakia
53695943e3
docs(instructor.md): tutorial on using litellm with instructor
2024-03-25 08:35:11 -07:00
Krrish Dholakia
9e9de7f6e2
docs(routing.md): add fallbacks being done in order
2024-03-24 12:13:19 -07:00
Krrish Dholakia
1c60fd0e78
docs(routing.md): add url
2024-03-23 20:03:42 -07:00
Krrish Dholakia
7c74ea8b77
docs(routing.md): add proxy example to pre-call checks in routing docs
2024-03-23 20:00:50 -07:00
Ishaan Jaff
92759ef055
Merge pull request #2670 from BerriAI/litellm_docs_best_practices_prod
...
(docs) best prod practices
2024-03-23 19:38:22 -07:00
Krish Dholakia
c92fa1af7c
Merge pull request #2669 from BerriAI/litellm_router_pre_call_checks
...
feat(router.py): enable pre-call checks
2024-03-23 19:38:09 -07:00
Ishaan Jaff
09992a6122
(docs) prod best perf
2024-03-23 19:36:26 -07:00
Ishaan Jaff
d04b4dea3e
(docs) best prod practices
2024-03-23 19:29:21 -07:00
Krrish Dholakia
e8e7964025
docs(routing.md): add pre-call checks to docs
2024-03-23 19:10:34 -07:00
Ishaan Jaff
2ae489c506
(docs) update config set_verbose
2024-03-23 18:54:31 -07:00
Ishaan Jaff
04a09830de
Merge pull request #2668 from BerriAI/litellm_update_deploy_docs
...
[Docs] Add Docs on deploying to EKS Cluster + K8
2024-03-23 18:42:36 -07:00
Ishaan Jaff
30ae52c21e
(docs) using litellm on EKS
2024-03-23 17:49:00 -07:00
Ishaan Jaff
f646a4612b
Merge pull request #2667 from BerriAI/litellm_update_gunicorn_instructions
...
[Docs] update gunicorn instructions - Uvicorn perf is significantly better on K8s
2024-03-23 17:43:09 -07:00
Ishaan Jaff
61d2e91632
(docs) update gunicorn usage
2024-03-23 17:39:07 -07:00
Vivek Aditya
efc90b04c7
minor fix
2024-03-23 12:50:46 +05:30
Vivek Aditya
6bd49c6087
Athina docs updated with information about additional fields and a minor fix in the callback
2024-03-23 12:42:07 +05:30
Krrish Dholakia
265dd5cd4f
docs(token_auth.md): add project based auth to docs
2024-03-22 17:27:40 -07:00
Krrish Dholakia
d06b9a5a47
fix(proxy_server.py): enable jwt-auth for users
...
allow a user to auth into the proxy via jwt's and call allowed routes
2024-03-22 17:08:10 -07:00
Krrish Dholakia
858fa07e07
docs(call_hooks.md): fix dead link
2024-03-22 09:06:01 -07:00
Krrish Dholakia
211a6887f3
docs(enterprise.md): fix llm guard api link
2024-03-22 09:03:11 -07:00
Krrish Dholakia
566d48d51b
docs(prompt_injection.md): fix dead link on docs
2024-03-22 08:24:47 -07:00
Krrish Dholakia
66e7345296
docs(virtual_keys.md): simplify virtual keys docs
2024-03-21 21:49:50 -07:00
Krrish Dholakia
425165dda9
docs(gemini.md): fix string for calling gemini 1.5
2024-03-21 18:04:11 -07:00
Krrish Dholakia
abe8d7c921
docs(configs.md): add disable swagger ui env tutorial to docs
2024-03-21 17:16:52 -07:00
dependabot[bot]
ad1054520c
build(deps): bump webpack-dev-middleware in /docs/my-website
...
Bumps [webpack-dev-middleware](https://github.com/webpack/webpack-dev-middleware ) from 5.3.3 to 5.3.4.
- [Release notes](https://github.com/webpack/webpack-dev-middleware/releases )
- [Changelog](https://github.com/webpack/webpack-dev-middleware/blob/v5.3.4/CHANGELOG.md )
- [Commits](https://github.com/webpack/webpack-dev-middleware/compare/v5.3.3...v5.3.4 )
---
updated-dependencies:
- dependency-name: webpack-dev-middleware
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-03-21 23:56:48 +00:00
Krish Dholakia
33a433eb0a
Merge branch 'main' into litellm_llm_api_prompt_injection_check
2024-03-21 09:57:10 -07:00
Krrish Dholakia
0521e8a1d9
fix(prompt_injection_detection.py): fix type check
2024-03-21 08:56:13 -07:00
Vincelwt
29e8c144fb
Merge branch 'main' into main
2024-03-22 00:52:42 +09:00
Ishaan Jaff
8363bd4e7e
Merge pull request #2613 from BerriAI/litellm_fix_quick_start_docker
...
(docs) Litellm fix quick start docker
2024-03-20 21:34:19 -07:00
Ishaan Jaff
354d13c7e1
(docs) fix litellm docker quick start
2024-03-20 21:34:01 -07:00
Ishaan Jaff
3612e47d6b
(fix) clean up quick start
2024-03-20 21:24:42 -07:00
Ishaan Jaff
ee1a0a9409
(docs) add example using openai compatib model
2024-03-20 21:15:50 -07:00
Ishaan Jaff
f7945a945b
(docs) add example using vertex ai on litellm proxy
2024-03-20 21:07:55 -07:00
Ishaan Jaff
5842486810
(docs) using /cache/ping
2024-03-20 17:03:26 -07:00
Ishaan Jaff
c068a5fb74
(docs) deploying litellm
2024-03-20 11:47:55 -07:00
Krrish Dholakia
ca970a90c4
fix(handle_jwt.py): remove issuer check
2024-03-20 08:35:23 -07:00
Krrish Dholakia
88733fda5d
docs(prompt_injection.md): open sourcing prompt injection detection
2024-03-19 22:48:52 -07:00
Krrish Dholakia
f25b03326b
fix(proxy_server.py): allow user to disable scheduled reset budget task
2024-03-19 20:36:22 -07:00
Krish Dholakia
5171d7689f
Merge pull request #2592 from BerriAI/litellm_jwt_auth
...
feat(handle_jwt.py): support authenticating admins into the proxy via jwt's
2024-03-19 17:54:54 -07:00
Krrish Dholakia
3ed3d89a06
docs: doc cleanup
2024-03-19 17:50:31 -07:00
Krrish Dholakia
0c1d754e2c
docs(cost_tracking.md): cleanup docs
2024-03-19 17:40:52 -07:00
Krrish Dholakia
191c2256f6
docs(deploy.md): fix deploy quick start command
2024-03-19 17:35:08 -07:00
Krrish Dholakia
a8d3d51d21
docs(token_based_auth.md): add jwt auth to docs
2024-03-19 16:34:27 -07:00
Ishaan Jaff
36440f6b4a
Merge pull request #2521 from BerriAI/dependabot/npm_and_yarn/docs/my-website/follow-redirects-1.15.6
...
build(deps): bump follow-redirects from 1.15.4 to 1.15.6 in /docs/my-website
2024-03-19 13:13:55 -07:00
Krrish Dholakia
7c74a0e6e2
fix(proxy_server.py): expose disable_spend_logs flag in config general settings
...
Writing each spend log adds +300ms latency
https://github.com/BerriAI/litellm/issues/1714#issuecomment-1924727281
2024-03-19 12:08:37 -07:00
Krrish Dholakia
c63259ebcd
docs(deploy.md): update docker start command
2024-03-19 07:58:08 -07:00
Vincelwt
1cbfd312fe
Merge branch 'main' into main
2024-03-19 12:50:04 +09:00
Ishaan Jaff
038c9d5781
(docs) litellm + datadog
2024-03-18 17:06:00 -07:00
Ishaan Jaff
4a4c322278
(docs) easily find call hooks
2024-03-18 07:38:29 -07:00
Krrish Dholakia
136a58b84a
docs(secret.md): add aws secret manager to docs
2024-03-16 18:47:56 -07:00
Ishaan Jaff
27cd012c2d
(docs) litellm hel
2024-03-16 12:14:35 -07:00
Ishaan Jaff
c17e721278
(docs) update litellm helm docs
2024-03-16 12:01:38 -07:00
Krrish Dholakia
2c2db9ce89
fix(proxy_server.py): bug fix on getting user obj from cache
2024-03-16 11:07:38 -07:00
Krrish Dholakia
2d2731c3b5
docs(caching.md): add batch redis requests to docs
2024-03-15 23:01:08 -07:00
ishaan-jaff
92b198f6c5
(docs) litellm + helm chart
2024-03-15 17:04:51 -07:00
Ishaan Jaff
8cfa0b64ce
Merge pull request #2541 from udit-001/docs/chatlitellm-langfuse
...
docs(langfuse): add chatlitellm section
2024-03-15 16:32:01 -07:00
ishaan-jaff
3108c91ebd
(docs) using litellm + helm charts
2024-03-15 16:20:26 -07:00
ishaan-jaff
4a33c53619
(fix) docs litellm helm chart
2024-03-15 16:07:43 -07:00
Udit
4a232f4ab3
docs(langfuse): update langfuse casing
2024-03-16 03:34:47 +05:30
Udit
b8dbcd7ac3
docs(langfuse): update section titles
2024-03-16 03:33:14 +05:30
Udit
31fb2d0219
docs(langfuse): fix missing litellm import
2024-03-16 03:30:01 +05:30
Udit
1220eb3c7a
docs(langfuse): update chatlitellm section
2024-03-16 03:28:19 +05:30
Udit
acd56b174c
docs(langfuse): add chatlitellm section
2024-03-16 03:24:07 +05:30
Krrish Dholakia
e033e84720
docs(cohere.md): fix model name in cohere docs
2024-03-15 10:08:07 -07:00
Krish Dholakia
32ca306123
Merge pull request #2535 from BerriAI/litellm_fireworks_ai_support
...
feat(utils.py): add native fireworks ai support
2024-03-15 10:02:53 -07:00
Krrish Dholakia
5edf414a5f
docs(audio_transcription.md): add openai sdk usage example to audio transcription docs
2024-03-15 09:54:03 -07:00
Krrish Dholakia
fa0c8b7be6
docs(fireworks_ai.md): add fireworks ai to docs
2024-03-15 09:17:15 -07:00
ishaan-jaff
f07a652148
(docs) load test proxy
2024-03-15 08:10:45 -07:00
Ishaan Jaff
4c834714ab
Merge pull request #2529 from snekkenull/main
...
(feat) add groq/gemma-7b-it
2024-03-15 07:41:44 -07:00
ishaan-jaff
91a47dc17a
(docs) how to run a locust load test
2024-03-15 07:37:50 -07:00
USAGI
a9634b717c
Add groq/gemma-7b-it
2024-03-15 11:50:19 +08:00
Krrish Dholakia
6f1eb038bc
docs(bedrock.md): adding docs for calling bedrock models on proxy via config.yaml
2024-03-14 14:50:13 -07:00
Krrish Dholakia
cb221cc88b
docs(caching.md): add redis namespaces to docs
2024-03-14 13:38:33 -07:00
dependabot[bot]
913f19e046
build(deps): bump follow-redirects in /docs/my-website
...
Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects ) from 1.15.4 to 1.15.6.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases )
- [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.15.4...v1.15.6 )
---
updated-dependencies:
- dependency-name: follow-redirects
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-03-14 20:02:59 +00:00
Krrish Dholakia
7876aa2d75
fix(parallel_request_limiter.py): handle metadata being none
2024-03-14 10:02:41 -07:00
ishaan-jaff
0269cddd55
(feat) add claude-3-haiku
2024-03-13 20:24:06 -07:00
Aaron Bach
daca0a93ce
Update docs
2024-03-13 17:37:59 -06:00
Krrish Dholakia
16e3aaced5
docs(enterprise.md): add prompt injection detection to docs
2024-03-13 12:37:32 -07:00
Krrish Dholakia
dbc7552d15
docs: refactor team based logging in docs
2024-03-13 12:26:39 -07:00
Krrish Dholakia
b3493269b3
fix(proxy_server.py): support checking openai user param
2024-03-13 12:00:27 -07:00
Krrish Dholakia
9e692d6cce
docs(sidebar.js): add dall e 3 cost tracking to docs
2024-03-12 22:26:10 -07:00
Krrish Dholakia
488c4b9939
docs(cost_tracking.md): add docs for cost tracking dall e 3 calls
2024-03-12 21:35:17 -07:00
Ishaan Jaff
5172fb1de9
Merge pull request #2474 from BerriAI/litellm_support_command_r
...
[New-Model] Cohere/command-r
2024-03-12 11:11:56 -07:00
ishaan-jaff
8fabaed543
(docs) cohere-comand-r
2024-03-12 10:34:08 -07:00
ishaan-jaff
ea83c8c9b0
(docs) using azure_text models
2024-03-12 09:54:34 -07:00
Krrish Dholakia
10f5f342bd
docs(virtual_keys.md): cleanup doc
2024-03-12 07:05:55 -07:00
Krrish Dholakia
47424b8c90
docs(routing.md): fix routing example on docs
2024-03-11 22:17:04 -07:00
ishaan-jaff
e46980c56c
(docs) using litellm router
2024-03-11 21:18:10 -07:00
Vince Loewe
7c38f992dc
Merge branch 'main' into main
2024-03-11 12:36:41 +09:00
Ishaan Jaff
a1784284bb
Merge pull request #2416 from BerriAI/litellm_use_consistent_port
...
(docs) LiteLLM Proxy - use port 4000 in examples
2024-03-09 16:32:08 -08:00
ishaan-jaff
a004240109
(docs) deploy litellm
2024-03-09 13:45:07 -08:00
ishaan-jaff
ba271e3e87
(docs) deploying litell
2024-03-09 13:41:20 -08:00
ishaan-jaff
7ae7e95da1
(docs) litellm getting started clarify sdk vs proxy
2024-03-09 13:04:52 -08:00
Krrish Dholakia
d8a6b8216d
docs(input.md): add docs on 'get_supported_openai_params'
2024-03-08 23:54:13 -08:00
Krrish Dholakia
b0fa25dfbd
docs(audio_transcription.md): add docs on audio transcription
2024-03-08 23:51:24 -08:00
ishaan-jaff
ea6f42216c
(docs) use port 4000
2024-03-08 21:59:00 -08:00
H0llyW00dzZ
33ba57a1b5
Fix Docs Formatting in Website
...
- [+] docs(deploy.md): move tip about versioning inside the tab item
2024-03-09 12:37:18 +07:00
Ishaan Jaff
8036b48f14
Merge pull request #2408 from BerriAI/litellm_no_store_reqs
...
[FEAT-liteLLM Proxy] Incognito Requests - Don't log anything
2024-03-08 21:11:43 -08:00
H0llyW00dzZ
7004940ce4
Update Docs for Kubernetes
...
- [+] docs(deploy.md): add tip about using versioning or SHA digests instead of latest tag
2024-03-09 11:55:31 +07:00
Guillermo
bb427b4659
Update deploy.md
2024-03-09 02:30:17 +01:00
Guillermo
37b4dde7fd
Add quickstart deploy with k8s
2024-03-09 02:24:07 +01:00
ishaan-jaff
4ff68c8562
(docs) no log requests
2024-03-08 16:26:25 -08:00
ishaan-jaff
2d71f54afb
(docs) load test litellm
2024-03-08 15:18:06 -08:00
Guillermo
a693045460
docs: fix yaml typo in proxy/configs.md
...
equals was used instead of : as key-value delimiter in yaml
2024-03-08 20:33:47 +01:00
Krrish Dholakia
0e7b30bec9
fix(utils.py): return function name for ollama_chat function calls
2024-03-08 08:01:10 -08:00
ishaan-jaff
b4e12fb8fd
(docs) litellm cloud formation stack
2024-03-07 21:01:28 -08:00
ishaan-jaff
3baa55210a
(docs) setting load balancing config
2024-03-07 12:22:39 -08:00
Krrish Dholakia
4508b4ede0
docs(team_based_routing.md): add docs on team based routing
2024-03-07 08:14:46 -08:00
ishaan-jaff
547f0a023d
(docs) best practices for high traffic
2024-03-06 16:36:35 -08:00
Krrish Dholakia
688b903d19
docs(bedrock.md): add anthropic function calling to docs
2024-03-05 21:34:46 -08:00
Krrish Dholakia
5c03109b6f
docs(configs.md): add load balancing to proxy config docs
2024-03-05 07:39:40 -08:00
Krrish Dholakia
8845430cdb
docs(anthropic.md): add proxy usage tutorial to anthropic docs
2024-03-04 22:00:33 -08:00
ishaan-jaff
1183e5f2e5
(feat) maintain anthropic text completion
2024-03-04 11:16:34 -08:00
Ishaan Jaff
14fc8355fb
Merge pull request #2315 from BerriAI/litellm_add_claude_3
...
[FEAT]- add claude 3
2024-03-04 09:23:13 -08:00
Ishaan Jaff
84415ef7b5
Merge pull request #2290 from ti3x/bedrock_mistral
...
Add support for Bedrock Mistral models
2024-03-04 08:42:47 -08:00
ishaan-jaff
d179ae376e
(feat) claude-3 test fixes
2024-03-04 07:53:06 -08:00
ishaan-jaff
25bbb73ce3
(docs) add claude-3
2024-03-04 07:40:18 -08:00
Krrish Dholakia
b283588eb8
refactor(budget_alerts.md): add spacing in doc
2024-03-02 23:12:49 -08:00
Krrish Dholakia
53326da1c9
refactor(budget_alerts.md): add spacing in doc
2024-03-02 23:12:34 -08:00
Krrish Dholakia
922b38301f
docs(budget_alerts.md): doc cleanup
2024-03-02 23:11:04 -08:00
ishaan-jaff
fa2c6fdebb
(docs) alerting slack budgets
2024-03-02 17:55:49 -08:00
ishaan-jaff
b2389a9b1d
(feat) improve test slack alert
2024-03-02 17:33:18 -08:00
ishaan-jaff
b7416fc946
(fix) improve example test slack alert
2024-03-02 17:33:07 -08:00
ishaan-jaff
0b85061086
(docs)
2024-03-02 16:32:33 -08:00
ishaan-jaff
fd9f8b7010
(docs) setting soft budgets
2024-03-02 13:05:00 -08:00
Krrish Dholakia
468995b288
docs(supported_embeddings.md): add vertex ai embeddings to docs
2024-03-02 09:34:01 -08:00
Ishaan Jaff
d494941dcc
Merge pull request #2285 from Linutux/patch-1
...
Update deploy.md / Update path to docker-compose.yml
2024-03-01 21:02:32 -08:00
Krrish Dholakia
d3a742efc8
docs(supported_embedding.md): add vertex ai embeddings to docs
2024-03-01 20:57:23 -08:00
Tim Xia
dc84e28c41
update docs for supported models
2024-03-01 23:34:04 -05:00
ishaan-jaff
d1465ed57e
(feat) add gpt-3.5-turbo-instruct-0914
2024-03-01 20:02:12 -08:00
Krrish Dholakia
5e516522fb
docs(azure.md): improve azure docs
2024-03-01 19:40:55 -08:00
Simon Zöllner
57bde371d6
Update deploy.md / Update path to docker-compose.yml
...
The file seems to have been moved
2024-03-01 23:32:47 +01:00
Vince Loewe
05c0fa8b9b
Merge branch 'main' into main
2024-03-01 13:37:17 -08:00
ishaan-jaff
edab94c0a6
(docs) load balancing on proxy
2024-03-01 12:28:59 -08:00
ishaan-jaff
295d36a383
(docs) load balancing
2024-03-01 11:46:42 -08:00
ishaan-jaff
4bfefd2b08
(feat) add groq api pricing, models
2024-02-29 16:11:22 -08:00
Ishaan Jaff
d2115d5a17
Merge pull request #2263 from BerriAI/litellm_gpt_gemini_base_64
...
[FEAT] Use Base64 images with vertex_ai/gemini-pro-vision
2024-02-29 16:01:19 -08:00
ishaan-jaff
02c3955c51
(docs) using gemini vision with base64
2024-02-29 15:55:56 -08:00
Ishaan Jaff
e044d6332f
Merge pull request #2255 from BerriAI/litellm_admin_ui_user_panel_load_time_high
...
[FEAT] proxy add pagination on /user/info endpoint (Admin UI does not load all users)
2024-02-29 13:22:00 -08:00
ishaan-jaff
2415dc7927
(docs) /user/info
2024-02-29 13:05:07 -08:00
ishaan-jaff
ed85d2de95
(docs) /user/info
2024-02-29 13:04:41 -08:00
Ishaan Jaff
3d2150afcc
Merge pull request #2247 from BerriAI/litellm_mistral_azure_ai_fixes
...
[FEAT] mistral azure - use with env vars + added pricing
2024-02-29 12:22:53 -08:00
ishaan-jaff
3fea348e4e
(docs) enterprise update
2024-02-29 11:42:19 -08:00
ishaan-jaff
817fa2483a
(docs) mistral on azure ai studio
2024-02-29 08:28:19 -08:00
ishaan-jaff
46134d3fba
(docs) using mistral azure ai studio
2024-02-29 08:14:24 -08:00
Vince Loewe
f98619e6f2
Merge branch 'BerriAI:main' into main
2024-02-28 22:18:14 -08:00
Krrish Dholakia
f120f94cc9
docs(ui.md): update
2024-02-28 21:25:39 -08:00
ishaan-jaff
76e7f8831f
(docs) check if supports function calling
2024-02-28 17:41:54 -08:00
Krrish Dholakia
a042092faa
test: removing bedrock claude-v1 testing - bedrock removed this
2024-02-28 11:08:17 -08:00
Vince Loewe
a9648613dc
feat: LLMonitor is now Lunary
2024-02-27 22:07:13 -08:00
Ishaan Jaff
990439c49c
Merge branch 'main' into litellm_daily_metrics
2024-02-27 20:33:35 -08:00
ishaan-jaff
4fb723f119
(docs) show /daily_metrics
2024-02-27 19:34:47 -08:00
ishaan-jaff
d19370083d
(feat) update /daily metrics
2024-02-27 18:33:59 -08:00
ishaan-jaff
7cabc6ac56
(docs) show daily metrics tab
2024-02-27 18:03:15 -08:00
ishaan-jaff
7485fa797c
(docs) vertex ai litellm proxy
2024-02-27 17:55:05 -08:00
ishaan-jaff
f3144dd9cf
(docs) vertex ai
2024-02-27 17:44:35 -08:00
ishaan-jaff
8075746078
(docs) fix clickhouse link
2024-02-26 18:35:33 -08:00
ishaan-jaff
9bb55a0671
add clickhouse docs
2024-02-26 18:31:10 -08:00
ishaan-jaff
c627ce6631
(docs) use azure ai studio + mistral litellm
2024-02-26 14:33:21 -08:00
ishaan-jaff
da4832d5a2
(feat) add mistral-large-latest
2024-02-26 09:25:44 -08:00
Krrish Dholakia
577a0f9440
docs: add gemini-1.5 to docs
2024-02-26 08:01:30 -08:00
Krish Dholakia
61d69b1efa
Merge pull request #2183 from BerriAI/litellm_team_rate_limits
...
fix(proxy_server.py): allow user to set team tpm/rpm limits/budget/models
2024-02-25 01:12:39 -08:00
ishaan-jaff
7c19783d32
(docs) writing custo add
2024-02-24 18:54:46 -08:00
Ishaan Jaff
c8daf61592
Merge pull request #2188 from BerriAI/litellm_fix_health_checks
...
[Fix] Fix health check when API base set for OpenAI compatible models
2024-02-24 18:47:13 -08:00
ishaan-jaff
a4d2d1c4e6
(docs) using openai compatible endpoints
2024-02-24 18:46:20 -08:00
ishaan-jaff
bf403dc02e
(docs) health
2024-02-24 18:38:39 -08:00
ishaan-jaff
986babfeaa
(docs) open router
2024-02-24 18:30:41 -08:00
ishaan-jaff
7c032fcc05
(docs) open router
2024-02-24 18:28:32 -08:00
Krrish Dholakia
0b77420087
docs(users.md): add team budgets to docs
2024-02-24 11:41:42 -08:00
Krrish Dholakia
edaf20b60a
docs(enterprise.md): add end user opt out to docs
2024-02-24 09:28:41 -08:00
Krrish Dholakia
308c73fca9
docs(contributing.md): add docs for contributing to litellm ui
2024-02-23 13:01:34 -08:00
ishaan-jaff
602b25972d
(docs) add groq ai
2024-02-23 10:40:33 -08:00
Krrish Dholakia
44b8270bf6
docs(enterprise.md): add banned keywords to docs
2024-02-23 10:07:31 -08:00
ishaan-jaff
c2325539e7
(docs) fix athina docs
2024-02-23 09:56:10 -08:00
Ishaan Jaff
9594ceae55
Merge pull request #2164 from BerriAI/litellm_support_extra_headers
...
[FEAT] Support extra headers - OpenAI / Azure
2024-02-23 09:42:09 -08:00
Ishaan Jaff
5ec3075fb1
Merge pull request #2163 from vivek-athina/feature/athina
...
Support for Athina logging
2024-02-23 09:39:06 -08:00
ishaan-jaff
c9567c8652
(docs) passing extra_headers to OpenAI
2024-02-23 09:27:48 -08:00
Vivek Aditya
0d3046dcc9
added athina to logging doc
2024-02-23 22:33:09 +05:30
ishaan-jaff
aa9164e2ce
(docs) setting extra_headers
2024-02-23 08:56:09 -08:00
Krrish Dholakia
d1a40ecacf
docs(load_balancing.md): have proxy routing docs point to sdk routing docs
2024-02-23 08:34:15 -08:00
Vivek Aditya
244fa1c4ab
Support for Athina logging
2024-02-23 21:49:40 +05:30
Krish Dholakia
e7cce90c3a
Merge pull request #2144 from BerriAI/litellm_blocked_user_list
...
feat(proxy_server.py): add support for blocked user lists (enterprise-only)
2024-02-22 21:34:07 -08:00
ishaan-jaff
21e1c2dc21
(docs) admin ui with proxy_base_url
2024-02-22 21:18:26 -08:00
ishaan-jaff
2122a7cf1e
(docs) set user tpm/rpm limits
2024-02-22 19:23:16 -08:00
Krrish Dholakia
6ad450396b
docs(enterprise.md): add Enable Blocked User Lists for docs
2024-02-22 18:04:29 -08:00
ishaan-jaff
b6886b8714
(docs) set hosted image for custom branding
2024-02-22 15:40:15 -08:00
ishaan-jaff
6a48fa64ce
(docs) set generic user attributes
2024-02-22 14:25:07 -08:00
Ishaan Jaff
b603d9784d
Merge pull request #2129 from adrien-f/sso
...
update generic SSO login
2024-02-22 13:21:53 -08:00
ishaan-jaff
580f9e3097
(docs) setting cache paras on proxy + Openai client
2024-02-22 13:17:32 -08:00
ishaan-jaff
5c888853c7
(docs) litellm proxy server
2024-02-22 07:55:23 -08:00
Adrien Fillon
90f0062fc6
update generic SSO login
...
During implementation for Okta, noticed a few things:
- Some providers require a state parameter to be sent
- Some providers require that the client_id is not included in the body
Moreover, the OpenID response converter was not implemented which
was returning an empty response.
Finally, there was an order where there's a fetch of user information
but on first usage, it is not created yet.
2024-02-22 14:34:18 +01:00
ishaan-jaff
f04b67c433
(docs) custom ui branding
2024-02-21 22:07:40 -08:00
ishaan-jaff
7419547ba1
(docs) model max budgets
2024-02-20 21:11:17 -08:00
ishaan-jaff
2b2e62477b
(docs) use correct base model for cost
2024-02-20 21:00:43 -08:00
Krrish Dholakia
987cb38976
docs(pii_masking.md): docs for ad-hoc recognizers for pii masking
2024-02-20 16:08:34 -08:00
Krrish Dholakia
1227964155
docs(enterprise.md): clarify what's in enterprise
2024-02-20 08:43:28 -08:00
Krrish Dholakia
fde478f70b
docs(enterprise.md): add llm guard to docs
2024-02-19 21:05:01 -08:00
Krrish Dholakia
54e9b5b99a
docs(enterprise.md): add customizing llama guard prompt to docs
2024-02-19 15:22:09 -08:00
Krrish Dholakia
7348956bf2
docs(enterprise.md): add google text moderations to the docs
2024-02-19 14:17:52 -08:00
Krish Dholakia
6f77a4a31e
Merge pull request #2037 from BerriAI/litellm_request_level_pii_masking
...
feat(presidio_pii_masking.py): allow request level controls for turning on/off pii masking
2024-02-17 19:05:14 -08:00
Krrish Dholakia
045d84e167
fix(proxy_cli.py): allow user to control db connection pool + timeouts from config
2024-02-17 19:03:43 -08:00
Krish Dholakia
ad81e19282
Merge pull request #2013 from afbarbaro/litellm_gemini_safety_settings
...
Add safety_settings parameter to gemini generate_content calls
2024-02-17 16:47:29 -08:00
Ishaan Jaff
35af2d666b
Merge pull request #2022 from BerriAI/litellm_budgets_per_llm
...
[FEAT] Track spend per model (for Key, User and Team)
2024-02-17 15:35:31 -08:00
ishaan-jaff
1652e894c1
(docs) set budget per model
2024-02-17 15:34:55 -08:00
Andres Barbaro
b10bf2083c
Update gemini documentation
2024-02-17 17:31:37 -06:00
ishaan-jaff
c5891c3ee8
(fix) docs - incorrect title
2024-02-17 13:26:45 -08:00
Ishaan Jaff
ab8df9c284
Merge pull request #2039 from BerriAI/litellm_customizationroot_path
...
[FEAT] Set FastAPI root path
2024-02-17 13:23:31 -08:00
Ishaan Jaff
3fe762b8b1
Merge pull request #2018 from Lunik/feat/refresh-helm-chart
...
✨ Refresh Helm chart structure
2024-02-17 13:19:11 -08:00
ishaan-jaff
67932dccbc
(docs) setting server root path
2024-02-17 13:12:06 -08:00
Krrish Dholakia
448537e684
feat(presidio_pii_masking.py): allow request level controls for turning on/off pii masking
...
https://github.com/BerriAI/litellm/issues/2003
2024-02-17 11:04:56 -08:00
Krrish Dholakia
e3fab50853
docs(call_hooks.md): add async_moderation_hook to docs
2024-02-17 09:40:34 -08:00
Krrish Dholakia
0cd2deee63
docs(call_hooks.md): add async_moderation_hooks to docs
2024-02-17 09:38:36 -08:00
Krrish Dholakia
3565f74338
docs(enterprise.md): add llama guard tutorial to enterprise docs
2024-02-17 09:25:49 -08:00
Ishaan Jaff
4d4653b619
Merge branch 'main' into litellm_fix_generic_sso
2024-02-16 14:51:46 -08:00
ishaan-jaff
4ab697c6c2
(Docs) generic sso provider
2024-02-16 14:47:15 -08:00
Ishaan Jaff
e6b9e5b46f
Merge pull request #2020 from Lunik/feat/generic-sso-scopes
...
✨ Allow to configure scopes in generic SSO
2024-02-16 14:45:09 -08:00
Lunik
21552620ed
📝 Clarify GENERIC_SCOPE usage
...
Signed-off-by: Lunik <lunik@tiwabbit.fr>
2024-02-16 23:40:59 +01:00
Lunik
af4537e421
✨ Allow to configure scopes in generic SSO
...
Signed-off-by: Lunik <lunik@tiwabbit.fr>
2024-02-16 23:24:58 +01:00
ishaan-jaff
6e1708f595
(docs) use litellm ghcr as base image
2024-02-16 14:02:46 -08:00
Lunik
880213d4a6
✨ Refresh Helm chart structure
...
Signed-off-by: Lunik <lunik@tiwabbit.fr>
2024-02-16 22:59:14 +01:00
ishaan-jaff
d574bfc297
(docs) view spend per tag
2024-02-16 10:47:33 -08:00
Krrish Dholakia
a938b296a3
docs(pii_masking.md): allow keys to turn off pii masking
2024-02-16 00:04:24 -08:00
ishaan-jaff
92612c0d4e
(docs) custom callback apis
2024-02-15 17:16:36 -08:00
ishaan-jaff
b6b5e0e7c2
(docs) use async callback APIs
2024-02-15 17:06:16 -08:00
Krish Dholakia
57654f4533
Merge branch 'main' into litellm_aioboto3_sagemaker
2024-02-14 21:46:58 -08:00
ishaan-jaff
3d03f65b08
(docs) generic sso
2024-02-14 15:07:03 -08:00
Ishaan Jaff
ed8f507536
Merge pull request #1974 from BerriAI/litellm_proxy_add_moderations_endpoint
...
[FEAT] Proxy Add /moderations endpoint
2024-02-14 13:07:34 -08:00
Krrish Dholakia
a61b0bf9e5
docs(pii_masking.md): add output parsing to docs
2024-02-14 12:09:05 -08:00
Krrish Dholakia
e7666d3908
docs(custom_callback.md): link to proxy docs for custom logging there
2024-02-14 11:42:13 -08:00
ishaan-jaff
f1dc656491
(docs) add moderations to docs
2024-02-14 11:34:06 -08:00
Krrish Dholakia
e590f47a44
docs(health.md): add docs on image generation health checks
2024-02-13 23:31:05 -08:00
ishaan-jaff
b81f8ec8ca
(docs) fix docker run command
2024-02-13 21:47:23 -08:00
Ishaan Jaff
003feda33f
Merge branch 'main' into litellm_dynamo_use_arn
2024-02-13 21:27:38 -08:00
Krrish Dholakia
f09c09ace4
docs(pii_masking.md): fix presidio tutorial
2024-02-13 07:42:27 -08:00
Krrish Dholakia
f3a950705c
docs(pii_masking.md): add pii masking to proxy docs
2024-02-12 21:40:34 -08:00
Krrish Dholakia
ad7e856a02
docs(pii_masking.md): add pii masking to proxy docs
2024-02-12 11:36:52 -08:00
deena
2d62353309
docs to include langfuse trace tags feature
2024-02-12 20:26:32 +02:00
ishaan-jaff
7d67096756
(docs) virtual keys
2024-02-12 08:54:18 -08:00
ishaan-jaff
ef89144eaf
(docs) caching proxy server
2024-02-12 08:32:00 -08:00
ishaan-jaff
fb7958dc40
(docs) caching
2024-02-12 08:27:52 -08:00
ishaan-jaff
60de5ce643
(docs) Restrict models by team_id
2024-02-10 21:26:16 -08:00
ishaan-jaff
e0cd109d28
(docs) ssl_settings for litellm proxy
2024-02-10 18:17:15 -08:00
Krrish Dholakia
7bd4737018
docs(ui.md): update ui docs
2024-02-10 17:26:04 -08:00
Krrish Dholakia
d1893129f7
docs(custom_pricing.md): add disclaimer on pricing in custom pricing docs
2024-02-10 07:40:19 -08:00
ishaan-jaff
5078ed1ace
(docs) llamaindex + proxy
2024-02-09 17:06:49 -08:00
ishaan-jaff
e3f5579091
(docs) use llama index with litellm proxy
2024-02-09 16:57:48 -08:00
ishaan-jaff
cf16687509
(docs) litellm
2024-02-09 10:27:46 -08:00
ishaan-jaff
694f0d6af5
(docs) proxy quickstart
2024-02-09 10:21:39 -08:00
ishaan-jaff
854eee3785
(docs) getting started
2024-02-09 09:42:37 -08:00
David Leen
140d915adf
Add support for AWS credentials from profile file
...
https://boto3.amazonaws.com/v1/documentation/api/latest/guide/credentials.html#aws-config-file
2024-02-08 15:10:50 -08:00
Krrish Dholakia
9be5e2f7e3
docs(enterprise.md): adding enterprise support to docs
2024-02-08 10:02:40 -08:00
Ishaan Jaff
98b0ace2e9
Merge pull request #1874 from BerriAI/litellm_azure_base_model_pricing
...
[FEAT] Azure Pricing - based on base_model in model_info
2024-02-07 18:37:55 -08:00
ishaan-jaff
c98e247b0f
(docs) azure/gpt-4-0125-preview
2024-02-07 18:22:38 -08:00
ishaan-jaff
206a6845ac
(docs) pricing base_model
2024-02-07 16:54:24 -08:00
Krrish Dholakia
66913222a1
docs(langfuse_integration.md): docs for showing how to log errors to langfuse
2024-02-07 12:07:11 -08:00
Krrish Dholakia
048acc8e68
docs(ui.md): add more help to docs
2024-02-07 11:46:57 -08:00
Krrish Dholakia
2fcbe06af8
docs(ui.md): add proxy admin view to docs
2024-02-07 11:38:27 -08:00
Krrish Dholakia
e165ec40d4
docs(ui.md): ui doc updates
2024-02-07 11:38:27 -08:00
ishaan-jaff
5f4b06fb19
(docs) caching
2024-02-06 19:39:32 -08:00
ishaan-jaff
8208ebd9db
(docs) budget per end_user
2024-02-06 15:39:45 -08:00
Krrish Dholakia
fa5f4b9774
test(test_completion.py): fix test
2024-02-06 13:29:47 -08:00
Ishaan Jaff
7cb69c72c8
Merge branch 'main' into litellm_add_semantic_cache
2024-02-06 11:18:43 -08:00
ishaan-jaff
54c920c299
(docs) litellm semantic caching
2024-02-06 10:54:55 -08:00
ishaan-jaff
93504915d7
(docs) redis cache
2024-02-06 10:53:28 -08:00
ishaan-jaff
bdc2091838
(docs) using semantic caching on proxy
2024-02-06 10:32:07 -08:00
TanaroSch
b69cb2c773
change max_tokens float to int
2024-02-06 11:19:28 +01:00
