ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
11,876 Commits 9 Branches 7 Tags 935 MiB
01bb26bbba
Commit Graph

1827 Commits

Author SHA1 Message Date
Krrish Dholakia
265dd5cd4f docs(token_auth.md): add project based auth to docs 2024-03-22 17:27:40 -07:00
Krrish Dholakia
d06b9a5a47 fix(proxy_server.py): enable jwt-auth for users 
allow a user to auth into the proxy via jwt's and call allowed routes
 2024-03-22 17:08:10 -07:00
Krrish Dholakia
858fa07e07 docs(call_hooks.md): fix dead link 2024-03-22 09:06:01 -07:00
Krrish Dholakia
211a6887f3 docs(enterprise.md): fix llm guard api link 2024-03-22 09:03:11 -07:00
Krrish Dholakia
566d48d51b docs(prompt_injection.md): fix dead link on docs 2024-03-22 08:24:47 -07:00
Krrish Dholakia
66e7345296 docs(virtual_keys.md): simplify virtual keys docs 2024-03-21 21:49:50 -07:00
Krrish Dholakia
425165dda9 docs(gemini.md): fix string for calling gemini 1.5 2024-03-21 18:04:11 -07:00
Krrish Dholakia
abe8d7c921 docs(configs.md): add disable swagger ui env tutorial to docs 2024-03-21 17:16:52 -07:00
dependabot[bot]
ad1054520c
build(deps): bump webpack-dev-middleware in /docs/my-website 
Bumps [webpack-dev-middleware](https://github.com/webpack/webpack-dev-middleware) from 5.3.3 to 5.3.4.
- [Release notes](https://github.com/webpack/webpack-dev-middleware/releases)
- [Changelog](https://github.com/webpack/webpack-dev-middleware/blob/v5.3.4/CHANGELOG.md)
- [Commits](https://github.com/webpack/webpack-dev-middleware/compare/v5.3.3...v5.3.4)

---
updated-dependencies:
- dependency-name: webpack-dev-middleware
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-03-21 23:56:48 +00:00
Krish Dholakia
33a433eb0a
Merge branch 'main' into litellm_llm_api_prompt_injection_check 2024-03-21 09:57:10 -07:00
Krrish Dholakia
0521e8a1d9 fix(prompt_injection_detection.py): fix type check 2024-03-21 08:56:13 -07:00
Vincelwt
29e8c144fb
Merge branch 'main' into main 2024-03-22 00:52:42 +09:00
Ishaan Jaff
8363bd4e7e
Merge pull request #2613 from BerriAI/litellm_fix_quick_start_docker 
(docs) Litellm fix quick start docker
 2024-03-20 21:34:19 -07:00
Ishaan Jaff
354d13c7e1 (docs) fix litellm docker quick start 2024-03-20 21:34:01 -07:00
Ishaan Jaff
3612e47d6b (fix) clean up quick start 2024-03-20 21:24:42 -07:00
Ishaan Jaff
ee1a0a9409 (docs) add example using openai compatib model 2024-03-20 21:15:50 -07:00
Ishaan Jaff
f7945a945b (docs) add example using vertex ai on litellm proxy 2024-03-20 21:07:55 -07:00
Ishaan Jaff
5842486810 (docs) using /cache/ping 2024-03-20 17:03:26 -07:00
Ishaan Jaff
c068a5fb74 (docs) deploying litellm 2024-03-20 11:47:55 -07:00
Krrish Dholakia
ca970a90c4 fix(handle_jwt.py): remove issuer check 2024-03-20 08:35:23 -07:00
Krrish Dholakia
88733fda5d docs(prompt_injection.md): open sourcing prompt injection detection 2024-03-19 22:48:52 -07:00
Krrish Dholakia
f25b03326b fix(proxy_server.py): allow user to disable scheduled reset budget task 2024-03-19 20:36:22 -07:00
Krish Dholakia
5171d7689f
Merge pull request #2592 from BerriAI/litellm_jwt_auth 
feat(handle_jwt.py): support authenticating admins into the proxy via jwt's
 2024-03-19 17:54:54 -07:00
Krrish Dholakia
3ed3d89a06 docs: doc cleanup 2024-03-19 17:50:31 -07:00
Krrish Dholakia
0c1d754e2c docs(cost_tracking.md): cleanup docs 2024-03-19 17:40:52 -07:00
Krrish Dholakia
191c2256f6 docs(deploy.md): fix deploy quick start command 2024-03-19 17:35:08 -07:00
Krrish Dholakia
a8d3d51d21 docs(token_based_auth.md): add jwt auth to docs 2024-03-19 16:34:27 -07:00
Ishaan Jaff
36440f6b4a
Merge pull request #2521 from BerriAI/dependabot/npm_and_yarn/docs/my-website/follow-redirects-1.15.6 
build(deps): bump follow-redirects from 1.15.4 to 1.15.6 in /docs/my-website
 2024-03-19 13:13:55 -07:00
Krrish Dholakia
7c74a0e6e2 fix(proxy_server.py): expose disable_spend_logs flag in config general settings 
Writing each spend log adds +300ms latency

https://github.com/BerriAI/litellm/issues/1714#issuecomment-1924727281
 2024-03-19 12:08:37 -07:00
Krrish Dholakia
c63259ebcd docs(deploy.md): update docker start command 2024-03-19 07:58:08 -07:00
Vincelwt
1cbfd312fe
Merge branch 'main' into main 2024-03-19 12:50:04 +09:00
Ishaan Jaff
038c9d5781 (docs) litellm + datadog 2024-03-18 17:06:00 -07:00
Ishaan Jaff
4a4c322278 (docs) easily find call hooks 2024-03-18 07:38:29 -07:00
Krrish Dholakia
136a58b84a docs(secret.md): add aws secret manager to docs 2024-03-16 18:47:56 -07:00
Ishaan Jaff
27cd012c2d (docs) litellm hel 2024-03-16 12:14:35 -07:00
Ishaan Jaff
c17e721278 (docs) update litellm helm docs 2024-03-16 12:01:38 -07:00
Krrish Dholakia
2c2db9ce89 fix(proxy_server.py): bug fix on getting user obj from cache 2024-03-16 11:07:38 -07:00
Krrish Dholakia
2d2731c3b5 docs(caching.md): add batch redis requests to docs 2024-03-15 23:01:08 -07:00
ishaan-jaff
92b198f6c5 (docs) litellm + helm chart 2024-03-15 17:04:51 -07:00
Ishaan Jaff
8cfa0b64ce
Merge pull request #2541 from udit-001/docs/chatlitellm-langfuse 
docs(langfuse): add chatlitellm section
 2024-03-15 16:32:01 -07:00
ishaan-jaff
3108c91ebd (docs) using litellm + helm charts 2024-03-15 16:20:26 -07:00
ishaan-jaff
4a33c53619 (fix) docs litellm helm chart 2024-03-15 16:07:43 -07:00
Udit
4a232f4ab3 docs(langfuse): update langfuse casing 2024-03-16 03:34:47 +05:30
Udit
b8dbcd7ac3 docs(langfuse): update section titles 2024-03-16 03:33:14 +05:30
Udit
31fb2d0219 docs(langfuse): fix missing litellm import 2024-03-16 03:30:01 +05:30
Udit
1220eb3c7a docs(langfuse): update chatlitellm section 2024-03-16 03:28:19 +05:30
Udit
acd56b174c docs(langfuse): add chatlitellm section 2024-03-16 03:24:07 +05:30
Krrish Dholakia
e033e84720 docs(cohere.md): fix model name in cohere docs 2024-03-15 10:08:07 -07:00
Krish Dholakia
32ca306123
Merge pull request #2535 from BerriAI/litellm_fireworks_ai_support 
feat(utils.py): add native fireworks ai support
 2024-03-15 10:02:53 -07:00
Krrish Dholakia
5edf414a5f docs(audio_transcription.md): add openai sdk usage example to audio transcription docs 2024-03-15 09:54:03 -07:00
Krrish Dholakia
fa0c8b7be6 docs(fireworks_ai.md): add fireworks ai to docs 2024-03-15 09:17:15 -07:00
ishaan-jaff
f07a652148 (docs) load test proxy 2024-03-15 08:10:45 -07:00
Ishaan Jaff
4c834714ab
Merge pull request #2529 from snekkenull/main 
(feat) add groq/gemma-7b-it
 2024-03-15 07:41:44 -07:00
ishaan-jaff
91a47dc17a (docs) how to run a locust load test 2024-03-15 07:37:50 -07:00
USAGI
a9634b717c
Add groq/gemma-7b-it 2024-03-15 11:50:19 +08:00
Krrish Dholakia
6f1eb038bc docs(bedrock.md): adding docs for calling bedrock models on proxy via config.yaml 2024-03-14 14:50:13 -07:00
Krrish Dholakia
cb221cc88b docs(caching.md): add redis namespaces to docs 2024-03-14 13:38:33 -07:00
dependabot[bot]
913f19e046
build(deps): bump follow-redirects in /docs/my-website 
Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.15.4 to 1.15.6.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases)
- [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.15.4...v1.15.6)

---
updated-dependencies:
- dependency-name: follow-redirects
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-03-14 20:02:59 +00:00
Krrish Dholakia
7876aa2d75 fix(parallel_request_limiter.py): handle metadata being none 2024-03-14 10:02:41 -07:00
ishaan-jaff
0269cddd55 (feat) add claude-3-haiku 2024-03-13 20:24:06 -07:00
Aaron Bach
daca0a93ce Update docs 2024-03-13 17:37:59 -06:00
Krrish Dholakia
16e3aaced5 docs(enterprise.md): add prompt injection detection to docs 2024-03-13 12:37:32 -07:00
Krrish Dholakia
dbc7552d15 docs: refactor team based logging in docs 2024-03-13 12:26:39 -07:00
Krrish Dholakia
b3493269b3 fix(proxy_server.py): support checking openai user param 2024-03-13 12:00:27 -07:00
Krrish Dholakia
9e692d6cce docs(sidebar.js): add dall e 3 cost tracking to docs 2024-03-12 22:26:10 -07:00
Krrish Dholakia
488c4b9939 docs(cost_tracking.md): add docs for cost tracking dall e 3 calls 2024-03-12 21:35:17 -07:00
Ishaan Jaff
5172fb1de9
Merge pull request #2474 from BerriAI/litellm_support_command_r 
[New-Model] Cohere/command-r
 2024-03-12 11:11:56 -07:00
ishaan-jaff
8fabaed543 (docs) cohere-comand-r 2024-03-12 10:34:08 -07:00
ishaan-jaff
ea83c8c9b0 (docs) using azure_text models 2024-03-12 09:54:34 -07:00
Krrish Dholakia
10f5f342bd docs(virtual_keys.md): cleanup doc 2024-03-12 07:05:55 -07:00
Krrish Dholakia
47424b8c90 docs(routing.md): fix routing example on docs 2024-03-11 22:17:04 -07:00
ishaan-jaff
e46980c56c (docs) using litellm router 2024-03-11 21:18:10 -07:00
Vince Loewe
7c38f992dc
Merge branch 'main' into main 2024-03-11 12:36:41 +09:00
Ishaan Jaff
a1784284bb
Merge pull request #2416 from BerriAI/litellm_use_consistent_port 
(docs) LiteLLM Proxy - use port 4000 in examples
 2024-03-09 16:32:08 -08:00
ishaan-jaff
a004240109 (docs) deploy litellm 2024-03-09 13:45:07 -08:00
ishaan-jaff
ba271e3e87 (docs) deploying litell 2024-03-09 13:41:20 -08:00
ishaan-jaff
7ae7e95da1 (docs) litellm getting started clarify sdk vs proxy 2024-03-09 13:04:52 -08:00
Krrish Dholakia
d8a6b8216d docs(input.md): add docs on 'get_supported_openai_params' 2024-03-08 23:54:13 -08:00
Krrish Dholakia
b0fa25dfbd docs(audio_transcription.md): add docs on audio transcription 2024-03-08 23:51:24 -08:00
ishaan-jaff
ea6f42216c (docs) use port 4000 2024-03-08 21:59:00 -08:00
H0llyW00dzZ
33ba57a1b5
Fix Docs Formatting in Website 
- [+] docs(deploy.md): move tip about versioning inside the tab item
 2024-03-09 12:37:18 +07:00
Ishaan Jaff
8036b48f14
Merge pull request #2408 from BerriAI/litellm_no_store_reqs 
[FEAT-liteLLM Proxy] Incognito Requests -  Don't log anything
 2024-03-08 21:11:43 -08:00
H0llyW00dzZ
7004940ce4
Update Docs for Kubernetes 
- [+] docs(deploy.md): add tip about using versioning or SHA digests instead of latest tag
 2024-03-09 11:55:31 +07:00
Guillermo
bb427b4659
Update deploy.md 2024-03-09 02:30:17 +01:00
Guillermo
37b4dde7fd
Add quickstart deploy with k8s 2024-03-09 02:24:07 +01:00
ishaan-jaff
4ff68c8562 (docs) no log requests 2024-03-08 16:26:25 -08:00
ishaan-jaff
2d71f54afb (docs) load test litellm 2024-03-08 15:18:06 -08:00
Guillermo
a693045460
docs: fix yaml typo in proxy/configs.md 
equals was used instead of : as key-value delimiter in yaml
 2024-03-08 20:33:47 +01:00
Krrish Dholakia
0e7b30bec9 fix(utils.py): return function name for ollama_chat function calls 2024-03-08 08:01:10 -08:00
ishaan-jaff
b4e12fb8fd (docs) litellm cloud formation stack 2024-03-07 21:01:28 -08:00
ishaan-jaff
3baa55210a (docs) setting load balancing config 2024-03-07 12:22:39 -08:00
Krrish Dholakia
4508b4ede0 docs(team_based_routing.md): add docs on team based routing 2024-03-07 08:14:46 -08:00
ishaan-jaff
547f0a023d (docs) best practices for high traffic 2024-03-06 16:36:35 -08:00
Krrish Dholakia
688b903d19 docs(bedrock.md): add anthropic function calling to docs 2024-03-05 21:34:46 -08:00
Krrish Dholakia
5c03109b6f docs(configs.md): add load balancing to proxy config docs 2024-03-05 07:39:40 -08:00
Krrish Dholakia
8845430cdb docs(anthropic.md): add proxy usage tutorial to anthropic docs 2024-03-04 22:00:33 -08:00
ishaan-jaff
1183e5f2e5 (feat) maintain anthropic text completion 2024-03-04 11:16:34 -08:00
Ishaan Jaff
14fc8355fb
Merge pull request #2315 from BerriAI/litellm_add_claude_3 
[FEAT]- add claude 3
 2024-03-04 09:23:13 -08:00
Ishaan Jaff
84415ef7b5
Merge pull request #2290 from ti3x/bedrock_mistral 
Add support for Bedrock Mistral models
 2024-03-04 08:42:47 -08:00
ishaan-jaff
d179ae376e (feat) claude-3 test fixes 2024-03-04 07:53:06 -08:00
ishaan-jaff
25bbb73ce3 (docs) add claude-3 2024-03-04 07:40:18 -08:00
Krrish Dholakia
b283588eb8 refactor(budget_alerts.md): add spacing in doc 2024-03-02 23:12:49 -08:00
Krrish Dholakia
53326da1c9 refactor(budget_alerts.md): add spacing in doc 2024-03-02 23:12:34 -08:00
Krrish Dholakia
922b38301f docs(budget_alerts.md): doc cleanup 2024-03-02 23:11:04 -08:00
ishaan-jaff
fa2c6fdebb (docs) alerting slack budgets 2024-03-02 17:55:49 -08:00
ishaan-jaff
b2389a9b1d (feat) improve test slack alert 2024-03-02 17:33:18 -08:00
ishaan-jaff
b7416fc946 (fix) improve example test slack alert 2024-03-02 17:33:07 -08:00
ishaan-jaff
0b85061086 (docs) 2024-03-02 16:32:33 -08:00
ishaan-jaff
fd9f8b7010 (docs) setting soft budgets 2024-03-02 13:05:00 -08:00
Krrish Dholakia
468995b288 docs(supported_embeddings.md): add vertex ai embeddings to docs 2024-03-02 09:34:01 -08:00
Ishaan Jaff
d494941dcc
Merge pull request #2285 from Linutux/patch-1 
Update deploy.md / Update path to docker-compose.yml
 2024-03-01 21:02:32 -08:00
Krrish Dholakia
d3a742efc8 docs(supported_embedding.md): add vertex ai embeddings to docs 2024-03-01 20:57:23 -08:00
Tim Xia
dc84e28c41 update docs for supported models 2024-03-01 23:34:04 -05:00
ishaan-jaff
d1465ed57e (feat) add gpt-3.5-turbo-instruct-0914 2024-03-01 20:02:12 -08:00
Krrish Dholakia
5e516522fb docs(azure.md): improve azure docs 2024-03-01 19:40:55 -08:00
Simon Zöllner
57bde371d6
Update deploy.md / Update path to docker-compose.yml 
The file seems to have been moved
 2024-03-01 23:32:47 +01:00
Vince Loewe
05c0fa8b9b
Merge branch 'main' into main 2024-03-01 13:37:17 -08:00
ishaan-jaff
edab94c0a6 (docs) load balancing on proxy 2024-03-01 12:28:59 -08:00
ishaan-jaff
295d36a383 (docs) load balancing 2024-03-01 11:46:42 -08:00
ishaan-jaff
4bfefd2b08 (feat) add groq api pricing, models 2024-02-29 16:11:22 -08:00
Ishaan Jaff
d2115d5a17
Merge pull request #2263 from BerriAI/litellm_gpt_gemini_base_64 
[FEAT] Use Base64 images with vertex_ai/gemini-pro-vision
 2024-02-29 16:01:19 -08:00
ishaan-jaff
02c3955c51 (docs) using gemini vision with base64 2024-02-29 15:55:56 -08:00
Ishaan Jaff
e044d6332f
Merge pull request #2255 from BerriAI/litellm_admin_ui_user_panel_load_time_high 
[FEAT] proxy add pagination on /user/info endpoint (Admin UI does not load all users)
 2024-02-29 13:22:00 -08:00
ishaan-jaff
2415dc7927 (docs) /user/info 2024-02-29 13:05:07 -08:00
ishaan-jaff
ed85d2de95 (docs) /user/info 2024-02-29 13:04:41 -08:00
Ishaan Jaff
3d2150afcc
Merge pull request #2247 from BerriAI/litellm_mistral_azure_ai_fixes 
[FEAT]  mistral azure - use with env vars + added pricing
 2024-02-29 12:22:53 -08:00
ishaan-jaff
3fea348e4e (docs) enterprise update 2024-02-29 11:42:19 -08:00
ishaan-jaff
817fa2483a (docs) mistral on azure ai studio 2024-02-29 08:28:19 -08:00
ishaan-jaff
46134d3fba (docs) using mistral azure ai studio 2024-02-29 08:14:24 -08:00
Vince Loewe
f98619e6f2
Merge branch 'BerriAI:main' into main 2024-02-28 22:18:14 -08:00
Krrish Dholakia
f120f94cc9 docs(ui.md): update 2024-02-28 21:25:39 -08:00
ishaan-jaff
76e7f8831f (docs) check if supports function calling 2024-02-28 17:41:54 -08:00
Krrish Dholakia
a042092faa test: removing bedrock claude-v1 testing - bedrock removed this 2024-02-28 11:08:17 -08:00
Vince Loewe
a9648613dc feat: LLMonitor is now Lunary 2024-02-27 22:07:13 -08:00
Ishaan Jaff
990439c49c
Merge branch 'main' into litellm_daily_metrics 2024-02-27 20:33:35 -08:00
ishaan-jaff
4fb723f119 (docs) show /daily_metrics 2024-02-27 19:34:47 -08:00
ishaan-jaff
d19370083d (feat) update /daily metrics 2024-02-27 18:33:59 -08:00
ishaan-jaff
7cabc6ac56 (docs) show daily metrics tab 2024-02-27 18:03:15 -08:00
ishaan-jaff
7485fa797c (docs) vertex ai litellm proxy 2024-02-27 17:55:05 -08:00
ishaan-jaff
f3144dd9cf (docs) vertex ai 2024-02-27 17:44:35 -08:00
ishaan-jaff
8075746078 (docs) fix clickhouse link 2024-02-26 18:35:33 -08:00
ishaan-jaff
9bb55a0671 add clickhouse docs 2024-02-26 18:31:10 -08:00
ishaan-jaff
c627ce6631 (docs) use azure ai studio + mistral litellm 2024-02-26 14:33:21 -08:00
ishaan-jaff
da4832d5a2 (feat) add mistral-large-latest 2024-02-26 09:25:44 -08:00
Krrish Dholakia
577a0f9440 docs: add gemini-1.5 to docs 2024-02-26 08:01:30 -08:00
Krish Dholakia
61d69b1efa
Merge pull request #2183 from BerriAI/litellm_team_rate_limits 
fix(proxy_server.py): allow user to set team tpm/rpm limits/budget/models
 2024-02-25 01:12:39 -08:00
ishaan-jaff
7c19783d32 (docs) writing custo add 2024-02-24 18:54:46 -08:00
Ishaan Jaff
c8daf61592
Merge pull request #2188 from BerriAI/litellm_fix_health_checks 
[Fix] Fix health check when API base set for OpenAI compatible models
 2024-02-24 18:47:13 -08:00
ishaan-jaff
a4d2d1c4e6 (docs) using openai compatible endpoints 2024-02-24 18:46:20 -08:00
ishaan-jaff
bf403dc02e (docs) health 2024-02-24 18:38:39 -08:00
ishaan-jaff
986babfeaa (docs) open router 2024-02-24 18:30:41 -08:00
ishaan-jaff
7c032fcc05 (docs) open router 2024-02-24 18:28:32 -08:00
Krrish Dholakia
0b77420087 docs(users.md): add team budgets to docs 2024-02-24 11:41:42 -08:00
Krrish Dholakia
edaf20b60a docs(enterprise.md): add end user opt out to docs 2024-02-24 09:28:41 -08:00
Krrish Dholakia
308c73fca9 docs(contributing.md): add docs for contributing to litellm ui 2024-02-23 13:01:34 -08:00
ishaan-jaff
602b25972d (docs) add groq ai 2024-02-23 10:40:33 -08:00
Krrish Dholakia
44b8270bf6 docs(enterprise.md): add banned keywords to docs 2024-02-23 10:07:31 -08:00
ishaan-jaff
c2325539e7 (docs) fix athina docs 2024-02-23 09:56:10 -08:00
Ishaan Jaff
9594ceae55
Merge pull request #2164 from BerriAI/litellm_support_extra_headers 
[FEAT] Support extra headers - OpenAI / Azure
 2024-02-23 09:42:09 -08:00
Ishaan Jaff
5ec3075fb1
Merge pull request #2163 from vivek-athina/feature/athina 
Support for Athina logging
 2024-02-23 09:39:06 -08:00
ishaan-jaff
c9567c8652 (docs) passing extra_headers to OpenAI 2024-02-23 09:27:48 -08:00
Vivek Aditya
0d3046dcc9 added athina to logging doc 2024-02-23 22:33:09 +05:30
ishaan-jaff
aa9164e2ce (docs) setting extra_headers 2024-02-23 08:56:09 -08:00
Krrish Dholakia
d1a40ecacf docs(load_balancing.md): have proxy routing docs point to sdk routing docs 2024-02-23 08:34:15 -08:00
Vivek Aditya
244fa1c4ab Support for Athina logging 2024-02-23 21:49:40 +05:30
Krish Dholakia
e7cce90c3a
Merge pull request #2144 from BerriAI/litellm_blocked_user_list 
feat(proxy_server.py): add support for blocked user lists (enterprise-only)
 2024-02-22 21:34:07 -08:00
ishaan-jaff
21e1c2dc21 (docs) admin ui with proxy_base_url 2024-02-22 21:18:26 -08:00
ishaan-jaff
2122a7cf1e (docs) set user tpm/rpm limits 2024-02-22 19:23:16 -08:00
Krrish Dholakia
6ad450396b docs(enterprise.md): add Enable Blocked User Lists for docs 2024-02-22 18:04:29 -08:00
ishaan-jaff
b6886b8714 (docs) set hosted image for custom branding 2024-02-22 15:40:15 -08:00
ishaan-jaff
6a48fa64ce (docs) set generic user attributes 2024-02-22 14:25:07 -08:00
Ishaan Jaff
b603d9784d
Merge pull request #2129 from adrien-f/sso 
update generic SSO login
 2024-02-22 13:21:53 -08:00
ishaan-jaff
580f9e3097 (docs) setting cache paras on proxy + Openai client 2024-02-22 13:17:32 -08:00
ishaan-jaff
5c888853c7 (docs) litellm proxy server 2024-02-22 07:55:23 -08:00
Adrien Fillon
90f0062fc6
update generic SSO login 
During implementation for Okta, noticed a few things:

- Some providers require a state parameter to be sent
- Some providers require that the client_id is not included in the body

Moreover, the OpenID response converter was not implemented which
was returning an empty response.

Finally, there was an order where there's a fetch of user information
but on first usage, it is not created yet.
 2024-02-22 14:34:18 +01:00
ishaan-jaff
f04b67c433 (docs) custom ui branding 2024-02-21 22:07:40 -08:00
ishaan-jaff
7419547ba1 (docs) model max budgets 2024-02-20 21:11:17 -08:00
ishaan-jaff
2b2e62477b (docs) use correct base model for cost 2024-02-20 21:00:43 -08:00
Krrish Dholakia
987cb38976 docs(pii_masking.md): docs for ad-hoc recognizers for pii masking 2024-02-20 16:08:34 -08:00
Krrish Dholakia
1227964155 docs(enterprise.md): clarify what's in enterprise 2024-02-20 08:43:28 -08:00
Krrish Dholakia
fde478f70b docs(enterprise.md): add llm guard to docs 2024-02-19 21:05:01 -08:00
Krrish Dholakia
54e9b5b99a docs(enterprise.md): add customizing llama guard prompt to docs 2024-02-19 15:22:09 -08:00
Krrish Dholakia
7348956bf2 docs(enterprise.md): add google text moderations to the docs 2024-02-19 14:17:52 -08:00
Krish Dholakia
6f77a4a31e
Merge pull request #2037 from BerriAI/litellm_request_level_pii_masking 
feat(presidio_pii_masking.py): allow request level controls for turning on/off pii masking
 2024-02-17 19:05:14 -08:00
Krrish Dholakia
045d84e167 fix(proxy_cli.py): allow user to control db connection pool + timeouts from config 2024-02-17 19:03:43 -08:00
Krish Dholakia
ad81e19282
Merge pull request #2013 from afbarbaro/litellm_gemini_safety_settings 
Add safety_settings parameter to gemini generate_content calls
 2024-02-17 16:47:29 -08:00
Ishaan Jaff
35af2d666b
Merge pull request #2022 from BerriAI/litellm_budgets_per_llm 
[FEAT] Track spend per model (for Key, User and Team)
 2024-02-17 15:35:31 -08:00
ishaan-jaff
1652e894c1 (docs) set budget per model 2024-02-17 15:34:55 -08:00
Andres Barbaro
b10bf2083c Update gemini documentation 2024-02-17 17:31:37 -06:00
ishaan-jaff
c5891c3ee8 (fix) docs - incorrect title 2024-02-17 13:26:45 -08:00
Ishaan Jaff
ab8df9c284
Merge pull request #2039 from BerriAI/litellm_customizationroot_path 
[FEAT] Set FastAPI root path
 2024-02-17 13:23:31 -08:00
Ishaan Jaff
3fe762b8b1
Merge pull request #2018 from Lunik/feat/refresh-helm-chart 
✨ Refresh Helm chart structure
 2024-02-17 13:19:11 -08:00
ishaan-jaff
67932dccbc (docs) setting server root path 2024-02-17 13:12:06 -08:00
Krrish Dholakia
448537e684 feat(presidio_pii_masking.py): allow request level controls for turning on/off pii masking 
https://github.com/BerriAI/litellm/issues/2003
 2024-02-17 11:04:56 -08:00
Krrish Dholakia
e3fab50853 docs(call_hooks.md): add async_moderation_hook to docs 2024-02-17 09:40:34 -08:00
Krrish Dholakia
0cd2deee63 docs(call_hooks.md): add async_moderation_hooks to docs 2024-02-17 09:38:36 -08:00
Krrish Dholakia
3565f74338 docs(enterprise.md): add llama guard tutorial to enterprise docs 2024-02-17 09:25:49 -08:00
Ishaan Jaff
4d4653b619
Merge branch 'main' into litellm_fix_generic_sso 2024-02-16 14:51:46 -08:00
ishaan-jaff
4ab697c6c2 (Docs) generic sso provider 2024-02-16 14:47:15 -08:00
Ishaan Jaff
e6b9e5b46f
Merge pull request #2020 from Lunik/feat/generic-sso-scopes 
✨ Allow to configure scopes in generic SSO
 2024-02-16 14:45:09 -08:00
Lunik
21552620ed
📝 Clarify GENERIC_SCOPE usage 
Signed-off-by: Lunik <lunik@tiwabbit.fr>
 2024-02-16 23:40:59 +01:00
Lunik
af4537e421
✨ Allow to configure scopes in generic SSO 
Signed-off-by: Lunik <lunik@tiwabbit.fr>
 2024-02-16 23:24:58 +01:00
ishaan-jaff
6e1708f595 (docs) use litellm ghcr as base image 2024-02-16 14:02:46 -08:00
Lunik
880213d4a6
✨ Refresh Helm chart structure 
Signed-off-by: Lunik <lunik@tiwabbit.fr>
 2024-02-16 22:59:14 +01:00
ishaan-jaff
d574bfc297 (docs) view spend per tag 2024-02-16 10:47:33 -08:00
Krrish Dholakia
a938b296a3 docs(pii_masking.md): allow keys to turn off pii masking 2024-02-16 00:04:24 -08:00
ishaan-jaff
92612c0d4e (docs) custom callback apis 2024-02-15 17:16:36 -08:00
ishaan-jaff
b6b5e0e7c2 (docs) use async callback APIs 2024-02-15 17:06:16 -08:00
Krish Dholakia
57654f4533
Merge branch 'main' into litellm_aioboto3_sagemaker 2024-02-14 21:46:58 -08:00
ishaan-jaff
3d03f65b08 (docs) generic sso 2024-02-14 15:07:03 -08:00
Ishaan Jaff
ed8f507536
Merge pull request #1974 from BerriAI/litellm_proxy_add_moderations_endpoint 
[FEAT] Proxy Add /moderations endpoint
 2024-02-14 13:07:34 -08:00
Krrish Dholakia
a61b0bf9e5 docs(pii_masking.md): add output parsing to docs 2024-02-14 12:09:05 -08:00
Krrish Dholakia
e7666d3908 docs(custom_callback.md): link to proxy docs for custom logging there 2024-02-14 11:42:13 -08:00
ishaan-jaff
f1dc656491 (docs) add moderations to docs 2024-02-14 11:34:06 -08:00
Krrish Dholakia
e590f47a44 docs(health.md): add docs on image generation health checks 2024-02-13 23:31:05 -08:00
ishaan-jaff
b81f8ec8ca (docs) fix docker run command 2024-02-13 21:47:23 -08:00
Ishaan Jaff
003feda33f
Merge branch 'main' into litellm_dynamo_use_arn 2024-02-13 21:27:38 -08:00
Krrish Dholakia
f09c09ace4 docs(pii_masking.md): fix presidio tutorial 2024-02-13 07:42:27 -08:00
Krrish Dholakia
f3a950705c docs(pii_masking.md): add pii masking to proxy docs 2024-02-12 21:40:34 -08:00
Krrish Dholakia
ad7e856a02 docs(pii_masking.md): add pii masking to proxy docs 2024-02-12 11:36:52 -08:00
deena
2d62353309 docs to include langfuse trace tags feature 2024-02-12 20:26:32 +02:00
ishaan-jaff
7d67096756 (docs) virtual keys 2024-02-12 08:54:18 -08:00
ishaan-jaff
ef89144eaf (docs) caching proxy server 2024-02-12 08:32:00 -08:00
ishaan-jaff
fb7958dc40 (docs) caching 2024-02-12 08:27:52 -08:00
ishaan-jaff
60de5ce643 (docs) Restrict models by team_id 2024-02-10 21:26:16 -08:00
ishaan-jaff
e0cd109d28 (docs) ssl_settings for litellm proxy 2024-02-10 18:17:15 -08:00
Krrish Dholakia
7bd4737018 docs(ui.md): update ui docs 2024-02-10 17:26:04 -08:00
Krrish Dholakia
d1893129f7 docs(custom_pricing.md): add disclaimer on pricing in custom pricing docs 2024-02-10 07:40:19 -08:00
ishaan-jaff
5078ed1ace (docs) llamaindex + proxy 2024-02-09 17:06:49 -08:00
ishaan-jaff
e3f5579091 (docs) use llama index with litellm proxy 2024-02-09 16:57:48 -08:00
ishaan-jaff
cf16687509 (docs) litellm 2024-02-09 10:27:46 -08:00
ishaan-jaff
694f0d6af5 (docs) proxy quickstart 2024-02-09 10:21:39 -08:00
ishaan-jaff
854eee3785 (docs) getting started 2024-02-09 09:42:37 -08:00
David Leen
140d915adf Add support for AWS credentials from profile file 
https://boto3.amazonaws.com/v1/documentation/api/latest/guide/credentials.html#aws-config-file
 2024-02-08 15:10:50 -08:00
Krrish Dholakia
9be5e2f7e3 docs(enterprise.md): adding enterprise support to docs 2024-02-08 10:02:40 -08:00
Ishaan Jaff
98b0ace2e9
Merge pull request #1874 from BerriAI/litellm_azure_base_model_pricing 
[FEAT] Azure Pricing - based on base_model in model_info
 2024-02-07 18:37:55 -08:00
ishaan-jaff
c98e247b0f (docs) azure/gpt-4-0125-preview 2024-02-07 18:22:38 -08:00
ishaan-jaff
206a6845ac (docs) pricing base_model 2024-02-07 16:54:24 -08:00
Krrish Dholakia
66913222a1 docs(langfuse_integration.md): docs for showing how to log errors to langfuse 2024-02-07 12:07:11 -08:00
Krrish Dholakia
048acc8e68 docs(ui.md): add more help to docs 2024-02-07 11:46:57 -08:00
Krrish Dholakia
2fcbe06af8 docs(ui.md): add proxy admin view to docs 2024-02-07 11:38:27 -08:00
Krrish Dholakia
e165ec40d4 docs(ui.md): ui doc updates 2024-02-07 11:38:27 -08:00
ishaan-jaff
5f4b06fb19 (docs) caching 2024-02-06 19:39:32 -08:00
ishaan-jaff
8208ebd9db (docs) budget per end_user 2024-02-06 15:39:45 -08:00
Krrish Dholakia
fa5f4b9774 test(test_completion.py): fix test 2024-02-06 13:29:47 -08:00
Ishaan Jaff
7cb69c72c8
Merge branch 'main' into litellm_add_semantic_cache 2024-02-06 11:18:43 -08:00
ishaan-jaff
54c920c299 (docs) litellm semantic caching 2024-02-06 10:54:55 -08:00
ishaan-jaff
93504915d7 (docs) redis cache 2024-02-06 10:53:28 -08:00
ishaan-jaff
bdc2091838 (docs) using semantic caching on proxy 2024-02-06 10:32:07 -08:00
TanaroSch
b69cb2c773 change max_tokens float to int 2024-02-06 11:19:28 +01:00
ishaan-jaff
d4fd287617 (docs) upperbound_key_generate_params 2024-02-05 22:37:05 -08:00
David Manouchehri
c77deb12b3
(docs) Add session_id to Langfuse doc 2024-02-05 15:21:05 -05:00
ishaan-jaff
7e43d22da4 (docs) update ui 2024-02-03 20:43:43 -08:00
Krish Dholakia
6408af11b6
Merge pull request #1799 from BerriAI/litellm_bedrock_stable_diffusion_support 
feat(bedrock.py): add stable diffusion image generation support
 2024-02-03 12:59:00 -08:00
Krrish Dholakia
269866edc9 docs(bedrock.md): add image generation docs to bedrock file 2024-02-03 12:17:30 -08:00
ishaan-jaff
3f2f864cc8 (docs) /user/new 2024-02-03 10:59:06 -08:00
Krrish Dholakia
6cdb9aede0 docs(logging.md): add team-based logging to docs 2024-02-02 20:15:49 -08:00
Krrish Dholakia
aac8106c37 docs(vertex.md): adding vertex ai model garden support to docs 2024-02-02 18:42:56 -08:00
ishaan-jaff
662d5e8b85 (docs) set ssl_verify for OpenAI 2024-02-01 21:07:58 -08:00
Krrish Dholakia
1a1b929a4e docs(token_usage.md): add LITELLM_LOCAL_MODEL_COST_MAP to docs 2024-02-01 18:05:13 -08:00
ishaan-jaff
bfdc3f6205 (docs) ui 2024-02-01 16:17:35 -08:00
ishaan-jaff
631657ba5e (docs) remove PROXYBASEURL 2024-02-01 13:09:03 -08:00
ishaan-jaff
deecf13bdc (docs) use bedrock + aws_region on proxy 2024-02-01 10:10:51 -08:00
Krrish Dholakia
ee50e97c98 docs(configs.md): add aws routing to proxy docs 2024-02-01 08:50:20 -08:00
ishaan-jaff
dbd947a366 (docs) update proxy ui docs 2024-01-31 19:54:04 -08:00
ishaan-jaff
cfa69c3184 (docs) UI - no sso 2024-01-30 17:05:36 -08:00
ishaan-jaff
693c6ec40e (docs) ui + sso callbacks 2024-01-30 15:41:01 -08:00
ishaan-jaff
5c0f9f421c (docs) setting organization on config.yaml 2024-01-30 11:08:52 -08:00
Krrish Dholakia
5531fd014a docs(configs.md): add complete proxy config in docs 2024-01-30 07:48:56 -08:00
ishaan-jaff
56214b7971 (docs) default /key/generate params 2024-01-29 17:06:11 -08:00
Ishaan Jaff
1102863ca8
Merge pull request #1673 from BerriAI/litellm_version_health_readiness 
[Feat] return litellm version in health/readiness
 2024-01-29 15:36:18 -08:00
Krrish Dholakia
f7320834af docs(debugging.md): add docs for debugging on the proxy 2024-01-29 15:21:12 -08:00
ishaan-jaff
d974e5971a (docs) /healthreadiness 2024-01-29 15:21:08 -08:00
ishaan-jaff
45dacc5336 (docs) Default /key/generate params 2024-01-29 14:35:22 -08:00
ishaan-jaff
29babdcc48 (docs) use admin UI 2024-01-29 12:20:18 -08:00
ishaan-jaff
1499c2ad62 (docs) hosted ui litellm 2024-01-29 09:43:55 -08:00
Krrish Dholakia
0c9e56aff1 docs(virtual_keys.md): add key alias and key name to docs 2024-01-27 20:03:07 -08:00
ishaan-jaff
950c753429 (docs) on callbacks tracking api_key, base etc 2024-01-27 08:31:50 -08:00
ishaan-jaff
21a6698a39 (docs) alerting 2024-01-26 15:22:50 -08:00
ishaan-jaff
eda2c08dd4 (docs) alerts - key, proxy budgets 2024-01-26 15:22:50 -08:00
ishaan-jaff
65fd405bd4 (docs) dimensions embedding param 2024-01-26 13:33:11 -08:00
ishaan-jaff
42270258d1 (docs) new gpt-4-0125-preview 2024-01-25 14:48:56 -08:00
ishaan-jaff
b3853c3a53 (docs) new OpenAI embedding models 2024-01-25 14:38:03 -08:00
Krrish Dholakia
fdb28407bc docs(custom_pricing.md): fix tutorial 2024-01-25 09:36:15 -08:00
Krrish Dholakia
01a84837a7 docs(vertex.md): add vertex ai proxy tutorial to docs 2024-01-25 09:11:11 -08:00
Krrish Dholakia
389347250f docs(users.md): add proxy budget to docs 2024-01-25 09:04:23 -08:00
ishaan-jaff
3ca82fb458 (docs) spend per user 2024-01-24 12:17:23 -08:00
ishaan-jaff
9b39893980 v0 set arn number on dynamoDB /key/gen 2024-01-24 10:29:28 -08:00
Krrish Dholakia
d9fd8f28d6 docs(users.md): add docs on resetting budget at the end of duration 2024-01-24 08:34:48 -08:00
ishaan-jaff
19af0cd3ed (docs) admin ui 2024-01-23 19:41:40 -08:00
Krrish Dholakia
9327d76379 docs(users.md): add key budgets to docs 2024-01-23 06:42:13 -08:00
Krish Dholakia
bedb08bdef
Merge pull request #1557 from BerriAI/litellm_emit_spend_logs 
feat(utils.py): emit response cost as part of logs
 2024-01-22 21:02:40 -08:00
Krrish Dholakia
3e8c8ef507 fix(openai.py): fix linting issue 2024-01-22 18:20:15 -08:00
Ishaan Jaff
db68774d60
Merge branch 'main' into litellm_budget_per_key 2024-01-22 15:49:57 -08:00
Krrish Dholakia
82bbf336d5 docs(sidebars.js): add custom pricing to docs 2024-01-22 15:15:34 -08:00
Ishaan Jaff
5700d60e1a
Merge pull request #1538 from BerriAI/litellm_use_custom_key_gen 
[Feat] Proxy Auth - Use custom_key_generate
 2024-01-22 14:21:19 -08:00
ishaan-jaff
76214baab9 (docs) budget per key 2024-01-22 13:18:07 -08:00
Krrish Dholakia
265f5ef6da docs(routing.md): add timeouts per model 2024-01-22 08:55:17 -08:00
ishaan-jaff
6b7fd172a3 (docs) Custom /key/generate 2024-01-20 10:12:47 -08:00
Kihaya Sugiura
82449ffcfd
docs: Fix import 2024-01-20 19:15:07 +09:00
Kihaya Sugiura
c550357199
docs: Fix import 2024-01-20 19:13:33 +09:00
ishaan-jaff
5295168bda (docs) router 2024-01-19 20:46:43 -08:00
ishaan-jaff
6bc7cc46b4 (docs) router debugging 2024-01-19 15:18:00 -08:00
Tim Asp
315fbcd09f update docs 2024-01-19 11:39:39 -08:00
Krrish Dholakia
62e35f6a14 docs(users.md): add tpm rpm rate limits to docs 2024-01-19 08:56:47 -08:00
Krrish Dholakia
c5e144af23 docs(health.md): add /health/readiness and /health/liveliness to docs 2024-01-19 08:45:23 -08:00
ishaan-jaff
cdede8836f (docs)virtual keys 2024-01-18 15:16:40 -08:00
ishaan-jaff
0e3e8050d7 (docs) /key/info 2024-01-18 14:54:11 -08:00
ishaan-jaff
d5e720e161 (docs) /key/update 2024-01-18 14:45:49 -08:00
ishaan-jaff
f405a827e3 (docs) virtual_keys 2024-01-18 13:55:32 -08:00
ishaan-jaff
1c987a436e (docs) virtual_keys 2024-01-18 13:34:33 -08:00
Krrish Dholakia
37e6c6a59f docs(sidebars.js): simplify docs nav 2024-01-18 11:38:02 -08:00
Krrish Dholakia
354a0b2497 docs(sidebar.js): add link to all endpoints in sidebar 2024-01-18 11:21:55 -08:00
Duarte OC
5d0654e6f6 docs 2024-01-18 17:32:42 +01:00
Krrish Dholakia
a6cd068c49 docs(virtual_keys.md): add model access groups to docs 2024-01-17 20:38:41 -08:00
Krrish Dholakia
70c4227f5e docs(bedrock.md): add sts based auth to docs 2024-01-17 12:17:09 -08:00
ishaan-jaff
5bb4fdc7e4 (docs) using azure gpt4 vision enhancements 2024-01-17 11:04:38 -08:00
ishaan-jaff
3c52fec28b (docs) using azure with vision enhancements on litellm 2024-01-17 10:59:25 -08:00
ishaan-jaff
ffc655e768 (docs) proxy /key/gen 2024-01-16 20:09:43 -08:00
ishaan-jaff
4929a6c95c (docs) proxy - key management, show correct code 2024-01-16 12:02:04 -08:00
ishaan-jaff
a84c86562c (docs) controlling num_workers using env variables 2024-01-16 08:46:41 -08:00
ishaan-jaff
ab7531b6c1 (docs) failing rules 2024-01-15 21:07:16 -08:00
ishaan-jaff
2b3cc694af (docs) proxy - fail requests with custom error message 2024-01-15 17:16:56 -08:00
ishaan-jaff
07a60c19ac (docs) dynamoDB + Key management 2024-01-15 14:20:29 -08:00
Chris Mungall
2bdd35245d
Update image_generation.md 
Fixed two typos
 2024-01-15 11:54:01 -08:00
Ishaan Jaff
ad06b08a5e
Merge pull request #1442 from BerriAI/litellm_bedrock_provisioned_throughput 
[Feat] Support Bedrock provisioned throughput LLMs
 2024-01-14 10:51:28 +05:30
ishaan-jaff
7af3fe68e4 (docs) provisioned throughput bedrock models 2024-01-13 21:12:59 -08:00
ishaan-jaff
0648226c48 (docs) azure with vision enhancements 2024-01-13 15:13:37 -08:00
Krrish Dholakia
8a7a745549 Merge branch 'litellm_dynamo_db_keys' 2024-01-13 18:38:43 +05:30
ishaan-jaff
0ae8ab1b13 (docs) sso login + bedrock 2024-01-12 16:51:15 -08:00
Krrish Dholakia
b6a9274baa docs(virtual_keys.md): clearer example for /key/generate 2024-01-13 01:39:03 +05:30
Krrish Dholakia
cbdb8d68a3 docs(health.md): add text completion health check tutorial to docs 2024-01-12 00:32:06 +05:30
ishaan-jaff
c46a370919 (docs) logging proxy input / output 2024-01-11 15:37:03 +05:30
ishaan-jaff
aef2dfbf55 (docs) proxy - s3 logging 2024-01-11 10:01:52 +05:30
ishaan-jaff
cf8dd063cf (docs) add s3 logging to proxy 2024-01-11 09:45:42 +05:30
Krrish Dholakia
8394315173 docs(deploy.md): update docker version tags to main-latest 2024-01-11 02:36:25 +05:30
Krrish Dholakia
b8de5636d4 docs(quick_start.md): update docs to use correct docker image 2024-01-10 23:31:51 +05:30
ishaan-jaff
9e4449a072 (docs) bedrock - show bedrock/ prefix 2024-01-10 23:07:05 +05:30
ishaan-jaff
6e19bb87e2 (docs) proxy config - show how to set seed, temp on config.yaml 2024-01-10 22:16:04 +05:30
ishaan-jaff
03a0e04b0d (docs) proxy - we now use gunicorn default 2024-01-10 22:09:25 +05:30
ishaan-jaff
59669b4c2a (docs) key/gen link to Deploy instructions 2024-01-10 22:07:14 +05:30
Krrish Dholakia
e44d3e51aa ci(config.yml): run prisma generate before testing 2024-01-10 21:26:38 +05:30
Krrish Dholakia
0ed54ddc7f docs(virtual_keys.md): add dynamodb docs 2024-01-09 23:26:45 +05:30
Ishaan Jaff
4cfa010dbd
Merge pull request #1381 from BerriAI/litellm_content_policy_violation_exception 
[Feat] Add litellm.ContentPolicyViolationError
 2024-01-09 17:18:29 +05:30
ishaan-jaff
75d44fad66 (docs) add ContentPolicyViolationError 2024-01-09 17:16:35 +05:30
ishaan-jaff
248e5f3d92 (chore) remove deprecated completion_with_config() tests 2024-01-09 17:13:06 +05:30
ishaan-jaff
cc07ba1d6a (docs) move tutorials 2024-01-09 17:09:41 +05:30
ishaan-jaff
e8987d9b67 (docs) remove outdated tutorials 2024-01-09 17:06:35 +05:30
ishaan-jaff
4713309b0b (docs) using /key/generate 2024-01-09 16:21:58 +05:30
dependabot[bot]
6b548c04e4
build(deps): bump follow-redirects in /docs/my-website 
Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.15.2 to 1.15.4.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases)
- [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.15.2...v1.15.4)

---
updated-dependencies:
- dependency-name: follow-redirects
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-09 10:24:25 +00:00