Commit Graph

2427 Commits

Author SHA1 Message Date
Ishaan Jaff
82948fccc7 add link to fine tuning api 2024-07-31 17:15:12 -07:00
Ishaan Jaff
4a1ab44f6a docs fine tuning 2024-07-31 17:13:02 -07:00
Krish Dholakia
3a70849ce0
Merge pull request #4976 from BerriAI/litellm_huggingface_embedding_fixes
feat(huggingface_restapi.py): Support multiple hf embedding types + async hf embeddings
2024-07-30 15:34:44 -07:00
Krrish Dholakia
d0971dd50e docs(supported_embedding.md): add specifying input_type for huggingface embedding calls 2024-07-30 13:45:38 -07:00
Ishaan Jaff
afad69b147
Merge pull request #4969 from BerriAI/litellm_get_batches
[Feature]: GET /v1/batches to return list of batches
2024-07-30 13:27:22 -07:00
Krrish Dholakia
f1b7d2318c docs(input.md): update docs to show ollama tool calling 2024-07-30 09:56:24 -07:00
Ishaan Jaff
1e1bce4594 docs LIST batches 2024-07-30 09:49:11 -07:00
Krrish Dholakia
7d5022b0e0 docs(scheduler.md): update docs with request timeout 2024-07-29 21:18:12 -07:00
Krrish Dholakia
76f4aa80e3 docs(deploy.md): support running litellm docker container without internet connection 2024-07-29 19:40:12 -07:00
Ishaan Jaff
b0da3f12e8
Merge pull request #4950 from BerriAI/dependabot/npm_and_yarn/docs/my-website/fast-xml-parser-4.4.1
build(deps): bump fast-xml-parser from 4.3.2 to 4.4.1 in /docs/my-website
2024-07-29 15:10:07 -07:00
dependabot[bot]
9cb3235d98
build(deps): bump fast-xml-parser in /docs/my-website
Bumps [fast-xml-parser](https://github.com/NaturalIntelligence/fast-xml-parser) from 4.3.2 to 4.4.1.
- [Release notes](https://github.com/NaturalIntelligence/fast-xml-parser/releases)
- [Changelog](https://github.com/NaturalIntelligence/fast-xml-parser/blob/master/CHANGELOG.md)
- [Commits](https://github.com/NaturalIntelligence/fast-xml-parser/compare/v4.3.2...v4.4.1)

---
updated-dependencies:
- dependency-name: fast-xml-parser
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-29 21:41:45 +00:00
Ishaan Jaff
3ce0cac56d docs guardrailConfig 2024-07-29 14:26:46 -07:00
Ishaan Jaff
21963e0bbe proxy server 2024-07-29 14:22:02 -07:00
Ishaan Jaff
7cac1b0dce docs - Bedrock Guardrails 2024-07-29 14:18:42 -07:00
Krrish Dholakia
21eea28723 docs(vertex.md): add mistral api to docs 2024-07-27 22:44:15 -07:00
Ishaan Jaff
b2f745f0e2
Merge pull request #4926 from BerriAI/litellm_check_max_request_size
Proxy Enterprise - security - check max request size
2024-07-27 17:02:12 -07:00
Krish Dholakia
f9eca63433
Merge pull request #4919 from yujonglee/fix-canary-dev
Fix Canary error with `docusaurus start`
2024-07-27 16:42:49 -07:00
Krrish Dholakia
a7785c624b docs(user_keys.md): improve openai migration docs 2024-07-27 16:29:06 -07:00
Ishaan Jaff
15d488c25c docs set max_request_size 2024-07-27 16:25:57 -07:00
Krrish Dholakia
1e621f716f docs(debugging.md): cleanup docs 2024-07-27 09:28:53 -07:00
yujonglee
48a1a2ba26 fix 2024-07-27 15:05:17 +09:00
Krish Dholakia
f9c2fec1a6
Merge pull request #4918 from BerriAI/litellm_ollama_tool_calling
feat(ollama_chat.py): support ollama tool calling
2024-07-26 22:16:58 -07:00
Krrish Dholakia
77fe8f57cf docs(ollama.md): add ollama tool calling to docs 2024-07-26 22:12:52 -07:00
Ishaan Jaff
f03769e2a4 docs fix link https://models.litellm.ai/ 2024-07-26 21:35:54 -07:00
Ishaan Jaff
f8b9c7128e docs batches 2024-07-26 18:51:13 -07:00
Ishaan Jaff
90648bee60 docs batches API 2024-07-26 18:50:44 -07:00
Ishaan Jaff
dd37d1d032 use correct link on http://localhost:4000 2024-07-26 18:42:45 -07:00
Ishaan Jaff
f4048bc890 docs batches api 2024-07-26 18:41:53 -07:00
Krrish Dholakia
b515d4f441 docs(stream.md): add streaming token usage info to docs
Closes https://github.com/BerriAI/litellm/issues/4904
2024-07-26 10:51:17 -07:00
Krrish Dholakia
7ca29d987d docs(docusaurus.config.js): add llm model cost map to docs 2024-07-26 10:07:47 -07:00
Krrish Dholakia
84482703b8 docs(config.md): update wildcard docs 2024-07-26 08:59:53 -07:00
Krish Dholakia
35737d04d3
Merge pull request #4893 from yujonglee/canary
[Docs] Better search experience with Canary
2024-07-26 08:34:54 -07:00
yujonglee
10ffb5a960 remove ui shift on reload 2024-07-26 22:13:04 +09:00
yujonglee
8a45abb563 fix import and add fallback 2024-07-26 22:00:48 +09:00
yujonglee
c54f23f936 wrap existing search bar 2024-07-26 21:46:36 +09:00
yujonglee
3967007595 update to latest 2024-07-26 21:06:53 +09:00
Krrish Dholakia
afcad9e12c docs(custom_llm_server.md): cleanup docs 2024-07-25 22:45:03 -07:00
Ishaan Jaff
079a41fbe1
Merge branch 'main' into litellm_proxy_support_all_providers 2024-07-25 20:15:37 -07:00
yujonglee
b6bcb7eb3c update lock 2024-07-26 12:10:05 +09:00
Ishaan Jaff
9247fc3c64 deploy link to using litellm 2024-07-25 20:09:49 -07:00
yujonglee
a540c23730 improvements 2024-07-26 12:08:46 +09:00
Ishaan Jaff
c2e309baf3 docs using litellm proxy 2024-07-25 20:05:28 -07:00
Ishaan Jaff
646b2d50f9 docs -quick start 2024-07-25 19:52:53 -07:00
Ishaan Jaff
bb6f72b315 add mistral sdk usage 2024-07-25 19:47:54 -07:00
Krrish Dholakia
f5fd9bd3ce feat(proxy_server.py): support custom llm handler on proxy 2024-07-25 19:35:52 -07:00
Krrish Dholakia
acda75b96f docs(custom_llm_server.md): add calling custom llm server to docs 2024-07-25 19:35:48 -07:00
Ishaan Jaff
7d68536763 docs - add info about routing strategy on load balancing docs 2024-07-25 19:35:48 -07:00
Ishaan Jaff
5ff0e47f22 docs add example on using text to speech models 2024-07-25 19:35:48 -07:00
Krrish Dholakia
52648ebac6 docs(enterprise.md): cleanup docs 2024-07-25 19:35:40 -07:00
Krrish Dholakia
24ff9882ee docs(enterprise.md): cleanup docs 2024-07-25 19:35:40 -07:00
Krrish Dholakia
9ec34313b0 docs(caching.md): update caching docs to include ttl info 2024-07-25 19:35:40 -07:00
Ishaan Jaff
993920ca6c docs add mistral api large 2 2024-07-25 19:35:29 -07:00
Ishaan Jaff
910597fcfa docs groq models 2024-07-25 19:35:29 -07:00
Ishaan Jaff
af1cd9e06f docs on pass through support 2024-07-25 19:17:20 -07:00
Krish Dholakia
a306b83b2d
Merge pull request #4887 from BerriAI/litellm_custom_llm
feat(custom_llm.py): Support Custom LLM Handlers
2024-07-25 19:05:29 -07:00
Ishaan Jaff
ff0f21a1f3 docs - anthropic 2024-07-25 19:02:22 -07:00
Ishaan Jaff
26a9f694e1
Merge pull request #4890 from BerriAI/docs_set_routing_strategies
docs - add info about routing strategy on load balancing docs
2024-07-25 18:55:51 -07:00
yujonglee
78de9424a7 customize 2024-07-26 10:41:29 +09:00
yujonglee
823d20101d eject default UI
npm run swizzle @getcanary/docusaurus-pagefind SearchBar -- --eject --danger
2024-07-26 10:41:29 +09:00
yujonglee
a9a946a660 install canary (default UI) 2024-07-26 10:41:29 +09:00
Krrish Dholakia
bd7af04a72 feat(proxy_server.py): support custom llm handler on proxy 2024-07-25 17:56:34 -07:00
Krrish Dholakia
a2d07cfe64 docs(custom_llm_server.md): add calling custom llm server to docs 2024-07-25 17:41:19 -07:00
Ishaan Jaff
3814170ae1 docs - add info about routing strategy on load balancing docs 2024-07-25 17:41:16 -07:00
Ishaan Jaff
3573b47098 docs add example on using text to speech models 2024-07-25 17:29:28 -07:00
Krrish Dholakia
397451570e docs(enterprise.md): cleanup docs 2024-07-25 10:09:02 -07:00
Krrish Dholakia
d91b01a24b docs(enterprise.md): cleanup docs 2024-07-25 10:08:40 -07:00
Krrish Dholakia
80800b9ec8 docs(caching.md): update caching docs to include ttl info 2024-07-25 10:01:47 -07:00
Ishaan Jaff
a92a2ca382 docs add mistral api large 2 2024-07-24 21:35:34 -07:00
Ishaan Jaff
c08d4ca9ec docs groq models 2024-07-24 20:49:28 -07:00
Krish Dholakia
e6963217ba
Merge branch 'main' into litellm_parallel_requests 2024-07-24 19:25:56 -07:00
wslee
dd10da4d46 add support for friendli dedicated endpoint 2024-07-25 11:14:35 +09:00
Ishaan Jaff
fe0b0ddaaa doc example using litellm proxy with groq 2024-07-24 14:33:49 -07:00
Ishaan Jaff
e378ab8bc9 docs - logging langsmith tags 2024-07-24 07:12:36 -07:00
Krrish Dholakia
d5d2ffffdf bump: version 1.41.28 → 1.42.0 2024-07-23 21:54:06 -07:00
Ishaan Jaff
e9d6816011
Merge pull request #4838 from BerriAI/doc_anthropic_proxy_usage
doc - using anthropic with litellm proxy server
2024-07-23 16:38:09 -07:00
Krrish Dholakia
169da8b8d0 docs(guardrails.md): add team-based controls to guardrails 2024-07-23 15:39:21 -07:00
Krrish Dholakia
d1ffb4de5f docs(raw_request_response.md): show how to get openai headers from response 2024-07-23 11:40:26 -07:00
Ishaan Jaff
8845bd4d76 doc - using anthropic with litellm proxy server 2024-07-23 10:42:17 -07:00
Krrish Dholakia
a8c88dad64 docs(sidebar.js): add oidc to left nav 2024-07-23 10:37:06 -07:00
Krish Dholakia
5382242f4b
Merge pull request #4836 from Manouchehri/oidc-docs-1
(docs): Add OIDC doc.
2024-07-23 10:34:37 -07:00
Ishaan Jaff
2ae5a936ea docs alerting 2024-07-23 10:10:01 -07:00
Ishaan Jaff
4559970a44 docs - alert to webhook_url 2024-07-23 10:06:18 -07:00
Ishaan Jaff
c28697133f docs - slack alerting 2024-07-23 09:42:12 -07:00
Ishaan Jaff
25dc0877d9 docs Debugging / Troubleshooting 2024-07-23 09:16:53 -07:00
David Manouchehri
bce56c1356
(docs): Make it more obvious where the group name is set in the example. 2024-07-23 16:15:21 +00:00
David Manouchehri
3d390a79f3
(docs): Add OIDC doc. 2024-07-23 16:08:28 +00:00
Krrish Dholakia
0935d162f6 docs: cleanup docs 2024-07-22 22:59:00 -07:00
Krish Dholakia
e770ac48a2
Merge branch 'main' into litellm_braintrust_integration 2024-07-22 22:40:39 -07:00
Ishaan Jaff
34575293a5 docs - team logging endpoints 2024-07-22 21:30:24 -07:00
Ishaan Jaff
290628d66b
Merge pull request #4831 from BerriAI/litellm_api_control_team_logging
[Feat] - API Endpoints to control logging callbacks per Team
2024-07-22 21:22:14 -07:00
Ishaan Jaff
4465675d9a doc - team based logging 2024-07-22 21:20:13 -07:00
Ishaan Jaff
09dcf4f3bb docs - control team logging 2024-07-22 21:13:39 -07:00
Krrish Dholakia
548e4f53f8 feat(redact_messages.py): allow remove sensitive key information before passing to logging integration 2024-07-22 20:58:02 -07:00
Krrish Dholakia
99a5436ed5 feat(lakera_ai.py): control running prompt injection between pre-call and in_parallel 2024-07-22 20:04:42 -07:00
Krrish Dholakia
dd6d58d29b docs(braintrust.md): add braintrust.md to docs 2024-07-22 17:47:08 -07:00
Ishaan Jaff
d3bced56bb docs - langsmith 2024-07-22 15:17:24 -07:00
Ishaan Jaff
488aca98a1 doc arize ai 2024-07-22 14:27:45 -07:00
Ishaan Jaff
f6225623e9
Merge branch 'main' into litellm_return-response_headers 2024-07-20 19:05:56 -07:00
Ishaan Jaff
4e301658ca docs _response_headers 2024-07-20 17:32:34 -07:00
Ishaan Jaff
40ee954e8b
Merge pull request #4808 from BerriAI/litellm_Add_mistral_models
feat - add mistral `open-codestral-mamba` `open-mistral-nemo`
2024-07-20 17:23:28 -07:00
Ishaan Jaff
106ff31c4d docs - using mistral models with litellm proxy 2024-07-20 17:08:35 -07:00
Ishaan Jaff
756a5f94a7 docs add mistral models 2024-07-20 17:02:34 -07:00
Ishaan Jaff
2e9f1e8de2 docs - response headers 2024-07-20 15:19:15 -07:00
Krrish Dholakia
576cccaade fix(main.py): check for ANTHROPIC_BASE_URL in environment
Fixes https://github.com/BerriAI/litellm/issues/4803
2024-07-20 14:38:31 -07:00
Ishaan Jaff
89922ab71f docs js spend tracking with tags 2024-07-20 13:15:20 -07:00
Ishaan Jaff
b9fab4bd4d docs - using tags OpenAI JS 2024-07-20 13:02:10 -07:00
Krrish Dholakia
305e884174 docs(bedrock.md): add jamba instruct to bedrock docs 2024-07-19 21:14:34 -07:00
Ishaan Jaff
0f52870a82 docs- control cache on / off per request 2024-07-19 12:27:44 -07:00
Ishaan Jaff
9f6e280fe4
Merge pull request #4287 from BerriAI/litellm_docusaurus_fix_base_url
docs(docusaurus.config.js): fix docusaurus base url
2024-07-19 10:13:51 -07:00
Ishaan Jaff
defc341f39 docs fireworks ai 2024-07-19 10:08:48 -07:00
Ishaan Jaff
f04397e19a
Merge pull request #4789 from BerriAI/litellm_router_refactor
[Feat-Router] - Tag based routing
2024-07-18 22:19:18 -07:00
Ishaan Jaff
a4338bec11 docs - tag based routing 2024-07-18 22:18:10 -07:00
Ishaan Jaff
ab17aa3919 rename doc 2024-07-18 21:48:24 -07:00
Krish Dholakia
967964a51c
Merge branch 'main' into litellm_anthropic_response_schema_support 2024-07-18 20:40:16 -07:00
Ishaan Jaff
d266234cd6 docs using free, paid tier 2024-07-18 18:01:21 -07:00
Krrish Dholakia
6d741a5424 docs(json_mode.md): add json mode to docs 2024-07-18 17:20:19 -07:00
Ishaan Jaff
b9d4d67357
Merge pull request #4779 from BerriAI/docs_add_salt_key_docker_compose
Docs -  add `LITELLM_SALT_KEY` to docker compose
2024-07-18 15:28:26 -07:00
Ishaan Jaff
976cc3f5ea ui - fix typo on referencing base url 2024-07-18 13:36:05 -07:00
Ishaan Jaff
b38f470135 docs on litellm docker compose 2024-07-18 13:08:06 -07:00
Ishaan Jaff
972eec2b3f docs - add instructions on LITELLM_SALT_KEY 2024-07-18 13:07:02 -07:00
Ishaan Jaff
51b3ef87d3 docs litellm telemetry 2024-07-18 12:36:16 -07:00
Ishaan Jaff
b2623ed8a3 add gpt-4o-mini-2024-07-18 to docs 2024-07-18 10:43:33 -07:00
Florian Greinacher
f8bec3a86c
feat(proxy): support hiding health check details 2024-07-18 17:21:12 +02:00
Krish Dholakia
77656d9f11
Merge branch 'main' into litellm_aporio_integration 2024-07-17 22:14:29 -07:00
maamalama
9d157c50a4 Helicone headers to metadata 2024-07-17 17:06:42 -07:00
Ishaan Jaff
ee53b9093b
Merge pull request #4758 from BerriAI/litellm_langsmith_async_support
[Feat] Use Async Httpx client for langsmith logging
2024-07-17 16:54:40 -07:00
Krrish Dholakia
07d90f6739 feat(aporio_ai.py): support aporio ai prompt injection for chat completion requests
Closes https://github.com/BerriAI/litellm/issues/2950
2024-07-17 16:38:47 -07:00
Ishaan Jaff
f462e6a46c langsmith logs 2024-07-17 16:37:24 -07:00
Krrish Dholakia
e587d32058 docs(scrub_data.md): add scrub logging data tutorial to docs 2024-07-17 15:39:31 -07:00
Ishaan Jaff
3a57fef448
Merge pull request #4739 from BerriAI/litellm_custom_header_master_key
feat - use custom api key header name when using litellm virtual keys
2024-07-16 21:17:17 -07:00
Ishaan Jaff
0d729e94c0 docs - how to invite users to view usage, caching analytics 2024-07-16 17:56:06 -07:00
Ishaan Jaff
e6b6c1f631 docs how to use custom header for litellm proxy 2024-07-16 16:54:13 -07:00
Krrish Dholakia
06efe28132 docs(reliability.md): add default fallbacks to proxy docs 2024-07-16 16:33:57 -07:00
Krrish Dholakia
2783953625 docs(bedrock.md): update bedrock / proxy doc 2024-07-16 11:55:08 -07:00
Ishaan Jaff
eaee90b02e docs - passing extra_headers to anthropic api 2024-07-15 21:15:39 -07:00
Ishaan Jaff
254ac37f65
Merge pull request #4724 from BerriAI/litellm_Set_max_file_size_transc
[Feat] - set max file size on /audio/transcriptions
2024-07-15 20:42:24 -07:00
Ishaan Jaff
e1c1149a64 docs set max file size on requests 2024-07-15 20:05:14 -07:00
Ishaan Jaff
685253568b doc set max file size 2024-07-15 19:57:17 -07:00
Krrish Dholakia
9e07af6c02 docs(vertex.md): Retrieve grounding metadata from call 2024-07-15 19:47:48 -07:00
Krrish Dholakia
ff1bcdd3b5 docs(streaming_logging.md): fix example 2024-07-15 14:58:15 -07:00
Krrish Dholakia
e8e31c4029 docs(enterprise.md): cleanup docs 2024-07-15 14:52:08 -07:00
Daniel Liden
b789440854
Update streaming_logging.md
updates cost tracking code

- replace `completion_response` with `response_obj`
- add `import logging`
2024-07-15 10:21:55 -05:00
Krrish Dholakia
82ca7af6df fix(vertex_httpx.py): google search grounding fix 2024-07-14 08:06:17 -07:00
Krrish Dholakia
385da04d72 docs(vertex.md): add reference vertex ai grounding doc 2024-07-13 22:04:38 -07:00
Krrish Dholakia
fe6ea9f892 docs(user_keys.md): add openai js example to docs 2024-07-13 22:00:53 -07:00
Krish Dholakia
6bf60d773e
Merge pull request #4696 from BerriAI/litellm_guardrail_logging_only
Allow setting `logging_only` in guardrails config
2024-07-13 21:50:43 -07:00
Krrish Dholakia
a6deb9c350 docs(pass_through.md): update doc to specify key rpm limits will be enforced 2024-07-13 15:10:13 -07:00
Krrish Dholakia
f1fe229bb1 docs(guardrails.md): update guardrail api spec 2024-07-13 12:34:49 -07:00
Krrish Dholakia
9d02d51a17 docs(pass_through.md): cleanup docs 2024-07-13 09:56:06 -07:00
Krrish Dholakia
667fd2b376 docs(pass_through.md): add doc on creating custom chat endpoints on proxy
Allows developers to call proxy with anthropic sdk/boto3/etc.
2024-07-12 18:48:40 -07:00