Commit Graph

15223 Commits

Author SHA1 Message Date
Krrish Dholakia
84482703b8 docs(config.md): update wildcard docs 2024-07-26 08:59:53 -07:00
Krrish Dholakia
1d6c39a607 feat(proxy_server.py): handle pydantic mockselvar error
Fixes https://github.com/BerriAI/litellm/issues/4898#issuecomment-2252105485
2024-07-26 08:38:51 -07:00
Krish Dholakia
35737d04d3
Merge pull request #4893 from yujonglee/canary
[Docs] Better search experience with Canary
2024-07-26 08:34:54 -07:00
yujonglee
10ffb5a960 remove ui shift on reload 2024-07-26 22:13:04 +09:00
yujonglee
8a45abb563 fix import and add fallback 2024-07-26 22:00:48 +09:00
yujonglee
c54f23f936 wrap existing search bar 2024-07-26 21:46:36 +09:00
yujonglee
3967007595 update to latest 2024-07-26 21:06:53 +09:00
Krrish Dholakia
afcad9e12c docs(custom_llm_server.md): cleanup docs 2024-07-25 22:45:03 -07:00
Krrish Dholakia
ce210ddaf6 fix(vertex_ai_llama3.py): Fix llama3 streaming issue
Closes https://github.com/BerriAI/litellm/issues/4885
2024-07-25 22:30:55 -07:00
Krrish Dholakia
0ce5a7962e bump: version 1.42.2 → 1.42.3 2024-07-25 22:18:17 -07:00
Krrish Dholakia
2f773d9cb6 fix(litellm_cost_calc/google.py): support meta llama vertex ai cost tracking 2024-07-25 22:12:07 -07:00
Ishaan Jaff
2626cc6d30 bump: version 1.42.1 → 1.42.2 2024-07-25 20:16:05 -07:00
Ishaan Jaff
24fb6fc28d
Merge pull request #4891 from BerriAI/litellm_proxy_support_all_providers
[Feat] Support /* for multiple providers
2024-07-25 20:15:42 -07:00
Ishaan Jaff
079a41fbe1
Merge branch 'main' into litellm_proxy_support_all_providers 2024-07-25 20:15:37 -07:00
Ishaan Jaff
4bf9681df4
Update README.md 2024-07-25 20:12:32 -07:00
Ishaan Jaff
4d513e0b5f
Merge pull request #4897 from BerriAI/docs_add_example_using_anthropic_sdk
Docs add example using anthropic sdk with litellm proxy
2024-07-25 20:11:16 -07:00
yujonglee
b6bcb7eb3c update lock 2024-07-26 12:10:05 +09:00
Ishaan Jaff
50bf488b58 read me link to using litellm 2024-07-25 20:10:02 -07:00
Ishaan Jaff
9247fc3c64 deploy link to using litellm 2024-07-25 20:09:49 -07:00
yujonglee
a540c23730 improvements 2024-07-26 12:08:46 +09:00
Ishaan Jaff
c2e309baf3 docs using litellm proxy 2024-07-25 20:05:28 -07:00
Ishaan Jaff
87cebdefd3
Merge pull request #4896 from BerriAI/docs_add_example_usage_with_mistral_python
Docs Proxy - add example usage with mistral SDK with Proxy
2024-07-25 20:02:26 -07:00
Krrish Dholakia
826bb125e8 test(test_router.py): handle azure api instability 2024-07-25 19:54:40 -07:00
Ishaan Jaff
646b2d50f9 docs -quick start 2024-07-25 19:52:53 -07:00
Krrish Dholakia
a2fd8459fc fix(utils.py): don't raise error on openai content filter during streaming - return as is
Fixes issue where we would raise an error vs. openai who return the chunk with finish reason as 'content_filter'
2024-07-25 19:50:52 -07:00
Ishaan Jaff
68e94f0976 example mistral sdk 2024-07-25 19:48:54 -07:00
Ishaan Jaff
bb6f72b315 add mistral sdk usage 2024-07-25 19:47:54 -07:00
Ishaan Jaff
5bec2bf513
Merge pull request #4894 from BerriAI/litellm_logfire_dotenv
fix logfire - don't load_dotenv
2024-07-25 19:34:35 -07:00
Ishaan Jaff
693bcfac39 fix using pass_through_all_models 2024-07-25 19:32:49 -07:00
Krish Dholakia
53752100f6
Merge pull request #4870 from BerriAI/litellm_redis_team_object
feat(auth_check.py): support using redis cache for team objects
2024-07-25 19:32:04 -07:00
Krish Dholakia
c2086300b7
Merge branch 'main' into litellm_redis_team_object 2024-07-25 19:31:52 -07:00
Krish Dholakia
80e2facf3d
Merge pull request #4883 from Manouchehri/bedrock-llama3.1-405b
Add Llama 3.1 405b & Tool Calling for Amazon Bedrock
2024-07-25 19:29:18 -07:00
Krish Dholakia
b6ca4406b6
Merge branch 'main' into bedrock-llama3.1-405b 2024-07-25 19:29:10 -07:00
Ishaan Jaff
a0655b4192
Merge pull request #4884 from Manouchehri/add-mistral-large-2407-bedrock-1
Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock
2024-07-25 19:22:46 -07:00
Ishaan Jaff
fcd834b277 fix logfire - don't load_dotenv 2024-07-25 19:22:26 -07:00
Ishaan Jaff
af1cd9e06f docs on pass through support 2024-07-25 19:17:20 -07:00
Krish Dholakia
c0c934d9cf
Merge pull request #4879 from fracapuano/main
Add Single-Token predictions support for Replicate
2024-07-25 19:10:57 -07:00
Krish Dholakia
a306b83b2d
Merge pull request #4887 from BerriAI/litellm_custom_llm
feat(custom_llm.py): Support Custom LLM Handlers
2024-07-25 19:05:29 -07:00
Krrish Dholakia
41abd51240 fix(custom_llm.py): pass input params to custom llm 2024-07-25 19:03:52 -07:00
Ishaan Jaff
ff0f21a1f3 docs - anthropic 2024-07-25 19:02:22 -07:00
Ishaan Jaff
26a9f694e1
Merge pull request #4890 from BerriAI/docs_set_routing_strategies
docs - add info about routing strategy on load balancing docs
2024-07-25 18:55:51 -07:00
Ishaan Jaff
05858cb249 test proxy all model 2024-07-25 18:54:30 -07:00
Ishaan Jaff
b497dbf0dd
Merge pull request #4889 from BerriAI/litellm_Fix_whisper_health_check
[Fix] OpenAI STT, TTS Health Checks on LiteLLM Proxy
2024-07-25 18:53:39 -07:00
Ishaan Jaff
9863520376 support using */* 2024-07-25 18:48:56 -07:00
yujonglee
78de9424a7 customize 2024-07-26 10:41:29 +09:00
yujonglee
823d20101d eject default UI
npm run swizzle @getcanary/docusaurus-pagefind SearchBar -- --eject --danger
2024-07-26 10:41:29 +09:00
yujonglee
a9a946a660 install canary (default UI) 2024-07-26 10:41:29 +09:00
Ishaan Jaff
35203cede7 add ANTHROPIC_API_KEY on build and test 2024-07-25 18:40:04 -07:00
Ishaan Jaff
8f4c5437b8 router support setting pass_through_all_models 2024-07-25 18:34:12 -07:00
Ishaan Jaff
e67daf79be router support setting pass_through_all_models 2024-07-25 18:22:35 -07:00