ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
23,118 Commits 9 Branches 7 Tags 935 MiB
4b3b4f8dff
Commit Graph

23118 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ishaan Jaff
5bec2bf513
Merge pull request #4894 from BerriAI/litellm_logfire_dotenv 
fix logfire - don't load_dotenv
 2024-07-25 19:34:35 -07:00
Ishaan Jaff
693bcfac39 fix using pass_through_all_models 2024-07-25 19:32:49 -07:00
Krish Dholakia
53752100f6
Merge pull request #4870 from BerriAI/litellm_redis_team_object 
feat(auth_check.py): support using redis cache for team objects
 2024-07-25 19:32:04 -07:00
Krish Dholakia
c2086300b7
Merge branch 'main' into litellm_redis_team_object 2024-07-25 19:31:52 -07:00
Krish Dholakia
80e2facf3d
Merge pull request #4883 from Manouchehri/bedrock-llama3.1-405b 
Add Llama 3.1 405b & Tool Calling for Amazon Bedrock
 2024-07-25 19:29:18 -07:00
Krish Dholakia
b6ca4406b6
Merge branch 'main' into bedrock-llama3.1-405b 2024-07-25 19:29:10 -07:00
Ishaan Jaff
a0655b4192
Merge pull request #4884 from Manouchehri/add-mistral-large-2407-bedrock-1 
Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock
 2024-07-25 19:22:46 -07:00
Ishaan Jaff
fcd834b277 fix logfire - don't load_dotenv 2024-07-25 19:22:26 -07:00
Ishaan Jaff
af1cd9e06f docs on pass through support 2024-07-25 19:17:20 -07:00
Krish Dholakia
c0c934d9cf
Merge pull request #4879 from fracapuano/main 
Add Single-Token predictions support for Replicate
 2024-07-25 19:10:57 -07:00
Krish Dholakia
a306b83b2d
Merge pull request #4887 from BerriAI/litellm_custom_llm 
feat(custom_llm.py): Support Custom LLM Handlers
 2024-07-25 19:05:29 -07:00
Krrish Dholakia
41abd51240 fix(custom_llm.py): pass input params to custom llm 2024-07-25 19:03:52 -07:00
Ishaan Jaff
ff0f21a1f3 docs - anthropic 2024-07-25 19:02:22 -07:00
Ishaan Jaff
26a9f694e1
Merge pull request #4890 from BerriAI/docs_set_routing_strategies 
docs - add info about routing strategy on load balancing docs
 2024-07-25 18:55:51 -07:00
Ishaan Jaff
05858cb249 test proxy all model 2024-07-25 18:54:30 -07:00
Ishaan Jaff
b497dbf0dd
Merge pull request #4889 from BerriAI/litellm_Fix_whisper_health_check 
[Fix] OpenAI STT, TTS Health Checks on LiteLLM Proxy
 2024-07-25 18:53:39 -07:00
Ishaan Jaff
9863520376 support using */* 2024-07-25 18:48:56 -07:00
yujonglee
78de9424a7 customize 2024-07-26 10:41:29 +09:00
yujonglee
823d20101d eject default UI 
npm run swizzle @getcanary/docusaurus-pagefind SearchBar -- --eject --danger
 2024-07-26 10:41:29 +09:00
yujonglee
a9a946a660 install canary (default UI) 2024-07-26 10:41:29 +09:00
Ishaan Jaff
35203cede7 add ANTHROPIC_API_KEY on build and test 2024-07-25 18:40:04 -07:00
Ishaan Jaff
8f4c5437b8 router support setting pass_through_all_models 2024-07-25 18:34:12 -07:00
Ishaan Jaff
e67daf79be router support setting pass_through_all_models 2024-07-25 18:22:35 -07:00
Krrish Dholakia
bd7af04a72 feat(proxy_server.py): support custom llm handler on proxy 2024-07-25 17:56:34 -07:00
Krrish Dholakia
a2d07cfe64 docs(custom_llm_server.md): add calling custom llm server to docs 2024-07-25 17:41:19 -07:00
Ishaan Jaff
3814170ae1 docs - add info about routing strategy on load balancing docs 2024-07-25 17:41:16 -07:00
Ishaan Jaff
f2443996d8 feat support audio health checks for azure 2024-07-25 17:30:15 -07:00
Ishaan Jaff
3573b47098 docs add example on using text to speech models 2024-07-25 17:29:28 -07:00
Ishaan Jaff
2432c90515 feat - support health check audio_speech 2024-07-25 17:26:14 -07:00
Ishaan Jaff
e3142b4294 fix whisper health check with litellm 2024-07-25 17:22:57 -07:00
Krrish Dholakia
060249c7e0 feat(utils.py): support async streaming for custom llm provider 2024-07-25 17:11:57 -07:00
Krrish Dholakia
b4e3a77ad0 feat(utils.py): support sync streaming for custom llm provider 2024-07-25 16:47:32 -07:00
Krrish Dholakia
9f97436308 fix(custom_llm.py): support async completion calls 2024-07-25 15:51:39 -07:00
Krrish Dholakia
6bf1b9353b feat(custom_llm.py): initial working commit for writing your own custom LLM handler 
Fixes https://github.com/BerriAI/litellm/issues/4675

 Also Addresses https://github.com/BerriAI/litellm/discussions/4677
 2024-07-25 15:33:05 -07:00
Krrish Dholakia
711496e260 fix(router.py): add support for diskcache to router 2024-07-25 14:30:46 -07:00
Krrish Dholakia
bfdda089c8 fix(proxy_server.py): check if input list > 0 before indexing into it 
resolves 'list index out of range' error
 2024-07-25 14:23:07 -07:00
David Manouchehri
64adae6e7f
Check for converse support first. 2024-07-25 21:16:23 +00:00
David Manouchehri
22c66991ed
Support tool calling for Llama 3.1 on Amazon bedrock. 2024-07-25 20:36:25 +00:00
David Manouchehri
5c4ee3ef3c
Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock. 2024-07-25 20:04:03 +00:00
David Manouchehri
3293ad7458
Add Llama 3.1 405b for Bedrock 2024-07-25 19:30:13 +00:00
maamalama
a3e4e4d412 anthropic gateway fixes 2024-07-25 11:37:29 -07:00
Krrish Dholakia
397451570e docs(enterprise.md): cleanup docs 2024-07-25 10:09:02 -07:00
Krrish Dholakia
d91b01a24b docs(enterprise.md): cleanup docs 2024-07-25 10:08:40 -07:00
fracapuano
5553f84d51 fix: now supports single tokens prediction 2024-07-25 19:06:07 +02:00
Krrish Dholakia
80800b9ec8 docs(caching.md): update caching docs to include ttl info 2024-07-25 10:01:47 -07:00
Krrish Dholakia
4e51f712f3 fix(main.py): fix calling openai gpt-3.5-turbo-instruct via /completions 
Fixes https://github.com/BerriAI/litellm/issues/749
 2024-07-25 09:57:19 -07:00
Krrish Dholakia
b376ee71b0 fix(internal_user_endpoints.py): support updating budgets for /user/update 2024-07-24 21:51:46 -07:00
Ishaan Jaff
5cb58fc3c9
Merge pull request #4873 from BerriAI/litellm_add_mistral-large-2407 
[Feat] -  Add `mistral/mistral-large 2`
 2024-07-24 21:37:08 -07:00
Ishaan Jaff
a92a2ca382 docs add mistral api large 2 2024-07-24 21:35:34 -07:00
Ishaan Jaff
c77abaa07f feat - add mistral large 2 2024-07-24 21:31:41 -07:00