ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
30,881 Commits 9 Branches 7 Tags 935 MiB
12bc66aa5b
Commit Graph

30881 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Krrish Dholakia
9943c6d607 fix(proxy_server.py): fix get secret for environment_variables 2024-07-26 13:33:02 -07:00
Krrish Dholakia
b515d4f441 docs(stream.md): add streaming token usage info to docs 
Closes https://github.com/BerriAI/litellm/issues/4904
 2024-07-26 10:51:17 -07:00
Krrish Dholakia
9a6ed8cabb fix(bedrock_httpx.py): fix streaming error message 
Fixes https://github.com/BerriAI/litellm/issues/4900
 2024-07-26 10:42:47 -07:00
Krish Dholakia
67115a56c0
Merge pull request #4869 from maamalama/anthropic-tools 
Fixed tool_call for Helicone integration
 2024-07-26 10:42:10 -07:00
Krrish Dholakia
7ca29d987d docs(docusaurus.config.js): add llm model cost map to docs 2024-07-26 10:07:47 -07:00
Krrish Dholakia
84482703b8 docs(config.md): update wildcard docs 2024-07-26 08:59:53 -07:00
Krrish Dholakia
1d6c39a607 feat(proxy_server.py): handle pydantic mockselvar error 
Fixes https://github.com/BerriAI/litellm/issues/4898#issuecomment-2252105485
 2024-07-26 08:38:51 -07:00
Krish Dholakia
35737d04d3
Merge pull request #4893 from yujonglee/canary 
[Docs] Better search experience with Canary
 2024-07-26 08:34:54 -07:00
yujonglee
10ffb5a960 remove ui shift on reload 2024-07-26 22:13:04 +09:00
yujonglee
8a45abb563 fix import and add fallback 2024-07-26 22:00:48 +09:00
yujonglee
c54f23f936 wrap existing search bar 2024-07-26 21:46:36 +09:00
yujonglee
3967007595 update to latest 2024-07-26 21:06:53 +09:00
Krrish Dholakia
afcad9e12c docs(custom_llm_server.md): cleanup docs 2024-07-25 22:45:03 -07:00
Krrish Dholakia
ce210ddaf6 fix(vertex_ai_llama3.py): Fix llama3 streaming issue 
Closes https://github.com/BerriAI/litellm/issues/4885
 2024-07-25 22:30:55 -07:00
Krrish Dholakia
0ce5a7962e bump: version 1.42.2 → 1.42.3 2024-07-25 22:18:17 -07:00
Krrish Dholakia
2f773d9cb6 fix(litellm_cost_calc/google.py): support meta llama vertex ai cost tracking 2024-07-25 22:12:07 -07:00
Ishaan Jaff
2626cc6d30 bump: version 1.42.1 → 1.42.2 2024-07-25 20:16:05 -07:00
Ishaan Jaff
24fb6fc28d
Merge pull request #4891 from BerriAI/litellm_proxy_support_all_providers 
[Feat] Support /* for multiple providers
 2024-07-25 20:15:42 -07:00
Ishaan Jaff
079a41fbe1
Merge branch 'main' into litellm_proxy_support_all_providers 2024-07-25 20:15:37 -07:00
Ishaan Jaff
4bf9681df4
Update README.md 2024-07-25 20:12:32 -07:00
Ishaan Jaff
4d513e0b5f
Merge pull request #4897 from BerriAI/docs_add_example_using_anthropic_sdk 
Docs add example using anthropic sdk with litellm proxy
 2024-07-25 20:11:16 -07:00
yujonglee
b6bcb7eb3c update lock 2024-07-26 12:10:05 +09:00
Ishaan Jaff
50bf488b58 read me link to using litellm 2024-07-25 20:10:02 -07:00
Ishaan Jaff
9247fc3c64 deploy link to using litellm 2024-07-25 20:09:49 -07:00
yujonglee
a540c23730 improvements 2024-07-26 12:08:46 +09:00
Ishaan Jaff
c2e309baf3 docs using litellm proxy 2024-07-25 20:05:28 -07:00
Ishaan Jaff
87cebdefd3
Merge pull request #4896 from BerriAI/docs_add_example_usage_with_mistral_python 
Docs Proxy - add example usage with mistral SDK with Proxy
 2024-07-25 20:02:26 -07:00
Krrish Dholakia
826bb125e8 test(test_router.py): handle azure api instability 2024-07-25 19:54:40 -07:00
Ishaan Jaff
646b2d50f9 docs -quick start 2024-07-25 19:52:53 -07:00
Krrish Dholakia
a2fd8459fc fix(utils.py): don't raise error on openai content filter during streaming - return as is 
Fixes issue where we would raise an error vs. openai who return the chunk with finish reason as 'content_filter'
 2024-07-25 19:50:52 -07:00
Ishaan Jaff
68e94f0976 example mistral sdk 2024-07-25 19:48:54 -07:00
Ishaan Jaff
bb6f72b315 add mistral sdk usage 2024-07-25 19:47:54 -07:00
David Manouchehri
533426e876 Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock. 2024-07-25 19:36:18 -07:00
fracapuano
c86f8e1eb4 fix: now supports single tokens prediction 2024-07-25 19:35:52 -07:00
Krrish Dholakia
a190bc750f fix(custom_llm.py): pass input params to custom llm 2024-07-25 19:35:52 -07:00
Krrish Dholakia
f5fd9bd3ce feat(proxy_server.py): support custom llm handler on proxy 2024-07-25 19:35:52 -07:00
Krrish Dholakia
acda75b96f docs(custom_llm_server.md): add calling custom llm server to docs 2024-07-25 19:35:48 -07:00
Krrish Dholakia
3b8f357af4 feat(utils.py): support async streaming for custom llm provider 2024-07-25 19:35:48 -07:00
Krrish Dholakia
8c12f7f820 feat(utils.py): support sync streaming for custom llm provider 2024-07-25 19:35:48 -07:00
Krrish Dholakia
7a5c1e7599 fix(custom_llm.py): support async completion calls 2024-07-25 19:35:48 -07:00
Krrish Dholakia
b9b0612c79 feat(custom_llm.py): initial working commit for writing your own custom LLM handler 
Fixes https://github.com/BerriAI/litellm/issues/4675

 Also Addresses https://github.com/BerriAI/litellm/discussions/4677
 2024-07-25 19:35:48 -07:00
Ishaan Jaff
7d68536763 docs - add info about routing strategy on load balancing docs 2024-07-25 19:35:48 -07:00
Ishaan Jaff
fe3c57e1c1 feat support audio health checks for azure 2024-07-25 19:35:48 -07:00
Ishaan Jaff
5ff0e47f22 docs add example on using text to speech models 2024-07-25 19:35:48 -07:00
Ishaan Jaff
1a89f9e86d feat - support health check audio_speech 2024-07-25 19:35:48 -07:00
Ishaan Jaff
734d0c3643 fix whisper health check with litellm 2024-07-25 19:35:48 -07:00
Krrish Dholakia
c23cf1ecc5 fix(router.py): add support for diskcache to router 2024-07-25 19:35:48 -07:00
Krrish Dholakia
a5ecf6b1c1 fix(proxy_server.py): check if input list > 0 before indexing into it 
resolves 'list index out of range' error
 2024-07-25 19:35:48 -07:00
David Manouchehri
fb1a805959 Check for converse support first. 2024-07-25 19:35:40 -07:00
David Manouchehri
2dd30d59ae Support tool calling for Llama 3.1 on Amazon bedrock. 2024-07-25 19:35:40 -07:00