Krrish Dholakia
|
ce210ddaf6
|
fix(vertex_ai_llama3.py): Fix llama3 streaming issue
Closes https://github.com/BerriAI/litellm/issues/4885
|
2024-07-25 22:30:55 -07:00 |
|
Krrish Dholakia
|
0ce5a7962e
|
bump: version 1.42.2 → 1.42.3
|
2024-07-25 22:18:17 -07:00 |
|
Krrish Dholakia
|
2f773d9cb6
|
fix(litellm_cost_calc/google.py): support meta llama vertex ai cost tracking
|
2024-07-25 22:12:07 -07:00 |
|
Ishaan Jaff
|
2626cc6d30
|
bump: version 1.42.1 → 1.42.2
|
2024-07-25 20:16:05 -07:00 |
|
Ishaan Jaff
|
24fb6fc28d
|
Merge pull request #4891 from BerriAI/litellm_proxy_support_all_providers
[Feat] Support /* for multiple providers
|
2024-07-25 20:15:42 -07:00 |
|
Ishaan Jaff
|
079a41fbe1
|
Merge branch 'main' into litellm_proxy_support_all_providers
|
2024-07-25 20:15:37 -07:00 |
|
Ishaan Jaff
|
4bf9681df4
|
Update README.md
|
2024-07-25 20:12:32 -07:00 |
|
Ishaan Jaff
|
4d513e0b5f
|
Merge pull request #4897 from BerriAI/docs_add_example_using_anthropic_sdk
Docs add example using anthropic sdk with litellm proxy
|
2024-07-25 20:11:16 -07:00 |
|
yujonglee
|
b6bcb7eb3c
|
update lock
|
2024-07-26 12:10:05 +09:00 |
|
Ishaan Jaff
|
50bf488b58
|
read me link to using litellm
|
2024-07-25 20:10:02 -07:00 |
|
Ishaan Jaff
|
9247fc3c64
|
deploy link to using litellm
|
2024-07-25 20:09:49 -07:00 |
|
yujonglee
|
a540c23730
|
improvements
|
2024-07-26 12:08:46 +09:00 |
|
Ishaan Jaff
|
c2e309baf3
|
docs using litellm proxy
|
2024-07-25 20:05:28 -07:00 |
|
Ishaan Jaff
|
87cebdefd3
|
Merge pull request #4896 from BerriAI/docs_add_example_usage_with_mistral_python
Docs Proxy - add example usage with mistral SDK with Proxy
|
2024-07-25 20:02:26 -07:00 |
|
Krrish Dholakia
|
826bb125e8
|
test(test_router.py): handle azure api instability
|
2024-07-25 19:54:40 -07:00 |
|
Ishaan Jaff
|
646b2d50f9
|
docs -quick start
|
2024-07-25 19:52:53 -07:00 |
|
Krrish Dholakia
|
a2fd8459fc
|
fix(utils.py): don't raise error on openai content filter during streaming - return as is
Fixes issue where we would raise an error vs. openai who return the chunk with finish reason as 'content_filter'
|
2024-07-25 19:50:52 -07:00 |
|
Ishaan Jaff
|
68e94f0976
|
example mistral sdk
|
2024-07-25 19:48:54 -07:00 |
|
Ishaan Jaff
|
bb6f72b315
|
add mistral sdk usage
|
2024-07-25 19:47:54 -07:00 |
|
David Manouchehri
|
533426e876
|
Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock.
|
2024-07-25 19:36:18 -07:00 |
|
fracapuano
|
c86f8e1eb4
|
fix: now supports single tokens prediction
|
2024-07-25 19:35:52 -07:00 |
|
Krrish Dholakia
|
a190bc750f
|
fix(custom_llm.py): pass input params to custom llm
|
2024-07-25 19:35:52 -07:00 |
|
Krrish Dholakia
|
f5fd9bd3ce
|
feat(proxy_server.py): support custom llm handler on proxy
|
2024-07-25 19:35:52 -07:00 |
|
Krrish Dholakia
|
acda75b96f
|
docs(custom_llm_server.md): add calling custom llm server to docs
|
2024-07-25 19:35:48 -07:00 |
|
Krrish Dholakia
|
3b8f357af4
|
feat(utils.py): support async streaming for custom llm provider
|
2024-07-25 19:35:48 -07:00 |
|
Krrish Dholakia
|
8c12f7f820
|
feat(utils.py): support sync streaming for custom llm provider
|
2024-07-25 19:35:48 -07:00 |
|
Krrish Dholakia
|
7a5c1e7599
|
fix(custom_llm.py): support async completion calls
|
2024-07-25 19:35:48 -07:00 |
|
Krrish Dholakia
|
b9b0612c79
|
feat(custom_llm.py): initial working commit for writing your own custom LLM handler
Fixes https://github.com/BerriAI/litellm/issues/4675
Also Addresses https://github.com/BerriAI/litellm/discussions/4677
|
2024-07-25 19:35:48 -07:00 |
|
Ishaan Jaff
|
7d68536763
|
docs - add info about routing strategy on load balancing docs
|
2024-07-25 19:35:48 -07:00 |
|
Ishaan Jaff
|
fe3c57e1c1
|
feat support audio health checks for azure
|
2024-07-25 19:35:48 -07:00 |
|
Ishaan Jaff
|
5ff0e47f22
|
docs add example on using text to speech models
|
2024-07-25 19:35:48 -07:00 |
|
Ishaan Jaff
|
1a89f9e86d
|
feat - support health check audio_speech
|
2024-07-25 19:35:48 -07:00 |
|
Ishaan Jaff
|
734d0c3643
|
fix whisper health check with litellm
|
2024-07-25 19:35:48 -07:00 |
|
Krrish Dholakia
|
c23cf1ecc5
|
fix(router.py): add support for diskcache to router
|
2024-07-25 19:35:48 -07:00 |
|
Krrish Dholakia
|
a5ecf6b1c1
|
fix(proxy_server.py): check if input list > 0 before indexing into it
resolves 'list index out of range' error
|
2024-07-25 19:35:48 -07:00 |
|
David Manouchehri
|
fb1a805959
|
Check for converse support first.
|
2024-07-25 19:35:40 -07:00 |
|
David Manouchehri
|
2dd30d59ae
|
Support tool calling for Llama 3.1 on Amazon bedrock.
|
2024-07-25 19:35:40 -07:00 |
|
David Manouchehri
|
35776d7e73
|
Add Llama 3.1 405b for Bedrock
|
2024-07-25 19:35:40 -07:00 |
|
Krrish Dholakia
|
52648ebac6
|
docs(enterprise.md): cleanup docs
|
2024-07-25 19:35:40 -07:00 |
|
Krrish Dholakia
|
24ff9882ee
|
docs(enterprise.md): cleanup docs
|
2024-07-25 19:35:40 -07:00 |
|
Krrish Dholakia
|
9ec34313b0
|
docs(caching.md): update caching docs to include ttl info
|
2024-07-25 19:35:40 -07:00 |
|
Krrish Dholakia
|
86973d6aca
|
fix(main.py): fix calling openai gpt-3.5-turbo-instruct via /completions
Fixes https://github.com/BerriAI/litellm/issues/749
|
2024-07-25 19:35:40 -07:00 |
|
Krrish Dholakia
|
9955b1b486
|
fix(internal_user_endpoints.py): support updating budgets for /user/update
|
2024-07-25 19:35:29 -07:00 |
|
Ishaan Jaff
|
993920ca6c
|
docs add mistral api large 2
|
2024-07-25 19:35:29 -07:00 |
|
Ishaan Jaff
|
53075030ff
|
feat - add mistral large 2
|
2024-07-25 19:35:29 -07:00 |
|
Ishaan Jaff
|
bb44d69152
|
bump: version 1.42.0 → 1.42.1
|
2024-07-25 19:35:29 -07:00 |
|
Ishaan Jaff
|
910597fcfa
|
docs groq models
|
2024-07-25 19:35:29 -07:00 |
|
Ishaan Jaff
|
6579095124
|
feat - add groq/llama-3.1
|
2024-07-25 19:35:29 -07:00 |
|
Krrish Dholakia
|
11cdb79fc0
|
test: cleanup testing
|
2024-07-25 19:35:29 -07:00 |
|
Krrish Dholakia
|
2c71f6dd04
|
feat(auth_check.py): support using redis cache for team objects
Allows team update / check logic to work across instances instantly
|
2024-07-25 19:35:29 -07:00 |
|