ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
30,881 Commits 9 Branches 7 Tags 935 MiB
12bc66aa5b
Commit Graph

30881 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
pat-cohere
972df1f303
Update cohere_chat.py 2024-07-29 17:26:07 -04:00
David Leen
ebca13b2ca fixes: #4947 Bedrock context exception does not have a response 2024-07-29 14:23:56 -07:00
pat-cohere
1ee8051c7c
Update cohere_chat.py 
Add chat history to cohere chat call that was previously being dropped.
 2024-07-29 17:23:04 -04:00
Ishaan Jaff
21963e0bbe proxy server 2024-07-29 14:22:02 -07:00
Ishaan Jaff
7cac1b0dce docs - Bedrock Guardrails 2024-07-29 14:18:42 -07:00
Ishaan Jaff
46555ab78b test - bedrock guardrailConfig 2024-07-29 14:13:08 -07:00
Ishaan Jaff
5154ec51a3 feat - support guardrailConfig 2024-07-29 14:10:09 -07:00
Ishaan Jaff
3eaa1fa217 types add GuardrailConfigBlock 2024-07-29 13:14:53 -07:00
Krrish Dholakia
ae4bcd8a41 fix(utils.py): fix trim_messages to handle tool calling 
Fixes https://github.com/BerriAI/litellm/issues/4931
 2024-07-29 13:04:41 -07:00
Krrish Dholakia
dd2d61bfce build(pre-commit.yaml): update 2024-07-29 12:29:56 -07:00
Krrish Dholakia
59384c84a5 fix(utils.py): correctly re-raise azure api connection error 
'
 2024-07-29 12:28:25 -07:00
Krish Dholakia
63531a9824
Merge pull request #4943 from dleen/logs 
Fix: #4942. Remove verbose logging when exception can be handled
 2024-07-29 12:12:28 -07:00
David Leen
452441ae03 Fix: #4942. Remove verbose logging when exception can be handled 2024-07-29 12:05:10 -07:00
Krrish Dholakia
66dbd938e8 fix(exceptions.py): use correct status code for content policy exceptions 
Fixes https://github.com/BerriAI/litellm/issues/4941#issuecomment-2256578732
 2024-07-29 12:01:54 -07:00
Krrish Dholakia
52b1ca292c fix(utils.py): check if tools is iterable before indexing into it 
Fixes https://github.com/BerriAI/litellm/issues/4933
 2024-07-29 09:01:32 -07:00
Ishaan Jaff
a2939c2f08
Merge pull request #4939 from BerriAI/litellm_log_transcription_resp_langfuse 
[Feat-Proxy] - Langfuse log /audio/transcription on langfuse
 2024-07-29 08:58:40 -07:00
Ishaan Jaff
285925e10a log output from /audio on langfuse 2024-07-29 08:21:22 -07:00
Krrish Dholakia
31445ab20a fix(caching.py): support /completion caching by default 
updates supported call types in redis cache to cover text_completion caching
 2024-07-29 08:19:30 -07:00
Ishaan Jaff
ec28e8e630 test - logging litellm-atranscription 2024-07-29 08:17:19 -07:00
Ishaan Jaff
95f063f978 fix default input/output values for /audio/trancription logging 2024-07-29 08:03:08 -07:00
Ishaan Jaff
b2fcf65653 log file_size_in_mb in metadata 2024-07-29 08:00:28 -07:00
Krrish Dholakia
92b539b42a fix(auth_checks.py): handle writing team object to redis caching correctly 2024-07-29 07:51:44 -07:00
Ravi N
b321f2988b Allow zero temperature for Sagemaker models based on config 
Since Sagemaker can host any kind of model, some models allow
zero temperature. However, this is not enabled by default and
only allowed based on config
 2024-07-28 21:55:53 -04:00
Krrish Dholakia
21eea28723 docs(vertex.md): add mistral api to docs 2024-07-27 22:44:15 -07:00
Krish Dholakia
442667434a
Merge pull request #4929 from BerriAI/litellm_vertex_mistral_cost_tracking 
Support vertex mistral cost tracking
 2024-07-27 22:38:33 -07:00
Krrish Dholakia
e0f3cd580c fix(factory.py): support mistral ai prefix:true in messages 
Fixes https://github.com/BerriAI/litellm/issues/4882
 2024-07-27 22:30:40 -07:00
Krrish Dholakia
1ac42d8464 fix: utils.py 
fix supported openai params
 2024-07-27 22:03:40 -07:00
Krish Dholakia
e3a94ac013
Merge pull request #4925 from BerriAI/litellm_vertex_mistral 
feat(vertex_ai_partner.py): Vertex AI Mistral Support
 2024-07-27 21:51:26 -07:00
Krish Dholakia
b854d2100c
Merge branch 'main' into litellm_vertex_migration 2024-07-27 20:25:12 -07:00
Krrish Dholakia
6d5aedc48d feat(databricks.py): support vertex mistral cost tracking 2024-07-27 20:22:35 -07:00
Ishaan Jaff
0627468455 fix checking mode on health checks 2024-07-27 20:21:39 -07:00
Ishaan Jaff
9b69e500e5
Merge pull request #4927 from BerriAI/litellm_set_max_request_response_size_ui 
Feat Enterprise -  set max request  / response size UI
 2024-07-27 20:06:09 -07:00
Ishaan Jaff
10e70f842d
Merge pull request #4928 from BerriAI/litellm_check_response_size 
[Feat Enterprise] - check max response size
 2024-07-27 17:03:56 -07:00
Ishaan Jaff
b2f745f0e2
Merge pull request #4926 from BerriAI/litellm_check_max_request_size 
Proxy Enterprise - security - check max request size
 2024-07-27 17:02:12 -07:00
Ishaan Jaff
3511aadf99 allow setting max request / response size on admin UI 2024-07-27 17:00:39 -07:00
Ishaan Jaff
f633f7d92d set max_response_size_mb 2024-07-27 16:54:31 -07:00
Ishaan Jaff
b2f72338f6 feat check check_response_size_is_safe 2024-07-27 16:53:39 -07:00
Ishaan Jaff
41ca6fd52a feat - check max response size 2024-07-27 16:53:00 -07:00
Krrish Dholakia
6f9c29d39b fix(databricks.py): handle DONE chunk from databricks 2024-07-27 16:51:45 -07:00
Krish Dholakia
9efebc490d
Merge pull request #4730 from danielbichuetti/fireworks-fix-cost-map 
[Feature]: Allow using custom and on-demand models in Fireworks AI + update data to model_prices_and_context_window.json
 2024-07-27 16:43:48 -07:00
Krish Dholakia
f9eca63433
Merge pull request #4919 from yujonglee/fix-canary-dev 
Fix Canary error with `docusaurus start`
 2024-07-27 16:42:49 -07:00
Krrish Dholakia
a7785c624b docs(user_keys.md): improve openai migration docs 2024-07-27 16:29:06 -07:00
Ishaan Jaff
15d488c25c docs set max_request_size 2024-07-27 16:25:57 -07:00
Krrish Dholakia
c5ee6fe4b9 build: cookbook on migrating to litellm proxy from openai/azure sdk 2024-07-27 16:09:50 -07:00
Ishaan Jaff
4ab8d2229d security - check max request size 2024-07-27 16:08:41 -07:00
Ishaan Jaff
2e9fb5ca1f
Merge pull request #4924 from BerriAI/litellm_log_writing_spend_to_db_otel 
[Feat] - log writing BatchSpendUpdate events on OTEL
 2024-07-27 16:07:56 -07:00
Krrish Dholakia
d1989b6063 fix(utils.py): support fireworks ai finetuned models 
Fixes https://github.com/BerriAI/litellm/issues/4923
 2024-07-27 15:38:27 -07:00
Krrish Dholakia
f76cad210c fix(utils.py): support fireworks ai finetuned models 
Fixes https://github.com/BerriAI/litellm/issues/4923
 2024-07-27 15:37:28 -07:00
Krrish Dholakia
c85ed01756 feat(utils.py): fix openai-like streaming 2024-07-27 15:32:57 -07:00
Ishaan Jaff
35ecf3c06b fix otel test 2024-07-27 15:30:58 -07:00