ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
23,118 Commits 9 Branches 7 Tags 935 MiB
4b3b4f8dff
Commit Graph

23118 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Krrish Dholakia
66dbd938e8 fix(exceptions.py): use correct status code for content policy exceptions 
Fixes https://github.com/BerriAI/litellm/issues/4941#issuecomment-2256578732
 2024-07-29 12:01:54 -07:00
Krrish Dholakia
52b1ca292c fix(utils.py): check if tools is iterable before indexing into it 
Fixes https://github.com/BerriAI/litellm/issues/4933
 2024-07-29 09:01:32 -07:00
Ishaan Jaff
a2939c2f08
Merge pull request #4939 from BerriAI/litellm_log_transcription_resp_langfuse 
[Feat-Proxy] - Langfuse log /audio/transcription on langfuse
 2024-07-29 08:58:40 -07:00
Ishaan Jaff
285925e10a log output from /audio on langfuse 2024-07-29 08:21:22 -07:00
Krrish Dholakia
31445ab20a fix(caching.py): support /completion caching by default 
updates supported call types in redis cache to cover text_completion caching
 2024-07-29 08:19:30 -07:00
Ishaan Jaff
ec28e8e630 test - logging litellm-atranscription 2024-07-29 08:17:19 -07:00
Ishaan Jaff
95f063f978 fix default input/output values for /audio/trancription logging 2024-07-29 08:03:08 -07:00
Ishaan Jaff
b2fcf65653 log file_size_in_mb in metadata 2024-07-29 08:00:28 -07:00
Krrish Dholakia
92b539b42a fix(auth_checks.py): handle writing team object to redis caching correctly 2024-07-29 07:51:44 -07:00
Ravi N
b321f2988b Allow zero temperature for Sagemaker models based on config 
Since Sagemaker can host any kind of model, some models allow
zero temperature. However, this is not enabled by default and
only allowed based on config
 2024-07-28 21:55:53 -04:00
Krrish Dholakia
21eea28723 docs(vertex.md): add mistral api to docs 2024-07-27 22:44:15 -07:00
Krish Dholakia
442667434a
Merge pull request #4929 from BerriAI/litellm_vertex_mistral_cost_tracking 
Support vertex mistral cost tracking
 2024-07-27 22:38:33 -07:00
Krrish Dholakia
e0f3cd580c fix(factory.py): support mistral ai prefix:true in messages 
Fixes https://github.com/BerriAI/litellm/issues/4882
 2024-07-27 22:30:40 -07:00
Krrish Dholakia
1ac42d8464 fix: utils.py 
fix supported openai params
 2024-07-27 22:03:40 -07:00
Krish Dholakia
e3a94ac013
Merge pull request #4925 from BerriAI/litellm_vertex_mistral 
feat(vertex_ai_partner.py): Vertex AI Mistral Support
 2024-07-27 21:51:26 -07:00
Krish Dholakia
b854d2100c
Merge branch 'main' into litellm_vertex_migration 2024-07-27 20:25:12 -07:00
Krrish Dholakia
6d5aedc48d feat(databricks.py): support vertex mistral cost tracking 2024-07-27 20:22:35 -07:00
Ishaan Jaff
0627468455 fix checking mode on health checks 2024-07-27 20:21:39 -07:00
Ishaan Jaff
9b69e500e5
Merge pull request #4927 from BerriAI/litellm_set_max_request_response_size_ui 
Feat Enterprise -  set max request  / response size UI
 2024-07-27 20:06:09 -07:00
Ishaan Jaff
10e70f842d
Merge pull request #4928 from BerriAI/litellm_check_response_size 
[Feat Enterprise] - check max response size
 2024-07-27 17:03:56 -07:00
Ishaan Jaff
b2f745f0e2
Merge pull request #4926 from BerriAI/litellm_check_max_request_size 
Proxy Enterprise - security - check max request size
 2024-07-27 17:02:12 -07:00
Ishaan Jaff
3511aadf99 allow setting max request / response size on admin UI 2024-07-27 17:00:39 -07:00
Ishaan Jaff
f633f7d92d set max_response_size_mb 2024-07-27 16:54:31 -07:00
Ishaan Jaff
b2f72338f6 feat check check_response_size_is_safe 2024-07-27 16:53:39 -07:00
Ishaan Jaff
41ca6fd52a feat - check max response size 2024-07-27 16:53:00 -07:00
Krrish Dholakia
6f9c29d39b fix(databricks.py): handle DONE chunk from databricks 2024-07-27 16:51:45 -07:00
Krish Dholakia
9efebc490d
Merge pull request #4730 from danielbichuetti/fireworks-fix-cost-map 
[Feature]: Allow using custom and on-demand models in Fireworks AI + update data to model_prices_and_context_window.json
 2024-07-27 16:43:48 -07:00
Krish Dholakia
f9eca63433
Merge pull request #4919 from yujonglee/fix-canary-dev 
Fix Canary error with `docusaurus start`
 2024-07-27 16:42:49 -07:00
Krrish Dholakia
a7785c624b docs(user_keys.md): improve openai migration docs 2024-07-27 16:29:06 -07:00
Ishaan Jaff
15d488c25c docs set max_request_size 2024-07-27 16:25:57 -07:00
Krrish Dholakia
c5ee6fe4b9 build: cookbook on migrating to litellm proxy from openai/azure sdk 2024-07-27 16:09:50 -07:00
Ishaan Jaff
4ab8d2229d security - check max request size 2024-07-27 16:08:41 -07:00
Ishaan Jaff
2e9fb5ca1f
Merge pull request #4924 from BerriAI/litellm_log_writing_spend_to_db_otel 
[Feat] - log writing BatchSpendUpdate events on OTEL
 2024-07-27 16:07:56 -07:00
Krrish Dholakia
d1989b6063 fix(utils.py): support fireworks ai finetuned models 
Fixes https://github.com/BerriAI/litellm/issues/4923
 2024-07-27 15:38:27 -07:00
Krrish Dholakia
f76cad210c fix(utils.py): support fireworks ai finetuned models 
Fixes https://github.com/BerriAI/litellm/issues/4923
 2024-07-27 15:37:28 -07:00
Krrish Dholakia
c85ed01756 feat(utils.py): fix openai-like streaming 2024-07-27 15:32:57 -07:00
Ishaan Jaff
35ecf3c06b fix otel test 2024-07-27 15:30:58 -07:00
Krrish Dholakia
3c77f39751 fix(databricks.py): fix client used 2024-07-27 13:15:00 -07:00
Krrish Dholakia
05ba34b9b7 fix(utils.py): add exception mapping for databricks errors 2024-07-27 13:13:31 -07:00
Krrish Dholakia
5b71421a7b feat(vertex_ai_partner.py): initial working commit for calling vertex ai mistral 
Closes https://github.com/BerriAI/litellm/issues/4874
 2024-07-27 12:54:14 -07:00
Ishaan Jaff
7dac0e0001 fix otel logging 2024-07-27 12:05:24 -07:00
Ishaan Jaff
7c0ea16e3d test otel for batch_write_to_db 2024-07-27 11:47:17 -07:00
Ishaan Jaff
19fb5cc11c use common helpers for writing to otel 2024-07-27 11:40:39 -07:00
Ishaan Jaff
f71ba63cab refactor use common helper 2024-07-27 11:39:03 -07:00
Ishaan Jaff
32eb3bd719 add new BATCH_WRITE_TO_DB type for service logger 2024-07-27 11:36:51 -07:00
Ishaan Jaff
d5d9ed73af use _get_parent_otel_span_from_kwargs 2024-07-27 11:14:06 -07:00
Ishaan Jaff
2a89486948 move _get_parent_otel_span_from_kwargs to otel.py 2024-07-27 11:12:13 -07:00
Ishaan Jaff
61c10e60a4 feat - use log_to_opentelemetry for _PROXY_track_cost_callback 2024-07-27 11:08:22 -07:00
Krrish Dholakia
1a8f45e8da build(model_prices_and_context_window.json): add mistral nemo + codestral pricing 2024-07-27 10:46:52 -07:00
Krrish Dholakia
2719860c46 build(model_prices_and_context_window.json): add mistral-large on vertex ai pricing 2024-07-27 10:37:18 -07:00