Commit Graph

34378 Commits

Author SHA1 Message Date
ishaan-jaff
53961d641e (docs) new OpenAI embedding models 2024-01-25 16:40:23 -08:00
ishaan-jaff
c10bda3d30 (chore) cleanup testing file 2024-01-25 16:40:23 -08:00
ishaan-jaff
4b15ae41f4 (feat) add new OpenAI text-embedding-3 2024-01-25 16:40:23 -08:00
ishaan-jaff
7e1b9158fe (test) embedding models 2024-01-25 16:40:23 -08:00
ishaan-jaff
5264a3eb53 (fix) do nothing if alerting is not switched on 2024-01-25 16:40:23 -08:00
ishaan-jaff
1c9b02ad99 (fix) alerting debug statements 2024-01-25 16:40:23 -08:00
ishaan-jaff
b8f917624f (docs) config.yaml 2024-01-25 16:40:23 -08:00
ishaan-jaff
3a1c8f453f (docs) track max_budget on proxy config.yaml 2024-01-25 16:40:23 -08:00
ishaan-jaff
229e4920df (fix) better alert message on budgets 2024-01-25 16:40:23 -08:00
ishaan-jaff
81c528f6ce (fix) raise correct error when proxy crossed budget 2024-01-25 16:40:23 -08:00
ishaan-jaff
56f49a87ba (fix) raise exception budget_duration is set and max_budget is Not 2024-01-25 16:40:23 -08:00
ishaan-jaff
7a2a7e047f (feat) slack alerting budgets 2024-01-25 16:40:23 -08:00
ishaan-jaff
55115a75b0 (feat) alerts proxy budgets 2024-01-25 16:40:23 -08:00
ishaan-jaff
565531fe9e v0 basic structure 2024-01-25 16:40:23 -08:00
ishaan-jaff
a1067521c3 (ui) view app spend 2024-01-25 16:15:05 -08:00
ishaan-jaff
e56721d6c3 (feat) view spend/logs by user_id, view spend/user by user 2024-01-25 16:12:28 -08:00
Krrish Dholakia
878b0be174 bump: version 1.19.3 → 1.19.4 2024-01-25 16:06:12 -08:00
Krrish Dholakia
76468cc351 refactor: trigger new bump 2024-01-25 16:06:01 -08:00
Krish Dholakia
7271f5d9d5
Merge pull request #1623 from BerriAI/litellm_dynamic_vertex_ai_project
fix(main.py): allow vertex ai project and location to be set in completion() call
2024-01-25 16:04:41 -08:00
Krrish Dholakia
72275ad8cb fix(main.py): fix logging event loop for async logging but sync streaming 2024-01-25 15:59:53 -08:00
Krrish Dholakia
fbab810189 fix(main.py): allow vertex ai project and location to be set in completion() call 2024-01-25 15:00:51 -08:00
Krrish Dholakia
bbe6a92eb9 fix(main.py): fix order of assembly for streaming chunks 2024-01-25 14:51:08 -08:00
ishaan-jaff
06506f65f0 bump: version 1.19.2 → 1.19.3 2024-01-25 14:50:51 -08:00
ishaan-jaff
42270258d1 (docs) new gpt-4-0125-preview 2024-01-25 14:48:56 -08:00
ishaan-jaff
e2d9e40886 (test) gpt-4-0125-preview 2024-01-25 14:42:10 -08:00
ishaan-jaff
4404f22f17 (feat) add gpt-4-0125-preview 2024-01-25 14:41:46 -08:00
ishaan-jaff
b3853c3a53 (docs) new OpenAI embedding models 2024-01-25 14:38:03 -08:00
ishaan-jaff
72790f44da (chore) cleanup testing file 2024-01-25 14:36:11 -08:00
ishaan-jaff
f0a11baf19 (feat) add new OpenAI text-embedding-3 2024-01-25 14:34:15 -08:00
ishaan-jaff
6cbde02cab (test) embedding models 2024-01-25 14:30:49 -08:00
Krrish Dholakia
09ec6d6458 fix(utils.py): fix sagemaker async logging for sync streaming
https://github.com/BerriAI/litellm/issues/1592
2024-01-25 12:49:45 -08:00
Ishaan Jaff
06a5dbfb5e
Merge pull request #1615 from BerriAI/litellm_alerts_budget_tracking
[Feat] Alerts for Proxy Budgets
2024-01-25 12:00:18 -08:00
ishaan-jaff
ca12e70369 (fix) do nothing if alerting is not switched on 2024-01-25 11:58:55 -08:00
ishaan-jaff
e80d32dcdd (fix) alerting debug statements 2024-01-25 11:56:52 -08:00
ishaan-jaff
6dc9be4d43 (docs) config.yaml 2024-01-25 11:41:35 -08:00
ishaan-jaff
6fb3f8f239 (docs) track max_budget on proxy config.yaml 2024-01-25 11:40:56 -08:00
ishaan-jaff
b3f91844cb (fix) better alert message on budgets 2024-01-25 11:40:20 -08:00
ishaan-jaff
450b0a0ad1 (fix) raise correct error when proxy crossed budget 2024-01-25 11:39:57 -08:00
ishaan-jaff
126b87e3fa (fix) raise exception budget_duration is set and max_budget is Not 2024-01-25 11:32:05 -08:00
ishaan-jaff
3ef2afb0e4 (feat) slack alerting budgets 2024-01-25 11:18:06 -08:00
ishaan-jaff
1ab713c76c (feat) alerts proxy budgets 2024-01-25 10:01:32 -08:00
ishaan-jaff
d328a4bad0 v0 basic structure 2024-01-25 09:58:43 -08:00
Krrish Dholakia
39d5407e67 fix(proxy_server.py): don't set tpm/rpm limits unless set
https://github.com/BerriAI/litellm/issues/1594
2024-01-25 09:53:10 -08:00
Krrish Dholakia
fdb28407bc docs(custom_pricing.md): fix tutorial 2024-01-25 09:36:15 -08:00
Krrish Dholakia
01a84837a7 docs(vertex.md): add vertex ai proxy tutorial to docs 2024-01-25 09:11:11 -08:00
Krrish Dholakia
389347250f docs(users.md): add proxy budget to docs 2024-01-25 09:04:23 -08:00
ishaan-jaff
5b151c8566 (ghcr deploy) use platform 2024-01-25 08:43:38 -08:00
Krrish Dholakia
7e06944d80 test(test_dynamodb_logs.py): skip flaky test 2024-01-24 23:18:45 -08:00
Krrish Dholakia
34154dde02 bump: version 1.19.1 → 1.19.2 2024-01-24 22:19:07 -08:00
Krrish Dholakia
81846ffdec fix(proxy/utils.py): handle item not existing during batch updates 2024-01-24 21:49:47 -08:00