ishaan-jaff
|
cb40f58cd3
|
(fix) return usage in mock_completion
|
2024-01-19 11:25:47 -08:00 |
|
ishaan-jaff
|
6a695477ba
|
(fix) async langfuse logger
|
2024-01-19 10:44:51 -08:00 |
|
ishaan-jaff
|
f2cfb76920
|
(fix) use asyncio run_in_executor
|
2024-01-19 09:52:51 -08:00 |
|
ishaan-jaff
|
e6b5152e63
|
(chore) update load test
|
2024-01-19 08:52:17 -08:00 |
|
ishaan-jaff
|
cd08a02764
|
(test) add blocking callback test
|
2024-01-19 08:51:52 -08:00 |
|
ishaan-jaff
|
a9c5b02303
|
(v0) fix
|
2024-01-19 08:51:14 -08:00 |
|
Ishaan Jaff
|
9aaa2c417d
|
Merge pull request #1515 from ErikBjare/patch-1
nit: switch to valid SPDX license identifier `MIT` in pyproject.toml
|
2024-01-19 08:03:39 -08:00 |
|
Erik Bjäreholt
|
3eab194014
|
nit: switch to valid SPDX license identifier MIT in pyproject.toml
See: https://python-poetry.org/docs/pyproject/#license
|
2024-01-19 10:47:29 +01:00 |
|
Ishaan Jaff
|
8fef1a1b69
|
Merge pull request #1499 from duarteocarmo/patch-2
Adds s3_path prefix so that we can save objects in predifined location in s3 bucket
|
2024-01-18 21:22:15 -08:00 |
|
Ishaan Jaff
|
8338d04d1a
|
Merge pull request #1506 from HaruHunab1320/main
add headers to budget manager
|
2024-01-18 21:20:45 -08:00 |
|
Ishaan Jaff
|
79e261f533
|
Merge pull request #1509 from BerriAI/litellm_track_cost_user_id_chat_completions
[Feat] Proxy - Track Cost Per User (Using `user` passed to requests)
|
2024-01-18 20:44:02 -08:00 |
|
Krrish Dholakia
|
b6b584fdba
|
bump: version 1.18.3 → 1.18.4
|
2024-01-18 19:37:40 -08:00 |
|
Krrish Dholakia
|
f7694bc193
|
Merge branch 'main' into litellm_tpm_rpm_rate_limits
|
2024-01-18 19:10:07 -08:00 |
|
ishaan-jaff
|
5698be0df1
|
(fix) safe access litellm_params, proxy_server_request
|
2024-01-18 18:05:51 -08:00 |
|
Krrish Dholakia
|
94ce524c63
|
test(test_completion.py): handle together ai timeout
|
2024-01-18 17:54:16 -08:00 |
|
ishaan-jaff
|
16f3d7e0ed
|
(feat) use user_id passed to request - cost track
|
2024-01-18 17:51:48 -08:00 |
|
ishaan-jaff
|
697c511e76
|
(feat) support user param for all providers
|
2024-01-18 17:45:59 -08:00 |
|
ishaan-jaff
|
ddd9ca86a7
|
(feat) proxy - track cost for user_ids that do not exist
|
2024-01-18 17:44:39 -08:00 |
|
Krrish Dholakia
|
b21a357ced
|
bump: version 1.18.2 → 1.18.3
|
2024-01-18 17:14:22 -08:00 |
|
Krrish Dholakia
|
e0aaa94f28
|
fix(main.py): read azure ad token from optional params extra body
|
2024-01-18 17:14:03 -08:00 |
|
Krrish Dholakia
|
1e5efdfa37
|
fix(proxy_server.py): support setting tpm/rpm limits per user / per key
|
2024-01-18 17:03:18 -08:00 |
|
Ishaan Jaff
|
a8ba5df90e
|
Merge pull request #1500 from BerriAI/litellm_create_keys_with_team_id
[Feat] /key/generate - create keys with`team_id`
|
2024-01-18 16:35:14 -08:00 |
|
Jakob
|
7ba7272a9a
|
add headers to budget manager
|
2024-01-18 16:10:45 -08:00 |
|
Krrish Dholakia
|
5dac2402ef
|
test(test_parallel_request_limiter.py): unit testing for tpm/rpm rate limits
|
2024-01-18 15:28:28 -08:00 |
|
Krrish Dholakia
|
22c3321208
|
test(test_parallel_request_limiter.py): unit testing for tpm/rpm rate limits
|
2024-01-18 15:25:29 -08:00 |
|
ishaan-jaff
|
340706565f
|
(fix) add team_id to doc string
|
2024-01-18 15:23:05 -08:00 |
|
ishaan-jaff
|
cdede8836f
|
(docs)virtual keys
|
2024-01-18 15:16:40 -08:00 |
|
ishaan-jaff
|
0e3e8050d7
|
(docs) /key/info
|
2024-01-18 14:54:11 -08:00 |
|
ishaan-jaff
|
d5e720e161
|
(docs) /key/update
|
2024-01-18 14:45:49 -08:00 |
|
ishaan-jaff
|
2b6972111e
|
(feat) write team_id to User Table
|
2024-01-18 14:42:46 -08:00 |
|
ishaan-jaff
|
5beef6dbcd
|
(test) setting team_id
|
2024-01-18 14:33:13 -08:00 |
|
Ishaan Jaff
|
a26267851f
|
Merge pull request #1498 from BerriAI/litellm_spend_tracking_logs
[Feat] Proxy - Add Spend tracking logs
|
2024-01-18 14:21:51 -08:00 |
|
ishaan-jaff
|
f405a827e3
|
(docs) virtual_keys
|
2024-01-18 13:55:32 -08:00 |
|
ishaan-jaff
|
90509a159a
|
(fix) write team_id to key table
|
2024-01-18 13:54:08 -08:00 |
|
Krrish Dholakia
|
aef59c554f
|
feat(parallel_request_limiter.py): add support for tpm/rpm limits
|
2024-01-18 13:52:15 -08:00 |
|
ishaan-jaff
|
42ad12b2bd
|
(fix) support team_id for /key/generate
|
2024-01-18 13:48:52 -08:00 |
|
ishaan-jaff
|
4294657b99
|
(fix) use get_logging_payload
|
2024-01-18 13:40:48 -08:00 |
|
ishaan-jaff
|
ea32a8757b
|
(feat) set team_id on virtual_keys
|
2024-01-18 13:34:51 -08:00 |
|
ishaan-jaff
|
1c987a436e
|
(docs) virtual_keys
|
2024-01-18 13:34:33 -08:00 |
|
ishaan-jaff
|
7bdf0a0a63
|
(chore) cleanup utils.py
|
2024-01-18 13:21:51 -08:00 |
|
ishaan-jaff
|
73938080f2
|
(feat) track - api_key in spendLogs
|
2024-01-18 13:16:25 -08:00 |
|
Duarte OC
|
daa399bc60
|
adds s3 folder prefix to cache
|
2024-01-18 21:57:47 +01:00 |
|
Krrish Dholakia
|
2e06e00413
|
bump: version 1.18.1 → 1.18.2
|
2024-01-18 12:42:33 -08:00 |
|
Krrish Dholakia
|
1ea3833ef7
|
fix(parallel_request_limiter.py): decrement count for failed llm calls
https://github.com/BerriAI/litellm/issues/1477
|
2024-01-18 12:42:14 -08:00 |
|
ishaan-jaff
|
5b54bcc712
|
(feat) spendLogs table DynamoDB
|
2024-01-18 12:39:11 -08:00 |
|
ishaan-jaff
|
4eb9221121
|
(fix) track EmbeddingResponse cost
|
2024-01-18 12:29:21 -08:00 |
|
ishaan-jaff
|
88cdfedf84
|
(feat) track cost streaming
|
2024-01-18 12:21:56 -08:00 |
|
ishaan-jaff
|
b0e18e92b6
|
(fix) when kwargs==None
|
2024-01-18 12:05:08 -08:00 |
|
ishaan-jaff
|
d14d36af9a
|
(v0 ) working - writing /chat/completion spend tracking
|
2024-01-18 11:54:15 -08:00 |
|
Krrish Dholakia
|
37e6c6a59f
|
docs(sidebars.js): simplify docs nav
|
2024-01-18 11:38:02 -08:00 |
|