Commit Graph

7869 Commits

Author SHA1 Message Date
Ishaan Jaff
3ff5745333
Merge pull request #2216 from BerriAI/litellm_fix_using_mistral_azure_ai
[FIX] using mistral on azure ai studio
2024-02-27 08:37:20 -08:00
Krish Dholakia
62efbd75b1
Merge pull request #2201 from Lunik/fix/ollama-vision
🐛 fix: Ollama vision models call arguments (like : llava)
2024-02-27 07:18:01 -08:00
Ishaan Jaff
db797f1fa9
Merge pull request #2213 from zu1k/main
fix(utils.py): fix compatibility between together_ai and openai-python
2024-02-27 07:00:43 -08:00
ishaan-jaff
e56cc26e18 (test) mistral on azure ai studio 2024-02-27 06:49:42 -08:00
ishaan-jaff
cfebbdfa7b (fix) support mistral on azure ai studio 2024-02-27 06:48:09 -08:00
zu1k
2e75279639 fix(utils.py): fix compatibility between together_ai and openai-python 2024-02-27 16:38:45 +08:00
Krrish Dholakia
156cccf706 bump: version 1.27.8 → 1.27.9 2024-02-26 23:10:31 -08:00
Krish Dholakia
365e7ed5b9
Merge pull request #2208 from BerriAI/litellm_enforce_team_limits
Litellm enforce team limits
2024-02-26 23:10:01 -08:00
Krrish Dholakia
4c134b1ec7 fix(proxy/utils.py): fix try-except for creating a view 2024-02-26 22:44:05 -08:00
Krrish Dholakia
1815ee16d4 fix(proxy_server.py): check if prisma client is initialized before checking if view exists 2024-02-26 22:11:47 -08:00
Krrish Dholakia
647e867cf8 test(test_amazing_vertex_completion.py): fix test to handle rate limit errors 2024-02-26 22:07:33 -08:00
Krrish Dholakia
1447621128 fix(utils.py): fix redis cache test 2024-02-26 22:04:24 -08:00
Krrish Dholakia
a428501e68 test(test_streaming.py): add more logging 2024-02-26 21:45:20 -08:00
Krrish Dholakia
6b14c6287b test(test_streaming.py): add more logging 2024-02-26 21:44:28 -08:00
Krrish Dholakia
02a1c4e7d8 bump: version 1.27.7 → 1.27.8 2024-02-26 21:35:47 -08:00
Krrish Dholakia
86982d0045 refactor(main.py): trigger new build 2024-02-26 21:35:30 -08:00
Krrish Dholakia
b3574f2b37 fix(parallel_request_limiter.py): handle none scenario 2024-02-26 20:09:06 -08:00
Krish Dholakia
600b925bca
Merge pull request #2212 from BerriAI/litellm_app_owner_usage
build(proxy_server.py): fix /spend/logs query bug
2024-02-26 19:58:29 -08:00
Krish Dholakia
95b5b7f1fc
Merge pull request #2203 from BerriAI/litellm_streaming_caching_fix
fix(utils.py): support returning caching streaming response for function calling streaming calls
2024-02-26 19:58:00 -08:00
Krrish Dholakia
4d9584ecd5 test(proxy_server.py): check if token has team params 2024-02-26 19:57:13 -08:00
Krrish Dholakia
2a6a72a0e7 fix(utils.py): fixing sync streaming for caching 2024-02-26 19:32:30 -08:00
Krrish Dholakia
7942539f9b test: testing fixes 2024-02-26 19:10:05 -08:00
ishaan-jaff
825c7fe376 (test) clickhouse 2024-02-26 18:56:43 -08:00
ishaan-jaff
2731fb3a7d (ci/cd) run again 2024-02-26 18:54:21 -08:00
Krrish Dholakia
d0c205fcd1 fix(proxy_server.py): don't cache request on key generate - misses the team related data 2024-02-26 18:48:55 -08:00
Krrish Dholakia
0273d1adc4 build(proxy_server.py): fix /spend/logs query bug 2024-02-26 18:38:02 -08:00
ishaan-jaff
8075746078 (docs) fix clickhouse link 2024-02-26 18:35:33 -08:00
ishaan-jaff
06525ca544 bump: version 1.27.6 → 1.27.7 2024-02-26 18:34:15 -08:00
Ishaan Jaff
1e49d654cd
Merge pull request #2211 from BerriAI/litellm_clickhouse_docs
[Docs] Use Clickhouse DB + Docker compose
2024-02-26 18:33:14 -08:00
ishaan-jaff
9bb55a0671 add clickhouse docs 2024-02-26 18:31:10 -08:00
Ishaan Jaff
dfdfd706cb
Merge pull request #2210 from BerriAI/litellm_use_clickhouse_viewing_logs
[FEAT] Admin UI  - View /spend/logs from clickhouse data
2024-02-26 18:09:01 -08:00
Krrish Dholakia
f86ab19067 fix(parallel_request_limiter.py): fix team rate limit enforcement 2024-02-26 18:06:13 -08:00
ishaan-jaff
30f4033bbc (feat) enable viewing /spend/logs for clickhouse 2024-02-26 18:05:21 -08:00
ishaan-jaff
c1f9703734 (feat) use clickhouse for /spend/logs 2024-02-26 17:54:10 -08:00
ishaan-jaff
dc5942f6aa (feat) use clickhouse for viewing data on Admin UI 2024-02-26 17:53:21 -08:00
ishaan-jaff
c591b3d9f3 (feat) insert clickhouse logs 2024-02-26 16:39:32 -08:00
Krrish Dholakia
f84ac35000 feat(parallel_request_limiter.py): enforce team based tpm / rpm limits 2024-02-26 16:20:41 -08:00
Krrish Dholakia
71d4b7aaf4 fix(proxy_server.py): enforce team based spend limits 2024-02-26 15:45:25 -08:00
Ishaan Jaff
18c27303aa
Merge pull request #2206 from BerriAI/litellm_setup_clickhouse
[Feat] Start Self hosted clickhouse server
2024-02-26 15:41:37 -08:00
ishaan-jaff
248755a1a5 (feat) init clickhouse logger 2024-02-26 15:38:07 -08:00
ishaan-jaff
919530593b (feat) basic clickhouse logging setup 2024-02-26 15:28:57 -08:00
ishaan-jaff
4c0f4d63c3 (feat) set up click house table on start 2024-02-26 15:25:59 -08:00
Krish Dholakia
2913c9525b
Update README.md 2024-02-26 15:23:52 -08:00
Krish Dholakia
99b92c4b23
Update README.md 2024-02-26 15:22:50 -08:00
Ishaan Jaff
6c200b3d5e
Merge pull request #2205 from BerriAI/litellm_docs_use_azure_ai
[Docs] use azure ai studio + mistral large
2024-02-26 14:33:49 -08:00
ishaan-jaff
c627ce6631 (docs) use azure ai studio + mistral litellm 2024-02-26 14:33:21 -08:00
Krrish Dholakia
788e24bd83 fix(utils.py): fix streaming logic 2024-02-26 14:26:58 -08:00
ishaan-jaff
031e0eabf8 (v0) start clickhouse 2024-02-26 14:18:56 -08:00
Krrish Dholakia
f7af18d72a test(test_amazing_vertex_completion.py): fix test 2024-02-26 12:57:23 -08:00
Krrish Dholakia
5b06627c09 fix(utils.py): fix streaming 2024-02-26 12:52:53 -08:00