Commit Graph

11316 Commits

Author SHA1 Message Date
Krrish Dholakia
4d9584ecd5 test(proxy_server.py): check if token has team params 2024-02-26 19:57:13 -08:00
Krrish Dholakia
2a6a72a0e7 fix(utils.py): fixing sync streaming for caching 2024-02-26 19:32:30 -08:00
Krrish Dholakia
7942539f9b test: testing fixes 2024-02-26 19:10:05 -08:00
ishaan-jaff
825c7fe376 (test) clickhouse 2024-02-26 18:56:43 -08:00
ishaan-jaff
2731fb3a7d (ci/cd) run again 2024-02-26 18:54:21 -08:00
Krrish Dholakia
d0c205fcd1 fix(proxy_server.py): don't cache request on key generate - misses the team related data 2024-02-26 18:48:55 -08:00
Krrish Dholakia
0273d1adc4 build(proxy_server.py): fix /spend/logs query bug 2024-02-26 18:38:02 -08:00
dependabot[bot]
82453a0d13
build(deps): bump orjson from 3.9.7 to 3.9.15
Bumps [orjson](https://github.com/ijl/orjson) from 3.9.7 to 3.9.15.
- [Release notes](https://github.com/ijl/orjson/releases)
- [Changelog](https://github.com/ijl/orjson/blob/master/CHANGELOG.md)
- [Commits](https://github.com/ijl/orjson/compare/3.9.7...3.9.15)

---
updated-dependencies:
- dependency-name: orjson
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-02-27 02:35:36 +00:00
ishaan-jaff
8075746078 (docs) fix clickhouse link 2024-02-26 18:35:33 -08:00
ishaan-jaff
06525ca544 bump: version 1.27.6 → 1.27.7 2024-02-26 18:34:15 -08:00
Ishaan Jaff
1e49d654cd
Merge pull request #2211 from BerriAI/litellm_clickhouse_docs
[Docs] Use Clickhouse DB + Docker compose
2024-02-26 18:33:14 -08:00
ishaan-jaff
9bb55a0671 add clickhouse docs 2024-02-26 18:31:10 -08:00
Ishaan Jaff
dfdfd706cb
Merge pull request #2210 from BerriAI/litellm_use_clickhouse_viewing_logs
[FEAT] Admin UI  - View /spend/logs from clickhouse data
2024-02-26 18:09:01 -08:00
Krrish Dholakia
f86ab19067 fix(parallel_request_limiter.py): fix team rate limit enforcement 2024-02-26 18:06:13 -08:00
ishaan-jaff
30f4033bbc (feat) enable viewing /spend/logs for clickhouse 2024-02-26 18:05:21 -08:00
ishaan-jaff
c1f9703734 (feat) use clickhouse for /spend/logs 2024-02-26 17:54:10 -08:00
ishaan-jaff
dc5942f6aa (feat) use clickhouse for viewing data on Admin UI 2024-02-26 17:53:21 -08:00
ishaan-jaff
c591b3d9f3 (feat) insert clickhouse logs 2024-02-26 16:39:32 -08:00
Krrish Dholakia
f84ac35000 feat(parallel_request_limiter.py): enforce team based tpm / rpm limits 2024-02-26 16:20:41 -08:00
Krrish Dholakia
71d4b7aaf4 fix(proxy_server.py): enforce team based spend limits 2024-02-26 15:45:25 -08:00
Ishaan Jaff
18c27303aa
Merge pull request #2206 from BerriAI/litellm_setup_clickhouse
[Feat] Start Self hosted clickhouse server
2024-02-26 15:41:37 -08:00
ishaan-jaff
248755a1a5 (feat) init clickhouse logger 2024-02-26 15:38:07 -08:00
ishaan-jaff
919530593b (feat) basic clickhouse logging setup 2024-02-26 15:28:57 -08:00
ishaan-jaff
4c0f4d63c3 (feat) set up click house table on start 2024-02-26 15:25:59 -08:00
Krish Dholakia
2913c9525b
Update README.md 2024-02-26 15:23:52 -08:00
Krish Dholakia
99b92c4b23
Update README.md 2024-02-26 15:22:50 -08:00
Ishaan Jaff
6c200b3d5e
Merge pull request #2205 from BerriAI/litellm_docs_use_azure_ai
[Docs] use azure ai studio + mistral large
2024-02-26 14:33:49 -08:00
ishaan-jaff
c627ce6631 (docs) use azure ai studio + mistral litellm 2024-02-26 14:33:21 -08:00
Krrish Dholakia
788e24bd83 fix(utils.py): fix streaming logic 2024-02-26 14:26:58 -08:00
ishaan-jaff
031e0eabf8 (v0) start clickhouse 2024-02-26 14:18:56 -08:00
Krrish Dholakia
f7af18d72a test(test_amazing_vertex_completion.py): fix test 2024-02-26 12:57:23 -08:00
Krrish Dholakia
5b06627c09 fix(utils.py): fix streaming 2024-02-26 12:52:53 -08:00
Krrish Dholakia
dfb1d34e26 fix(utils.py): support returning caching streaming response for function calling streaming calls 2024-02-26 12:31:00 -08:00
Krish Dholakia
069704c85b
Merge pull request #2202 from BerriAI/litellm_custom_callback_fix
Litellm custom callback fix
2024-02-26 10:50:46 -08:00
Krrish Dholakia
6cce9213d8 fix(main.py): refactor 2024-02-26 10:47:01 -08:00
Krrish Dholakia
a1c6e6d52b build(main.py): trigger new build 2024-02-26 10:44:24 -08:00
Krrish Dholakia
28f4b5809c test(test_amazing_vertex_completion.py): fix test 2024-02-26 10:42:05 -08:00
Krrish Dholakia
92ff9a1a79 test(test_amazing_vertex_completion.py): fix test 2024-02-26 10:40:22 -08:00
Krrish Dholakia
f460da4770 test: testing fixes 2024-02-26 10:38:49 -08:00
Krrish Dholakia
144254bd9d test(test_amazing_vertex_completion.py): skip gemini 1.5 as we don't have access to it 2024-02-26 09:32:37 -08:00
ishaan-jaff
da4832d5a2 (feat) add mistral-large-latest 2024-02-26 09:25:44 -08:00
Krrish Dholakia
1ac1f0a836 test(test_batch_completions.py): change flaky model 2024-02-26 09:25:25 -08:00
Krrish Dholakia
e48fff47dd test(test_custom_callback_input.py): assert async success called only once during vertex ai streaming 2024-02-26 09:18:46 -08:00
Krrish Dholakia
0209588681 bump: version 1.27.5 → 1.27.6 2024-02-26 09:00:20 -08:00
Krrish Dholakia
00d628544c fix(utils.py): fix vertex ai finish reason handling 2024-02-26 08:59:55 -08:00
Lunik
cee20695eb
🐛 fix: Ollama vision models call arguments (like : llava)
Signed-off-by: Lunik <lunik@tiwabbit.fr>
2024-02-26 17:52:55 +01:00
Krrish Dholakia
4e9210906b build(ui): add compiled ui to proxy 2024-02-26 08:30:40 -08:00
Ishaan Jaff
4067d4f1e5
Merge pull request #2187 from BerriAI/litellm_clickhouse_logs
[FEAT] Use Logging on clickhouse
2024-02-26 08:26:02 -08:00
ishaan-jaff
72abe7d7b7 bump: version 1.27.4 → 1.27.5 2024-02-26 08:04:13 -08:00
Ishaan Jaff
c09fa76045
Merge pull request #2198 from BerriAI/litellm_add_embedding3_costs
[FEAT] add cost for azure/text-embedding-3-large, azure/text-embedding-3-small
2024-02-26 08:03:57 -08:00