Commit Graph

8861 Commits

Author SHA1 Message Date
Ishaan Jaff
c196186190 (fix) add /metrics to utils.py 2024-03-19 17:28:33 -07:00
Ishaan Jaff
aa1c480452 (feat) using prom litellm 2024-03-19 15:49:23 -07:00
Ishaan Jaff
d2522752a6 (feat) prometheus metric collector 2024-03-19 15:44:36 -07:00
Ishaan Jaff
4b7e102187 (v0) prometheus metric 2024-03-19 14:48:38 -07:00
Krish Dholakia
358f94a4c3 Updated config.yml 2024-03-19 13:23:57 -07:00
Ishaan Jaff
36440f6b4a
Merge pull request #2521 from BerriAI/dependabot/npm_and_yarn/docs/my-website/follow-redirects-1.15.6
build(deps): bump follow-redirects from 1.15.4 to 1.15.6 in /docs/my-website
2024-03-19 13:13:55 -07:00
Ishaan Jaff
6f97e21039
Merge pull request #2589 from BerriAI/litellm_fill_models_when_creating_teams
[Admin UI] Show models when creating teams
2024-03-19 13:12:34 -07:00
Ishaan Jaff
4dc69db8e2 (feat) new ui build 2024-03-19 13:06:30 -07:00
Ishaan Jaff
d59d21f0fc (feat) ui - show models on create tab 2024-03-19 13:04:03 -07:00
Ishaan Jaff
3f3ce3372c (feat) - show models when creating teams 2024-03-19 12:55:03 -07:00
Ishaan Jaff
6cf0b32b32
Merge pull request #2588 from BerriAI/litellm_admin_ui_cleanup
[FEAT] Litellm admin UI cleanup
2024-03-19 12:42:37 -07:00
Ishaan Jaff
9b330db88f (feat) show slice of metadata 2024-03-19 12:38:53 -07:00
Ishaan Jaff
4b33a53f25 (feat) admin ui set max_width per column 2024-03-19 12:22:49 -07:00
Krrish Dholakia
4913ad41db bump: version 1.32.4 → 1.32.5 2024-03-19 12:09:24 -07:00
Krrish Dholakia
7c74a0e6e2 fix(proxy_server.py): expose disable_spend_logs flag in config general settings
Writing each spend log adds +300ms latency

https://github.com/BerriAI/litellm/issues/1714#issuecomment-1924727281
2024-03-19 12:08:37 -07:00
Ishaan Jaff
11683e5a7e (fix) rename spend report button 2024-03-19 11:54:36 -07:00
Krish Dholakia
c840fecdeb
Merge pull request #2142 from vilmar-hillow/azure_embedding_ad_token
Fixed azure ad token not being processed properly in embedding models
2024-03-19 11:51:28 -07:00
Krish Dholakia
97130bb34b
Merge pull request #2558 from lucasmrdt/main
fix(anthropic): tool calling detection
2024-03-19 11:48:05 -07:00
Krish Dholakia
25e0d9ac3a
Merge pull request #2562 from dragosMC91/add-mistral-medium-latest-to-prices-reference
Add mistral medium latest to model prices
2024-03-19 11:38:35 -07:00
Dragos Campean
40c2c343be Update small model name 2024-03-19 20:05:32 +02:00
Dragos Campean
28d5175908 Correct prices for mistral models 2024-03-19 20:02:09 +02:00
Krrish Dholakia
c03694ae1e fix(proxy/utils.py): cleanup logging 2024-03-19 09:29:29 -07:00
Krrish Dholakia
c63259ebcd docs(deploy.md): update docker start command 2024-03-19 07:58:08 -07:00
Krrish Dholakia
b6f094c5ec test(test_streaming.py): fix test 2024-03-18 22:06:29 -07:00
Krrish Dholakia
f18250df48 bump: version 1.32.3 → 1.32.4 2024-03-18 21:51:44 -07:00
Krish Dholakia
c4dbd0407e
Merge pull request #2561 from BerriAI/litellm_batch_writing_db
fix(proxy/utils.py): move to batch writing db updates
2024-03-18 21:50:47 -07:00
Ishaan Jaff
56f2f1b901 (test) usage based routing test 2024-03-18 21:39:59 -07:00
Krrish Dholakia
2fdc20f549 test: handle vertex ai rate limit errors 2024-03-18 21:33:08 -07:00
Krrish Dholakia
2827acc487 refactor(main.py): trigger new build 2024-03-18 21:27:32 -07:00
Ishaan Jaff
52a5ed410b (ci/cd) run again 2024-03-18 21:24:24 -07:00
Krrish Dholakia
693b5eb376 docs(main.py): add timeout to docstring 2024-03-18 21:23:46 -07:00
Krrish Dholakia
7eaddaef10 refactor(proxy_server.py): re-add custom db client logic - prevent regressions 2024-03-18 21:16:28 -07:00
Ishaan Jaff
a524918140 (fix) test load config proxy with redis 2024-03-18 20:42:41 -07:00
Krrish Dholakia
0b39bc141b test(test_update_spend.py): fix test 2024-03-18 20:38:21 -07:00
Ishaan Jaff
ef39b1bc43
Merge pull request #2581 from BerriAI/litellm_ui_show_global_spend
[FIX] UI show global spend - when proxy budget not set
2024-03-18 20:34:30 -07:00
Ishaan Jaff
a3397dd6c5 (feat) update ui build 2024-03-18 20:32:28 -07:00
Ishaan Jaff
51d658e878 (fix) if litellm-proxy-budget set use it 2024-03-18 20:31:23 -07:00
Krrish Dholakia
f588bff69b fix(proxy_server.py): fix spend log update 2024-03-18 20:26:28 -07:00
Krish Dholakia
c669943292
Merge pull request #2577 from BerriAI/litellm_vertex_ai_streaming_func_call
feat(vertex_ai.py): support gemini (vertex ai) function calling when streaming
2024-03-18 20:10:00 -07:00
Krish Dholakia
5edb703d78
Merge pull request #1527 from TheDiscoMole/litellm_non_openai_tool_call_prompt
improving non-openai tool_call prompt
2024-03-18 18:29:42 -07:00
Krish Dholakia
59a4e1bfb6
Merge branch 'main' into litellm_non_openai_tool_call_prompt 2024-03-18 18:29:36 -07:00
Ishaan Jaff
3d890ff396 (ui) show spend when budget not set 2024-03-18 18:28:30 -07:00
Ishaan Jaff
a8473042d1 (ui) show users their spend when max budget not set 2024-03-18 18:28:13 -07:00
Krish Dholakia
0ca619dc5d
Merge pull request #2548 from zdsfwy/main
fix bug: custom prompt templates registered are never applied to vllm provider
2024-03-18 18:19:45 -07:00
Ishaan Jaff
87dd3f1235 (fix) show global spend on UI 2024-03-18 18:15:08 -07:00
Ishaan Jaff
be6fb579df bump: version 1.32.2 → 1.32.3 2024-03-18 17:14:04 -07:00
Ishaan Jaff
faddf5d351 bump: version 1.32.1 → 1.32.2 2024-03-18 17:14:01 -07:00
Ishaan Jaff
436de920e4
Merge pull request #2579 from BerriAI/litellm_datadog_docs
[Docs] datadog docs + LiteLLM Proxy
2024-03-18 17:12:52 -07:00
Ishaan Jaff
bb54d692ec
Merge pull request #2578 from BerriAI/litellm_datadog_int
[FEAT] DataDog Logging Provider
2024-03-18 17:10:59 -07:00
Ishaan Jaff
038c9d5781 (docs) litellm + datadog 2024-03-18 17:06:00 -07:00