Commit Graph

8833 Commits

Author SHA1 Message Date
Krrish Dholakia
f18250df48 bump: version 1.32.3 → 1.32.4 2024-03-18 21:51:44 -07:00
Krish Dholakia
c4dbd0407e
Merge pull request #2561 from BerriAI/litellm_batch_writing_db
fix(proxy/utils.py): move to batch writing db updates
2024-03-18 21:50:47 -07:00
Ishaan Jaff
56f2f1b901 (test) usage based routing test 2024-03-18 21:39:59 -07:00
Krrish Dholakia
2fdc20f549 test: handle vertex ai rate limit errors 2024-03-18 21:33:08 -07:00
Krrish Dholakia
2827acc487 refactor(main.py): trigger new build 2024-03-18 21:27:32 -07:00
Ishaan Jaff
52a5ed410b (ci/cd) run again 2024-03-18 21:24:24 -07:00
Krrish Dholakia
693b5eb376 docs(main.py): add timeout to docstring 2024-03-18 21:23:46 -07:00
Krrish Dholakia
7eaddaef10 refactor(proxy_server.py): re-add custom db client logic - prevent regressions 2024-03-18 21:16:28 -07:00
Ishaan Jaff
a524918140 (fix) test load config proxy with redis 2024-03-18 20:42:41 -07:00
Krrish Dholakia
0b39bc141b test(test_update_spend.py): fix test 2024-03-18 20:38:21 -07:00
Ishaan Jaff
ef39b1bc43
Merge pull request #2581 from BerriAI/litellm_ui_show_global_spend
[FIX] UI show global spend - when proxy budget not set
2024-03-18 20:34:30 -07:00
Ishaan Jaff
a3397dd6c5 (feat) update ui build 2024-03-18 20:32:28 -07:00
Ishaan Jaff
51d658e878 (fix) if litellm-proxy-budget set use it 2024-03-18 20:31:23 -07:00
Krrish Dholakia
f588bff69b fix(proxy_server.py): fix spend log update 2024-03-18 20:26:28 -07:00
Krish Dholakia
c669943292
Merge pull request #2577 from BerriAI/litellm_vertex_ai_streaming_func_call
feat(vertex_ai.py): support gemini (vertex ai) function calling when streaming
2024-03-18 20:10:00 -07:00
Krish Dholakia
5edb703d78
Merge pull request #1527 from TheDiscoMole/litellm_non_openai_tool_call_prompt
improving non-openai tool_call prompt
2024-03-18 18:29:42 -07:00
Krish Dholakia
59a4e1bfb6
Merge branch 'main' into litellm_non_openai_tool_call_prompt 2024-03-18 18:29:36 -07:00
Ishaan Jaff
3d890ff396 (ui) show spend when budget not set 2024-03-18 18:28:30 -07:00
Ishaan Jaff
a8473042d1 (ui) show users their spend when max budget not set 2024-03-18 18:28:13 -07:00
Krish Dholakia
0ca619dc5d
Merge pull request #2548 from zdsfwy/main
fix bug: custom prompt templates registered are never applied to vllm provider
2024-03-18 18:19:45 -07:00
Ishaan Jaff
87dd3f1235 (fix) show global spend on UI 2024-03-18 18:15:08 -07:00
Ishaan Jaff
be6fb579df bump: version 1.32.2 → 1.32.3 2024-03-18 17:14:04 -07:00
Ishaan Jaff
faddf5d351 bump: version 1.32.1 → 1.32.2 2024-03-18 17:14:01 -07:00
Ishaan Jaff
436de920e4
Merge pull request #2579 from BerriAI/litellm_datadog_docs
[Docs] datadog docs + LiteLLM Proxy
2024-03-18 17:12:52 -07:00
Ishaan Jaff
bb54d692ec
Merge pull request #2578 from BerriAI/litellm_datadog_int
[FEAT] DataDog Logging Provider
2024-03-18 17:10:59 -07:00
Ishaan Jaff
038c9d5781 (docs) litellm + datadog 2024-03-18 17:06:00 -07:00
Krrish Dholakia
8fefe625d9 fix(proxy/utils.py): batch writing updates to db 2024-03-18 16:47:02 -07:00
Ishaan Jaff
0dab5841cd (fix) proxy extra spacing 2024-03-18 16:43:04 -07:00
Ishaan Jaff
fedb4e5703 (fix) clean dd imports 2024-03-18 16:40:58 -07:00
Ishaan Jaff
17295286d3 (cleanup) extra line 2024-03-18 16:40:01 -07:00
Ishaan Jaff
325eb35b44 (cleanup) proxy 2024-03-18 16:31:16 -07:00
Ishaan Jaff
2bce2ee7e3 (fix) log to datadog 2024-03-18 16:27:55 -07:00
Ishaan Jaff
2afddf4536 (feat) init datadog logger 2024-03-18 16:27:01 -07:00
Ishaan Jaff
6a7c86fc58 (test) dd test 2024-03-18 16:22:59 -07:00
Ishaan Jaff
ac826851fa (feat) v0 datadog logger 2024-03-18 16:01:47 -07:00
Krrish Dholakia
5ad790ffdf test: fix test 2024-03-18 13:43:14 -07:00
Krrish Dholakia
f0434350f1 fix(proxy_server.py): don't override cache params on proxy config if set 2024-03-18 12:11:30 -07:00
Krrish Dholakia
f49dc9a99f feat(vertex_ai.py): support gemini (vertex ai) function calling when streaming 2024-03-18 11:47:27 -07:00
Krish Dholakia
ebf17d99e5
Merge pull request #2570 from garfeildma/main
Support multiple system message tranlation for bedrock claude-3
2024-03-18 11:18:02 -07:00
Krrish Dholakia
8619499853 fix(proxy_server.py): ignore cache if value is false 2024-03-18 11:15:32 -07:00
Ishaan Jaff
a1b004900b (feat) add datadog integration 2024-03-18 10:55:29 -07:00
Krish Dholakia
6d7739aa6d
Merge pull request #2573 from BerriAI/litellm_fix_redis_dynamic_args
fix(caching.py): pass redis kwargs to connection pool init
2024-03-18 08:53:26 -07:00
Krrish Dholakia
03acc07380 fix(caching.py): pass redis kwargs to connection pool init 2024-03-18 08:21:36 -07:00
Ishaan Jaff
4a4c322278 (docs) easily find call hooks 2024-03-18 07:38:29 -07:00
garfeildma
45d31e33aa support multiple system message tranlation for bedrock claude-3 2024-03-18 19:41:15 +08:00
Bincheng Li
e605b04927 fix bug: custom prompt templates registered are never applied to vllm provider 2024-03-17 15:21:14 +08:00
Krrish Dholakia
077b9c6234 fix(proxy/utils.py): move to batch writing db updates 2024-03-16 22:32:00 -07:00
Ishaan Jaff
6eac5c4f0a bump: version 1.32.0 → 1.32.1 2024-03-16 19:39:38 -07:00
Ishaan Jaff
3636bfdf59 bump: version 1.31.17 → 1.31.18 2024-03-16 19:39:09 -07:00
Ishaan Jaff
4e33aac997
Merge pull request #2560 from BerriAI/litellm_view_team_based_spend
Admin UI - view team based spend
2024-03-16 19:38:17 -07:00