Commit Graph

11302 Commits

Author SHA1 Message Date
Ishaan Jaff
bfc84a7e81 fix - slack alerting use one httpx client for alerts 2024-04-23 18:47:39 -07:00
Ishaan Jaff
31979f83d2 fix - refactor slack alerting 2024-04-23 18:34:11 -07:00
Ishaan Jaff
37069f45cb fix - use one slack class 2024-04-23 18:31:15 -07:00
Krish Dholakia
8d2e411df6
Merge pull request #3124 from elisalimli/bugfix/add-missing-tool-calls-mistral-messages
Add missing tool_calls and name to messages
2024-04-23 17:25:12 -07:00
Krrish Dholakia
72ac0d26e3 test: fix test 2024-04-23 16:56:48 -07:00
Krrish Dholakia
d67e47d7fd fix(test_caching.py): add longer delay for async test 2024-04-23 16:13:03 -07:00
Krrish Dholakia
305d526140 build(model_prices_and_context_window.json): add claude 3 supporting function calling as true flag 2024-04-23 15:38:42 -07:00
Ishaan Jaff
16d245468a
Merge pull request #3252 from Manouchehri/groq-seed-1
(utils.py) - Add seed for Groq
2024-04-23 14:40:20 -07:00
David Manouchehri
69ddd7c68f
(utils.py) - Add seed for Groq 2024-04-23 20:32:21 +00:00
Ishaan Jaff
e29cf9ab38
Merge pull request #3249 from BerriAI/ui_router_Settings
ui - cleanup showing router settings
2024-04-23 13:04:01 -07:00
Krrish Dholakia
161e836427 fix(utils.py): fix 'no-cache': true when caching is turned on 2024-04-23 12:58:30 -07:00
Ishaan Jaff
e15ce79833
Merge pull request #3244 from BerriAI/litellm_fix_linking_langfuse_slack_alerts
[Fix] Linking Langfuse Projects to Slack Alerts
2024-04-23 12:53:18 -07:00
Ishaan Jaff
eada6f6d5d ui - cleanup showing router settings 2024-04-23 12:34:00 -07:00
Ishaan Jaff
0b604146ae
Merge pull request #3245 from BerriAI/litellm_router_settings_cleanup
[Fix] Proxy: updating router settings from UI
2024-04-23 12:10:13 -07:00
Ishaan Jaff
41ab5f2f56 fix - updating router settings from DB 2024-04-23 12:07:58 -07:00
Ishaan Jaff
5118c96b4d fix langfuse project id 2024-04-23 11:37:17 -07:00
Krish Dholakia
caca6a11d7
Merge pull request #3242 from BerriAI/litellm_router_fixes_2
fix(router.py) handle initial model list being empty
2024-04-23 10:55:19 -07:00
Krrish Dholakia
9d2726c2ac fix(proxy_server.py): handle router being initialized without a model list 2024-04-23 10:52:28 -07:00
dependabot[bot]
7ca8809889
build(deps): bump hono from 4.1.5 to 4.2.7 in /litellm-js/spend-logs
Bumps [hono](https://github.com/honojs/hono) from 4.1.5 to 4.2.7.
- [Release notes](https://github.com/honojs/hono/releases)
- [Commits](https://github.com/honojs/hono/compare/v4.1.5...v4.2.7)

---
updated-dependencies:
- dependency-name: hono
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-04-23 16:25:03 +00:00
Simon Sanchez Viloria
f9a7456eaa (docs) updated cookbook 2024-04-23 16:22:41 +02:00
Simon Sanchez Viloria
d72b725273 Fixed bugs in prompt factory for ibm-mistral and llama 3 models. 2024-04-23 16:20:49 +02:00
Simon S. Viloria
2ef4fb2efa
Merge branch 'BerriAI:main' into feature/watsonx-integration 2024-04-23 12:18:34 +02:00
Simon Sanchez Viloria
e64aceea91 (feat) Update WatsonX credentials and variable names 2024-04-23 12:16:04 +02:00
Simon Sanchez Viloria
7cbe9835c9 (docs) updated litellm watsonx cookbook 2024-04-23 12:01:13 +02:00
Simon Sanchez Viloria
74d2ba0a23 feat - watsonx refractoring, removed dependency, and added support for embedding calls 2024-04-23 12:01:13 +02:00
Ishaan Jaff
774fb33f28
Merge pull request #3231 from Manouchehri/fix-groq-1
(utils.py) - Fix response_format typo for Groq
2024-04-22 22:06:48 -07:00
David Manouchehri
6d61607ee3
(utils.py) - Fix response_format typo for Groq 2024-04-23 04:26:26 +00:00
Krrish Dholakia
8b74b52932 docs(caching.md): add redis ssl to docs 2024-04-22 19:32:03 -07:00
Krrish Dholakia
ec2c70e362 fix(vertex_ai.py): fix streaming logic 2024-04-22 19:15:20 -07:00
Krrish Dholakia
0bb8a4434e fix(vertex_ai.py): remove ExtendedGenerationConfig usage 2024-04-22 18:23:21 -07:00
Ishaan Jaff
7e9587c102 ui - new build 2024-04-22 18:16:54 -07:00
Ishaan Jaff
fdf432798e
Merge pull request #3228 from BerriAI/litellm_ui_polish
[Fix] Non-Admin SSO Login
2024-04-22 18:15:10 -07:00
Ishaan Jaff
9250f61a4c fix - sso login for non admins 2024-04-22 17:57:47 -07:00
Krish Dholakia
14d92aa944
Merge pull request #3214 from Manouchehri/add-p-and-f-pen-gemmini-1
(Vertex AI) - Add `frequency_penalty` and `presence_penalty` support
2024-04-22 16:46:49 -07:00
Krish Dholakia
b1512d23be
Merge pull request #3211 from Manouchehri/simplify-gemini-config-1
improve(vertex_ai.py): Switch to simpler dict type for supporting JSON mode
2024-04-22 16:46:33 -07:00
Ishaan Jaff
9886392694
Merge pull request #3226 from BerriAI/litellm_alerting_fix
[Bug-Fix] Alerting - don't send hanging request alert on failed request
2024-04-22 16:32:35 -07:00
Ishaan Jaff
bd0d6bce0f fix models displayed when logging in 2024-04-22 16:31:47 -07:00
Ishaan Jaff
8874eaa0b3 fix - track litellm_status=fail 2024-04-22 16:11:04 -07:00
Ishaan Jaff
517f577292 fix - dont send alert on fail request 2024-04-22 16:07:58 -07:00
Krish Dholakia
9a49065b0b
Merge pull request #3224 from BerriAI/litellm_prometheus_key_owner
fix(prometheus.py): add user tracking to prometheus
2024-04-22 15:45:26 -07:00
Ishaan Jaff
dbb06141a3
Merge pull request #3219 from BerriAI/litellm_ui_show_teams_ui
[UI-Fix] Show all teams on Admin UI
2024-04-22 15:22:14 -07:00
Ishaan Jaff
c777e5d9d2
Merge pull request #3223 from paul-gauthier/main
Added openrouter/meta-llama/llama-3-70b-instruct context and cost metrics
2024-04-22 15:18:07 -07:00
Krrish Dholakia
6ac0dba5c2 fix(prometheus.py): add user tracking to prometheus 2024-04-22 15:14:38 -07:00
Paul Gauthier
0a021a6fa2 Added openrouter/meta-llama/llama-3-70b-instruct context and cost metadata
Per https://openrouter.ai/models/meta-llama/llama-3-70b-instruct

Meta: Llama 3 70B Instruct
meta-llama/llama-3-70b-instruct

Updated Apr 18
8,192 context
$0.8/M input tkns
$0.8/M output tkns
2024-04-22 15:07:58 -07:00
Ishaan Jaff
aa73c115f6
Merge pull request #3205 from bllchmbrs/patch-1
Update langsmith_integration.md
2024-04-22 14:21:25 -07:00
Ishaan Jaff
4fbb92e9e9
Merge pull request #3218 from BerriAI/ui_cleanup_text_input
[UI-Polish] Cleanup Inputing Key Name, Team Name, User Email
2024-04-22 14:20:29 -07:00
Ishaan Jaff
50bbd188fb ui - show all teams on ui 2024-04-22 14:15:50 -07:00
Ishaan Jaff
cd3b2a21c1 ui - find all teams 2024-04-22 14:15:09 -07:00
Ishaan Jaff
877c4e27f4
Merge pull request #3212 from BerriAI/ui_increase_default_session_time
UI - increase default session time to 2 hours
2024-04-22 13:46:18 -07:00
Ishaan Jaff
1a945092de
Merge pull request #3210 from BerriAI/litellm_ui_round_up_team_spend_2_decimals
[UI] round up team spend to 2 decimals + diversify legend for team spend
2024-04-22 13:45:52 -07:00