Commit Graph

13586 Commits

Author SHA1 Message Date
Krrish Dholakia
5e893ed13e fix(utils.py): Fix anthropic tool calling exception mapping
Fixes https://github.com/BerriAI/litellm/issues/4348
2024-06-21 21:20:49 -07:00
Krrish Dholakia
44bd9548d9 docs(anthropic.md): update with correct model string 2024-06-21 21:16:07 -07:00
Krrish Dholakia
000d678445 fix(utils.py): improve coverage for anthropic exception mapping 2024-06-21 21:15:10 -07:00
Ishaan Jaff
24addd8a4f fix test test_router_completion_streaming 2024-06-21 21:02:34 -07:00
Ishaan Jaff
b4d95e740e fix get_logging_payload 2024-06-21 20:42:28 -07:00
Ishaan Jaff
4cd1171abb
Merge pull request #4350 from CaseMark/print-content-fallback
Print content window fallbacks on startup to help verify configuration
2024-06-21 20:01:22 -07:00
Steven Osborn
0ab6a18516 Print content window fallbacks on startup to help verify configuration 2024-06-21 19:43:26 -07:00
Ishaan Jaff
98c131e1e9 bump: version 1.40.21 → 1.40.22 2024-06-21 18:12:12 -07:00
Ishaan Jaff
662cb5a5ec ui - new build 2024-06-21 18:12:12 -07:00
Ishaan Jaff
6b63b663b9
Merge pull request #4345 from BerriAI/litellm_fix_cost_tracking_tags
[Fix + Test] -  Spend tags not getting stored on 1.40.9
2024-06-21 17:34:27 -07:00
Krrish Dholakia
06b297a6e8 fix(router.py): fix set_client init to check if custom_llm_provider is azure not if in model name
fixes issue where 'azure_ai/' was being init as azureopenai client
2024-06-21 17:09:20 -07:00
Ishaan Jaff
fff928b10b fix testing spend_tracking 2024-06-21 16:52:42 -07:00
Ishaan Jaff
29c2155796 fix cost tracking by tags 2024-06-21 16:49:57 -07:00
Ishaan Jaff
c0540e764d
Merge pull request #4342 from BerriAI/litellm_fix_moderations
fix - liteLLM proxy /moderations endpoint returns 500 error when model is not specified
2024-06-21 16:19:22 -07:00
Ishaan Jaff
4e795dad81 fix ContentPolicyViolationError mapping 2024-06-21 16:11:42 -07:00
Ishaan Jaff
8fcd61825b test - /moderations 2024-06-21 16:08:52 -07:00
Ishaan Jaff
eb8a9b2654 fix - /moderation don't require a model 2024-06-21 16:00:43 -07:00
Ishaan Jaff
cc11cedf02
Merge pull request #4340 from BerriAI/litellm_show_cache_hit_stats
[Feat] Admin UI - Show Cache hit stats
2024-06-21 15:34:11 -07:00
Ishaan Jaff
07f34ac256 ui - show cache hits 2024-06-21 15:26:30 -07:00
Ishaan Jaff
097474502a ui - fix linting errors 2024-06-21 15:00:26 -07:00
Krrish Dholakia
941574a921 fix(proxy/utils.py): fix add langfuse trace id to alert
Fixing the import after refactor
2024-06-21 14:55:09 -07:00
Ishaan Jaff
35c07306df show correct key aliases on ui 2024-06-21 14:36:38 -07:00
Ishaan Jaff
e0a2717a19 ui - filter by selected date time 2024-06-21 14:36:28 -07:00
Krrish Dholakia
5912decd19 fix(proxy/utils.py): fix bool on check 2024-06-21 14:29:38 -07:00
Ishaan Jaff
d30cdd82cc move caching up on left nav 2024-06-21 14:28:15 -07:00
Ishaan Jaff
b91854bdbb ui - show leading cache indicators 2024-06-21 13:43:47 -07:00
Ishaan Jaff
829ac3a0d0 ui - add new cache hits page 2024-06-21 13:10:40 -07:00
Ishaan Jaff
10e88a939d backend - new endpoint to show cache hit stats 2024-06-21 13:08:54 -07:00
Krish Dholakia
88c550e3b7
Merge pull request #4337 from spdustin/main
fix: use per-token costs for claude via vertex_ai
2024-06-21 11:45:19 -07:00
spdustin@gmail.com
4acc2d50ad fix: use per-token costs for claude via vertex_ai 2024-06-21 11:21:36 -05:00
Krrish Dholakia
04fed2171c fix(vertex_httpx.py): cleanup docstring 2024-06-21 09:11:11 -07:00
Krrish Dholakia
16941eee43 fix(utils.py): re-integrate separate gemini optional param mapping (google ai studio)
Fixes https://github.com/BerriAI/litellm/issues/4333
2024-06-21 09:01:32 -07:00
Krrish Dholakia
d2b4d1f7ed bump: version 1.40.20 → 1.40.21 2024-06-21 08:28:43 -07:00
Krrish Dholakia
fdb7101aaf fix(utils.py): add extra body params for text completion calls 2024-06-21 08:28:38 -07:00
Ishaan Jaff
12f4fb3a42 fix refactor - add batches endpoints proxy server.py 2024-06-21 07:55:53 -07:00
Krish Dholakia
361e47882b
Merge pull request #4121 from friendliai/feat/friendliai
feat: friendli ai support
2024-06-20 22:17:41 -07:00
Ishaan Jaff
e23b56fe16 ci/cd run again 2024-06-20 21:58:17 -07:00
Ishaan Jaff
0efd94cfca ci/cd run again 2024-06-20 21:47:48 -07:00
Krrish Dholakia
97d33324df test: trigger new build 2024-06-20 21:42:42 -07:00
Krrish Dholakia
086d3b2877 ci(config.yml): fix testing 2024-06-20 21:39:28 -07:00
Krrish Dholakia
dfd5882c31 fix(vertex_httpx.py): allow passing extra headers
Closes https://github.com/BerriAI/litellm/pull/4327
2024-06-20 21:14:44 -07:00
Ishaan Jaff
3a510582c2 fix test_litellm_proxy_server_config_no_general_settings 2024-06-20 21:11:30 -07:00
Ishaan Jaff
558c00931e
Merge pull request #4322 from BerriAI/litellm_bug_fix_spend_tracking
[Fix]  user field and user_api_key_* is sometimes omitted randomly
2024-06-20 21:10:13 -07:00
Ishaan Jaff
f2677620fd test_call_with_end_user_over_budget 2024-06-20 21:08:06 -07:00
Krrish Dholakia
cd73ea245a test(test_lowest_latency_routing.py): use mock responses 2024-06-20 21:05:23 -07:00
Krrish Dholakia
e96326a211 docs(input.md): update docs with parallel_tool_calls 2024-06-20 21:01:49 -07:00
Krrish Dholakia
5ff74f90ad bump: version 1.40.19 → 1.40.20 2024-06-20 20:54:29 -07:00
Krish Dholakia
e7e7b0e265
Merge pull request #4328 from BerriAI/litellm_proxy_testing
test(test_python_38.py): add coverage for non-gen settings config.yaml flow
2024-06-20 20:46:46 -07:00
Krrish Dholakia
46da517cdf test(test_python_38.py): add longer delay 2024-06-20 20:42:32 -07:00
Krrish Dholakia
9b5aa90bb7 test(test_python_38.py): add relevant installs 2024-06-20 20:39:59 -07:00