Ishaan Jaff
|
4d5b4a5293
|
add stream_options to text_completion
|
2024-05-09 08:35:35 -07:00 |
|
Ishaan Jaff
|
0b1885ca99
|
Merge pull request #3537 from BerriAI/litellm_support_stream_options_param
[Feat] support `stream_options` param for OpenAI
|
2024-05-09 08:34:08 -07:00 |
|
Hannes Burrichter
|
d9f5e56054
|
Add parent_observation_id parameter to Langfuse integration
|
2024-05-09 17:28:27 +02:00 |
|
Kade Heckel
|
54c57450ab
|
Update model_prices_and_context_window.json
fixed typo with ollama/llama3 token cost (now set to 0)
|
2024-05-09 16:03:22 +01:00 |
|
Krrish Dholakia
|
4cfd988529
|
fix(get_api_base): fix get_api_base to handle model with alias
|
2024-05-09 08:01:17 -07:00 |
|
Ishaan Jaff
|
dfd6361310
|
fix completion vs acompletion params
|
2024-05-09 07:59:37 -07:00 |
|
Krish Dholakia
|
4c8787f896
|
Merge pull request #3546 from BerriAI/revert-3479-feature/watsonx-integration
Revert "Add support for async streaming to watsonx provider "
|
2024-05-09 07:44:32 -07:00 |
|
Krish Dholakia
|
8015bc1c47
|
Revert "Add support for async streaming to watsonx provider "
|
2024-05-09 07:44:15 -07:00 |
|
Merlinvt
|
265d777894
|
fixes 2
|
2024-05-09 15:27:14 +02:00 |
|
Merlinvt
|
ccdd2046af
|
fixes
|
2024-05-09 15:20:32 +02:00 |
|
Merlinvt
|
fc51a3631e
|
add additional models from openrouter
|
2024-05-09 15:16:34 +02:00 |
|
Kade Heckel
|
615a4760af
|
Updated docs for Ollama.
|
2024-05-09 12:29:01 +01:00 |
|
Kade Heckel
|
256107c999
|
Added Ollama LLMs for LLaMa and Mistral
|
2024-05-09 12:06:51 +01:00 |
|
Kade Heckel
|
dde2e3249a
|
Update model_prices_and_context_window.json
Added Mistral and Mixtral Chat entries for Ollama.
|
2024-05-09 11:01:25 +01:00 |
|
Krish Dholakia
|
66a1b581e5
|
Merge pull request #3536 from BerriAI/litellm_region_based_routing
feat(proxy_server.py): add CRUD endpoints for 'end_user' management
|
2024-05-08 22:23:40 -07:00 |
|
Krish Dholakia
|
8ad979cdfe
|
Merge branch 'main' into litellm_region_based_routing
|
2024-05-08 22:19:51 -07:00 |
|
Krish Dholakia
|
3f13251241
|
Merge pull request #3479 from simonsanvil/feature/watsonx-integration
Add support for async streaming to watsonx provider
|
2024-05-08 22:19:05 -07:00 |
|
Krrish Dholakia
|
3d18897d69
|
feat(router.py): enable filtering model group by 'allowed_model_region'
|
2024-05-08 22:10:17 -07:00 |
|
Ishaan Jaff
|
e7e54772ae
|
docs include stream_options param
|
2024-05-08 21:57:25 -07:00 |
|
Ishaan Jaff
|
80ca011a64
|
support stream_options
|
2024-05-08 21:53:33 -07:00 |
|
Ishaan Jaff
|
f2965660dd
|
test openai stream_options
|
2024-05-08 21:52:39 -07:00 |
|
Ishaan Jaff
|
1042051602
|
support stream_options for chat completion models
|
2024-05-08 21:52:25 -07:00 |
|
Ishaan Jaff
|
edb10198ef
|
feat - add stream_options support litellm
|
2024-05-08 21:25:40 -07:00 |
|
Ishaan Jaff
|
b5db045624
|
bump: version 1.36.3 → 1.36.4
|
2024-05-08 19:49:35 -07:00 |
|
Krrish Dholakia
|
db666b01e5
|
feat(proxy_server.py): add CRUD endpoints for 'end_user' management
allow admin to specify region + default models for end users
|
2024-05-08 18:50:36 -07:00 |
|
Ishaan Jaff
|
dea4a081c7
|
ui - new build
|
2024-05-08 18:45:54 -07:00 |
|
Ishaan Jaff
|
b15c1c907a
|
Merge pull request #3530 from BerriAI/ui_show_spend_end_user
[UI] show `End-User` Usage on Usage Tab
|
2024-05-08 18:36:51 -07:00 |
|
Ishaan Jaff
|
6d955ef457
|
Merge branch 'main' into ui_show_spend_end_user
|
2024-05-08 18:29:25 -07:00 |
|
Ishaan Jaff
|
bcba92e092
|
fix bug filtering keys on usage tab
|
2024-05-08 18:25:28 -07:00 |
|
Ishaan Jaff
|
a38d9e35fd
|
feat - get price by end_user
|
2024-05-08 18:19:27 -07:00 |
|
Ishaan Jaff
|
0260addeac
|
clean up usage tab
|
2024-05-08 18:06:31 -07:00 |
|
Ishaan Jaff
|
f5f5bebe49
|
clean up users page
|
2024-05-08 17:58:10 -07:00 |
|
Ishaan Jaff
|
644738dafb
|
usage - filter by keys
|
2024-05-08 17:57:28 -07:00 |
|
Ishaan Jaff
|
081e8732dc
|
ui - cleanup view users tab
|
2024-05-08 17:34:44 -07:00 |
|
Ishaan Jaff
|
08d37e1b0e
|
ui - filter usage by day
|
2024-05-08 17:34:30 -07:00 |
|
Ishaan Jaff
|
c7037c20ea
|
fix pass startTime and endTime on Users Usage tab
|
2024-05-08 17:26:46 -07:00 |
|
Ishaan Jaff
|
b99a6717af
|
fix - startTime, endTime in GlobalEndUsersSpend
|
2024-05-08 17:05:09 -07:00 |
|
Ishaan Jaff
|
1eea4d1c90
|
fix /global/spend/end_users
|
2024-05-08 17:03:38 -07:00 |
|
Ishaan Jaff
|
faab704d28
|
update global/spend/end_users
|
2024-05-08 17:03:09 -07:00 |
|
Ishaan Jaff
|
41a4a06389
|
Merge pull request #3534 from BerriAI/litellm_fix_cost_calc_bedrock
[Fix] `litellm.completion_cost(model="bedrock/anthropic.claude-instant-v1"..)`
|
2024-05-08 16:59:46 -07:00 |
|
Krish Dholakia
|
ce7e64609f
|
Merge pull request #3535 from BerriAI/litellm_version_response_headers
feat(proxy_server.py): return litellm version in response headers
|
2024-05-08 16:34:44 -07:00 |
|
Krrish Dholakia
|
6575143460
|
feat(proxy_server.py): return litellm version in response headers
|
2024-05-08 16:00:08 -07:00 |
|
Ishaan Jaff
|
33d6caa889
|
fix completion cost test
|
2024-05-08 15:51:30 -07:00 |
|
Ishaan Jaff
|
282b8d0ae4
|
test bedrock pricing
|
2024-05-08 15:26:53 -07:00 |
|
Ishaan Jaff
|
8348c671a9
|
fix - cost tracking - looking up bedrock pricing
|
2024-05-08 15:25:52 -07:00 |
|
Krrish Dholakia
|
80378966a0
|
build: add azure resource template
|
2024-05-08 15:24:58 -07:00 |
|
frob
|
b93c00abec
|
Merge branch 'BerriAI:main' into ollama-image-handling
|
2024-05-09 00:14:29 +02:00 |
|
Krish Dholakia
|
91bb7cd261
|
Merge pull request #3437 from msabramo/add-engines-model-chat-completions-endpoint
Add `/engines/{model}/chat/completions` endpoint
|
2024-05-08 14:30:39 -07:00 |
|
Ishaan Jaff
|
ba08a82885
|
Merge pull request #3532 from BerriAI/litellm_send_alert_on_cooling_down_deploymeny
[Feat] send alert on cooling down deployment
|
2024-05-08 14:30:31 -07:00 |
|
Ishaan Jaff
|
597b09598c
|
feat - send alert on cooling down a deploymeny
|
2024-05-08 14:14:14 -07:00 |
|