Zihao Li
f16d0c06fd
Add backward compatibility to support xml tool use for bedrock and vertex
2024-04-06 00:34:33 +08:00
Ishaan Jaff
5ce80d82d3
fix support azure/mistral models
2024-04-05 09:32:39 -07:00
Krrish Dholakia
f0c4ff6e60
fix(vertex_ai_anthropic.py): support streaming, async completion, async streaming for vertex ai anthropic
2024-04-05 09:27:48 -07:00
Ishaan Jaff
ab60d7c8fb
docs azure ai command-r plust
2024-04-05 09:24:27 -07:00
Ishaan Jaff
cfe358abaa
simplify calling azure/commmand-r-plus
2024-04-05 09:18:11 -07:00
Ishaan Jaff
1ba1c84d83
skip vertex test for this PR
2024-04-05 09:06:15 -07:00
Ishaan Jaff
b25db0443a
docs - using command r on azure
2024-04-05 09:04:38 -07:00
Ishaan Jaff
5d196ff300
test - azure/command-r-plus
2024-04-05 08:56:05 -07:00
Ishaan Jaff
71352b1b36
fix add azure/command-r-plus
2024-04-05 08:53:24 -07:00
Ishaan Jaff
65b1a7be73
add azure command_r_plust
2024-04-05 08:51:39 -07:00
lazyhope
596d50a72a
Merge branch 'BerriAI:main' into anthropic-tools-use-2024-04-04
2024-04-05 23:51:03 +08:00
Caixiaopig
3d96e810b0
Updating the default Anthropic Officlal Claude 3 max_tokens to 4096
...
fix bug
2024-04-05 09:45:57 -05:00
Zihao Li
342073c212
Clean up imports of XML processing functions
2024-04-05 22:36:18 +08:00
Krish Dholakia
eb34306099
Merge pull request #2665 from BerriAI/litellm_claude_vertex_ai
...
[WIP] feat(vertex_ai_anthropic.py): Add support for claude 3 on vertex ai
2024-04-05 07:06:04 -07:00
Krish Dholakia
4ce8227e70
Merge pull request #2841 from Manouchehri/nuke-gemini-1.5-pro-vision
...
Fix: Remove non-existent gemini-1.5-pro-vision model.
2024-04-05 07:03:38 -07:00
Zihao Li
71fdf31790
Refactor tool result submission and tool invoke conversion
2024-04-05 17:11:35 +08:00
Zihao Li
d2cf9d2cf1
Move tool definitions from system prompt to parameter and refactor tool calling parse
2024-04-05 16:01:40 +08:00
Caixiaopig
09463bc584
Updating the default Anthropic Claude 3 max_tokens to 4096
...
The default value of max_tokens used to be 256. If the client does not set a larger value, the model's output may be truncated, so the default value has been changed to 4096. This value is also the maximum output value described in the official interface.
see: https://docs.anthropic.com/claude/reference/messages_post
2024-04-05 14:44:40 +08:00
Krrish Dholakia
b0d80de14d
docs(vertex.md): fix import routes
2024-04-04 21:32:44 -07:00
Krrish Dholakia
003cd3b102
docs(vertex.md): add tutorial for using vertex ai with gcp service account
2024-04-04 21:28:28 -07:00
Ishaan Jaff
d313f5bd61
Merge pull request #2847 from themrzmaster/feat/add_command_r_plus
...
Add command-r-plus
2024-04-04 21:06:42 -07:00
Krrish Dholakia
e1aa536ea6
bump: version 1.34.26 → 1.34.27
2024-04-04 20:02:41 -07:00
Krish Dholakia
b5f74bf6b7
Merge pull request #2851 from BerriAI/litellm_add_model_api_fix
...
feat(ui): add models via ui
2024-04-04 19:43:58 -07:00
Krish Dholakia
24e2535441
Merge branch 'main' into litellm_add_model_api_fix
2024-04-04 19:43:52 -07:00
Krrish Dholakia
1ee78c39e9
fix(proxy_server.py): skip to next model if invalid model (raise logger.error)
2024-04-04 19:22:17 -07:00
Krrish Dholakia
fbfcd57798
fix(proxy_server.py): fix linting issue
2024-04-04 19:15:57 -07:00
Krrish Dholakia
e3c2bdef4d
feat(ui): add models via ui
...
adds ability to add models via ui to the proxy. also fixes additional bugs around new /model/new endpoint
2024-04-04 18:56:20 -07:00
Ishaan Jaff
eaf81ed31c
fix github stable releases
2024-04-04 18:26:47 -07:00
Ishaan Jaff
ab368fcfc7
fix use stable / latest tags correctly
2024-04-04 18:15:53 -07:00
Ishaan Jaff
28d55cb511
stable releases
2024-04-04 18:07:36 -07:00
Ishaan Jaff
66f579f923
stable releases - ci/cd
2024-04-04 18:06:17 -07:00
Ishaan Jaff
280a3d580b
set release type
2024-04-04 18:02:37 -07:00
Ishaan Jaff
0dd7ab44ed
set release type on releases
2024-04-04 18:00:22 -07:00
Ishaan Jaff
7f50b80917
(ci/cd) aws suspended account
2024-04-04 17:43:16 -07:00
Ishaan Jaff
0b748f2eb0
ui - new build
2024-04-04 17:36:26 -07:00
Ishaan Jaff
31e98aa90e
Merge pull request #2850 from BerriAI/litellm_track_cost_tag
...
[UI] Show Usage Per Tag
2024-04-04 17:31:36 -07:00
Ishaan Jaff
9663ee56f2
ui - view spend by tag
2024-04-04 17:30:28 -07:00
Ishaan Jaff
1f7a741e28
show cost per tag on ui
2024-04-04 17:20:23 -07:00
Ishaan Jaff
73fce02392
ui - view spend per tag
2024-04-04 17:18:01 -07:00
Ishaan Jaff
ac5507bd84
ui show spend per tag
2024-04-04 16:57:45 -07:00
Nandesh Guru
0e9b1f5247
Greenscale Integration
...
Adding logger for Greenscale
2024-04-04 15:38:51 -07:00
Krrish Dholakia
2472311a3f
test(test_caching.py): skip test - aws suspended account
...
will need to recreate these objects on a new aws account
2024-04-04 15:07:19 -07:00
Krrish Dholakia
2236f283fe
fix(router.py): handle id being passed in as int
2024-04-04 14:23:10 -07:00
Ishaan Jaff
12e5118367
Merge pull request #2846 from BerriAI/litellm_docs_delete_cache_keys
...
docs - `delete` cache keys
2024-04-04 14:07:50 -07:00
Krrish Dholakia
2e40ab959d
test(test_router.py): fix casting
2024-04-04 13:54:16 -07:00
Krrish Dholakia
4dbb46cf42
docs(vertex.md): add docs on setting google_application_credentials
2024-04-04 13:49:03 -07:00
Krrish Dholakia
1441fccf9a
fix(main.py): trigger new build
2024-04-04 13:36:21 -07:00
Krrish Dholakia
c372c873a0
test(test_router.py): fix test to check cast
2024-04-04 13:32:50 -07:00
lucca
be265fbb15
initial
2024-04-04 16:58:51 -03:00
Ishaan Jaff
9e9b617934
docs - delete cache keys
2024-04-04 12:20:14 -07:00
