Commit Graph

23118 Commits

Author SHA1 Message Date
Krrish Dholakia
f2401d6d5e feat(vertex_ai_anthropic.py): support response_schema for vertex ai anthropic calls
allows passing response_schema for anthropic calls. supports schema validation.
2024-07-18 22:40:35 -07:00
Ishaan Jaff
4bde501ee1 bump: version 1.41.24 → 1.41.25 2024-07-18 22:20:39 -07:00
Ishaan Jaff
154fa64d0a
Merge pull request #4781 from msabramo/liveness-alias-of-liveliness
Alias  `/health/liveliness` as `/health/liveness`
2024-07-18 22:20:09 -07:00
Ishaan Jaff
f04397e19a
Merge pull request #4789 from BerriAI/litellm_router_refactor
[Feat-Router] - Tag based routing
2024-07-18 22:19:18 -07:00
Ishaan Jaff
4dff995932
Merge pull request #4787 from BerriAI/litellm_increase_default_session_time_ui
[Fix] Admin UI - make ui session last 12 hours
2024-07-18 22:19:09 -07:00
Ishaan Jaff
a4338bec11 docs - tag based routing 2024-07-18 22:18:10 -07:00
Krrish Dholakia
a0ac3e3c7d test: fix test 2024-07-18 22:05:47 -07:00
Ishaan Jaff
502b739b33 add tags to metadata 2024-07-18 21:55:53 -07:00
Ishaan Jaff
331e2bbc17 fix test 2024-07-18 21:49:36 -07:00
Ishaan Jaff
ab17aa3919 rename doc 2024-07-18 21:48:24 -07:00
Krish Dholakia
17575b1846
Merge pull request #4784 from BerriAI/litellm_anthropic_response_schema_support
feat(vertex_ai_anthropic.py): support response_schema for vertex ai anthropic calls
2024-07-18 20:40:22 -07:00
Krish Dholakia
967964a51c
Merge branch 'main' into litellm_anthropic_response_schema_support 2024-07-18 20:40:16 -07:00
Ishaan Jaff
f8bdfe7cc3 fix test amazing vertex medlm 2024-07-18 20:35:14 -07:00
Ishaan Jaff
946db012d4 docs free/paid tier 2024-07-18 20:35:14 -07:00
Ishaan Jaff
9f02fb5a33 docs using free, paid tier 2024-07-18 20:35:14 -07:00
Ishaan Jaff
59d599d5fd test adding free / paid tier to metadata 2024-07-18 20:35:14 -07:00
Ishaan Jaff
de8c92b11d feat - enterprise 2024-07-18 20:35:14 -07:00
Ishaan Jaff
0e70b5df14 router - use free paid tier routing 2024-07-18 20:35:14 -07:00
Ishaan Jaff
229b7a6493 helper to get_deployments_for_tier 2024-07-18 20:35:14 -07:00
Ishaan Jaff
dfc674622b litellm router - use free / paid tier 2024-07-18 20:35:14 -07:00
Ishaan Jaff
f3e0a89597 check if using tag based routing 2024-07-18 20:10:45 -07:00
Ishaan Jaff
08adda7091 control using enable_tag_filtering 2024-07-18 19:39:04 -07:00
Krrish Dholakia
96471c145e fix(bedrock_httpx.py): support jamba streaming 2024-07-18 19:36:50 -07:00
Ishaan Jaff
071091fd8c fix use tags as a litellm param 2024-07-18 19:34:45 -07:00
Ishaan Jaff
b6e60d481e fix remove previous code on free/paid tier 2024-07-18 19:24:13 -07:00
Ishaan Jaff
4d0fbfea83 router - refactor to tag based routing 2024-07-18 19:22:09 -07:00
Krrish Dholakia
cece76c4ee feat(bedrock_httpx.py): add ai21 jamba instruct as converse model
initial commit for adding ai21 jamba instruct support through bedrock converse
2024-07-18 18:24:06 -07:00
Ishaan Jaff
51525254e8 fix ui make ui session last 24 hours 2024-07-18 18:22:40 -07:00
Ishaan Jaff
81c77f33b8 fix test amazing vertex medlm 2024-07-18 18:16:00 -07:00
Ishaan Jaff
4b96cd46b2
Merge pull request #4786 from BerriAI/litellm_use_model_tier_keys
[Feat-Enterprise] Use free/paid tiers for Virtual Keys
2024-07-18 18:07:09 -07:00
Krrish Dholakia
b23a633cf1 fix(utils.py): fix status code in exception mapping 2024-07-18 18:04:59 -07:00
Ishaan Jaff
22ef951e0b docs free/paid tier 2024-07-18 18:01:30 -07:00
Ishaan Jaff
d266234cd6 docs using free, paid tier 2024-07-18 18:01:21 -07:00
Krrish Dholakia
e3ca2789df fix(bedrock_httpx.py): cache response stream shape
Fixes https://github.com/BerriAI/litellm/issues/4774
2024-07-18 17:41:31 -07:00
Krrish Dholakia
30d6c1d171 fix(factory.py): handle escape characters in image url
prevents mimetype errors in vertex ai calls
2024-07-18 17:36:58 -07:00
Ishaan Jaff
f6efed06de test adding free / paid tier to metadata 2024-07-18 17:31:02 -07:00
Krrish Dholakia
6d741a5424 docs(json_mode.md): add json mode to docs 2024-07-18 17:20:19 -07:00
Ishaan Jaff
fda5578263 feat - enterprise 2024-07-18 17:15:47 -07:00
Ishaan Jaff
64e38562d9 router - use free paid tier routing 2024-07-18 17:09:42 -07:00
Ishaan Jaff
88cd641089 helper to get_deployments_for_tier 2024-07-18 17:06:06 -07:00
Krrish Dholakia
4d963ab789 feat(vertex_ai_anthropic.py): support response_schema for vertex ai anthropic calls
allows passing response_schema for anthropic calls. supports schema validation.
2024-07-18 16:57:38 -07:00
Ishaan Jaff
007b959460 litellm router - use free / paid tier 2024-07-18 16:55:50 -07:00
reibs
f36c2061eb removed model from replicate registry 2024-07-18 16:47:19 -07:00
Ishaan Jaff
b9d4d67357
Merge pull request #4779 from BerriAI/docs_add_salt_key_docker_compose
Docs -  add `LITELLM_SALT_KEY` to docker compose
2024-07-18 15:28:26 -07:00
Ishaan Jaff
031ea1cbe4
Merge pull request #4782 from BerriAI/litellm_add_gemini-gemma-2-27b-it
[FEAT] -  add Google AI Studio: gemini-gemma-2-27b-it,  gemini-gemma-2-9b-it
2024-07-18 15:19:40 -07:00
Ishaan Jaff
99ffc5d4c3 feat - add gemini-gemma-2-27b-it 2024-07-18 15:18:56 -07:00
Marc Abramowitz
7b1c72e3f4 Alias /health/liveliness as /health/liveness
The latter is the more common term in Kubernetes, so it's nice to support that.
2024-07-18 14:29:32 -07:00
Ishaan Jaff
976cc3f5ea ui - fix typo on referencing base url 2024-07-18 13:36:05 -07:00
Ishaan Jaff
75ca53fab5 fix linting errors on main 2024-07-18 13:32:48 -07:00
Ishaan Jaff
b38f470135 docs on litellm docker compose 2024-07-18 13:08:06 -07:00