Commit Graph

14015 Commits

Author SHA1 Message Date
Krrish Dholakia
dc0218d34c build(pyproject.toml): remove ijson dep. add jsonschema dep. 2024-06-29 19:24:00 -07:00
Krrish Dholakia
b78043f904 test(test_amazing_vertex_completion.py): reduce vertex tests - quota exhaustion 2024-06-29 19:14:19 -07:00
Krrish Dholakia
7670c5bd13 fix(utils.py): add 'enforce_validation' param 2024-06-29 19:12:00 -07:00
Krrish Dholakia
69d06cfbcd fix(utils.py): fix passing additional param to post-call processing 2024-06-29 18:58:44 -07:00
Krrish Dholakia
b699d9a8b9 fix(utils.py): support json schema validation 2024-06-29 15:05:52 -07:00
Krrish Dholakia
05dfc63b88 feat(vertex_httpx.py): support the 'response_schema' param for older vertex ai models - pass as prompt (user-controlled)
if 'response_schema' is not supported for vertex model (e.g. gemini-1.5-flash) pass in prompt
2024-06-29 13:25:27 -07:00
Krrish Dholakia
5718d1e205 fix(utils.py): new helper function to check if provider/model supports 'response_schema' param 2024-06-29 12:40:29 -07:00
Krrish Dholakia
be8a6377f6 docs(input.md): add vertex ai json mode to mapped input params 2024-06-29 11:51:52 -07:00
Krrish Dholakia
3dea5dce86 docs(vertex.md): add 'response_schema' param to vertex docs 2024-06-29 11:48:45 -07:00
Krrish Dholakia
8d9352258f bump: version 1.41.0 → 1.41.1 2024-06-29 11:36:15 -07:00
Krrish Dholakia
e73e9e12bc fix(vertex_httpx.py): support passing response_schema to gemini 2024-06-29 11:33:19 -07:00
Krrish Dholakia
e1f84b1bd9 docs(vertex.md): add vertex pdf example to docs 2024-06-29 09:23:21 -07:00
Krrish Dholakia
4f32f283a3 fix(vertex_httpx.py): fix streaming for cloudflare proxy calls 2024-06-29 09:09:56 -07:00
Ishaan Jaff
2a7592d026 doc - pass through auth 2024-06-29 09:09:18 -07:00
Ishaan Jaff
0d62553afa doc - setting auth on pass through endpoints 2024-06-29 09:09:18 -07:00
Ishaan Jaff
6043155a8b
Merge pull request #4469 from BerriAI/litellm_add_auth_passthrough_endpoints
feat - Allow adding authentication on pass through endpoints
2024-06-29 08:46:11 -07:00
Ishaan Jaff
c578816434 feat - setting up auth on pass through endpoint 2024-06-29 08:38:44 -07:00
Ishaan Jaff
dd71bf0f83
Merge pull request #4468 from BerriAI/doc_add_spec_pass_through
[Doc] Add spec on pass through endpoints
2024-06-29 08:29:09 -07:00
Ishaan Jaff
f961b41046 doc add spec for pass through 2024-06-29 08:03:51 -07:00
Krrish Dholakia
555c02dbc3 docs(enterprise.md): add links 2024-06-28 22:58:47 -07:00
Krrish Dholakia
062ccf35ad docs(secret.md): update docs 2024-06-28 22:58:15 -07:00
Krrish Dholakia
40e4ad52a4 docs(aws-key-manager): add key decryption with aws key manager to docs 2024-06-28 22:56:22 -07:00
Krrish Dholakia
8571cb45e8 fix(http_handler.py): add retry logic for httpx.ConnectError 2024-06-28 22:35:26 -07:00
Krrish Dholakia
831745e710 test(test_streaming.py): try-except replicate api instability 2024-06-28 22:19:44 -07:00
Krrish Dholakia
c9a424d28d fix(router.py): fix get_router_model_info for azure models 2024-06-28 22:13:29 -07:00
Krrish Dholakia
9556bfda81 fix(aws_secret_manager.py): fix typing error 2024-06-28 21:56:14 -07:00
Krrish Dholakia
849f7ca590 bump: version 1.40.31 → 1.40.32 2024-06-28 21:52:07 -07:00
Krrish Dholakia
ca04244a0a fix(utils.py): correctly raise openrouter error 2024-06-28 21:50:21 -07:00
Krrish Dholakia
d10912beeb fix(main.py): pass in openrouter as custom provider for openai client call
Fixes https://github.com/BerriAI/litellm/issues/4414
2024-06-28 21:26:42 -07:00
Krish Dholakia
d0c89ddbe3
Merge pull request #4437 from BerriAI/litellm_aws_kms_decryption
fix(initial-commit): decrypts aws keys in entrypoint.sh
2024-06-28 21:10:52 -07:00
Ishaan Jaff
1ee18ce671 ci/cd run again 2024-06-28 18:05:03 -07:00
Ishaan Jaff
71890609ff fix gemini tool calling issue 2024-06-28 18:03:33 -07:00
Ishaan Jaff
4bd3569dc5
Merge pull request #4465 from BerriAI/litellm_pass_through_langfuse_requests
[Feat] - Proxy support Passing through Langfuse requests
2024-06-28 17:56:50 -07:00
Ishaan Jaff
c6c2617d70 docs - pass through langfuse requests on proxy 2024-06-28 17:53:13 -07:00
Ishaan Jaff
bc1c96ca35 pass through langfuse "/api/public/ingestion" 2024-06-28 17:29:11 -07:00
Ishaan Jaff
40d9278dcb test - pass through langfuse requests 2024-06-28 17:28:21 -07:00
Ishaan Jaff
6af1293384 feat - pass through langfuse requests 2024-06-28 17:27:13 -07:00
Ishaan Jaff
d172a3ef6b fix python3.8 install 2024-06-28 16:58:57 -07:00
Ishaan Jaff
f38854e148
Merge pull request #4464 from BerriAI/litellm_return_lakera_exception_in_response
[Enterprise] Return Raw response from Lakera in failed responses
2024-06-28 16:56:59 -07:00
Ishaan Jaff
d0d1efcbdf
Merge pull request #4463 from BerriAI/docs_create_pass_through_routes_litellm_proxy
Docs create pass through routes litellm proxy (tutorial setup cohere Re-Rank Endpoint)
2024-06-28 16:55:44 -07:00
Ishaan Jaff
1980a07f32 fix test custom callback router 2024-06-28 16:54:28 -07:00
Krrish Dholakia
b78dd6416a fix(prisma_migration.py): support decrypting variables in a python script 2024-06-28 16:31:37 -07:00
Ishaan Jaff
0223e52b21 test - lakera ai detection 2024-06-28 16:14:26 -07:00
Ishaan Jaff
e2046bd59c feat - laker return orig response from lakera api 2024-06-28 16:13:44 -07:00
Krrish Dholakia
b84d335624 fix(proxy_cli.py): run aws kms decrypt before starting proxy server 2024-06-28 16:03:56 -07:00
Ishaan Jaff
ac066462df docs - add pass through routes on litelm proxy 2024-06-28 15:55:29 -07:00
Ishaan Jaff
8f2931937a fix use os.environ/ vars for pass through endpoints 2024-06-28 15:30:31 -07:00
Krrish Dholakia
c151a1d244 fix(http_handler.py): raise more detailed http status errors 2024-06-28 15:12:38 -07:00
Ishaan Jaff
954c6ec9ed fix support pass through endpoints 2024-06-28 15:06:51 -07:00
Ishaan Jaff
f52cc18adb feat - support pass through endpoints 2024-06-28 15:03:21 -07:00