Commit Graph

16719 Commits

Author SHA1 Message Date
Ishaan Jaff
f947cec7fc add test vtx embedding 2024-08-21 17:05:47 -07:00
Ishaan Jaff
e9537c6560 proxy - print embedding request when recieved 2024-08-21 17:00:18 -07:00
Ishaan Jaff
55dfb3b181 add docs using litellm multi modal embeddings 2024-08-21 16:58:47 -07:00
Ishaan Jaff
2c7f5a0d27 fix test test_vertexai_multimodal_embedding 2024-08-21 15:25:13 -07:00
Ishaan Jaff
0e9efb3669 feat add multimodal embeddings on vertex 2024-08-21 15:19:48 -07:00
Ishaan Jaff
35781ab8d5 add multi modal vtx embedding 2024-08-21 15:05:59 -07:00
Ishaan Jaff
7e3dc83c0d add initial support for multimodal_embedding vertex 2024-08-21 14:29:05 -07:00
Ishaan Jaff
dd00cf2a97 add VertexMultimodalEmbeddingRequest type 2024-08-21 14:25:47 -07:00
Ishaan Jaff
9dbd1b089b fix tg ai -deprecated model 2024-08-21 12:14:39 -07:00
Ishaan Jaff
228a0bd6f7 fix qdrant semantic caching test 2024-08-21 12:11:49 -07:00
Ishaan Jaff
428a74be07 fix drant url 2024-08-21 12:09:09 -07:00
Krrish Dholakia
8812da04e3 fix(vertex_httpx.py): Fix tool calling with empty param list
Fixes https://github.com/BerriAI/litellm/issues/5055
2024-08-21 09:03:34 -07:00
Ishaan Jaff
7d0196191f
Merge pull request #5018 from haadirakhangi/main
Qdrant Semantic Caching
2024-08-21 08:50:43 -07:00
Krrish Dholakia
1b6db8359a fix(utils.py): support openrouter streaming
Fixes https://github.com/BerriAI/litellm/issues/5080
2024-08-21 08:48:58 -07:00
Ishaan Jaff
dc261dd07a
Merge pull request #5317 from BerriAI/docs_use_litellm_gcp
docs - use litellm on gcp cloud run
2024-08-21 08:46:17 -07:00
Ishaan Jaff
4fb359edd8 docs - use litellm on gcp cloud run 2024-08-21 08:39:24 -07:00
Krish Dholakia
b2e182a42c
Merge pull request #5314 from thiswillbeyourgithub/fix_missing_openrouter_claude_sonnet_beta
fix/docs: was missing a beta model from openrouter of claude sonnet
2024-08-21 08:31:21 -07:00
Ishaan Jaff
42df6b42c9 fix groq/3.1 reasoning model 2024-08-21 08:22:26 -07:00
Krrish Dholakia
04fc0bd7b3 feat(litellm_pre_call_utils.py): support passing tags/spend logs metadata from keys/team metadata to request 2024-08-21 08:13:36 -07:00
Ishaan Jaff
09aacfc6a8
Merge pull request #5315 from paul-gauthier/main
openrouter/anthropic/claude-3.5-sonnet: supports_assistant_prefill:true
2024-08-21 07:27:18 -07:00
Krrish Dholakia
8406016096 test(test_completion.py): fix gemini rate limit error 2024-08-21 07:17:27 -07:00
Krrish Dholakia
a6ee1e04fe test(test_completion.py): fix test 2024-08-21 07:01:02 -07:00
Paul Gauthier
2432cbc912 openrouter/anthropic/claude-3.5-sonnet: supports_assistant_prefill:true 2024-08-21 05:55:10 -07:00
thiswillbeyourgithub
00f7238c64 fix: was missing openrouter beta model from claude sonnet 2024-08-21 14:45:09 +02:00
Krrish Dholakia
de8eae20d9 docs(caching.md): add doc on enabling caching for just rate limiting features 2024-08-20 22:10:42 -07:00
Krrish Dholakia
a7578e9f2c fix(litellm_logging.py): add stricter check for special param being non none 2024-08-20 21:35:02 -07:00
Krrish Dholakia
8e9117f701 fix(utils.py): ensure consistent cost calc b/w returned header and logged object 2024-08-20 19:01:20 -07:00
Ishaan Jaff
f51f7750c0 bump: version 1.44.0 → 1.44.1 2024-08-20 17:35:06 -07:00
Ishaan Jaff
cea7b73015 enforece guardrails per API Key as enterprise 2024-08-20 17:34:28 -07:00
Ishaan Jaff
225e75cafb
Merge pull request #5309 from BerriAI/litellm_new_guardrails_doc
[Docs]  - v2 Guardrails are now Free / Open Source
2024-08-20 17:29:28 -07:00
Ishaan Jaff
5bd94f64da fix lakera ai tests 2024-08-20 17:28:18 -07:00
Ishaan Jaff
f130ff2587 fix doc guardrails 2024-08-20 17:23:00 -07:00
Ishaan Jaff
22a393769a fix doc lakera ai 2024-08-20 17:20:43 -07:00
Ishaan Jaff
8d2c529e55 support lakera ai category thresholds 2024-08-20 17:19:24 -07:00
Ishaan Jaff
30da63bd4f docs move lakera to free 2024-08-20 16:38:37 -07:00
Ishaan Jaff
befe041f00
Merge pull request #5303 from BerriAI/litellm_make_lakera_free
[Feat-Proxy] Make Guardrails Free / OSS - Lakera AI, Aporia AI 🛡️
2024-08-20 16:33:50 -07:00
Ishaan Jaff
9ac1b639bc
Merge pull request #5306 from BerriAI/litellm_fix_docker-permission_issue
[Fix Docker] Maintain separate docker image for running as non-root user
2024-08-20 16:15:43 -07:00
Krrish Dholakia
5f565806bd fix(litellm_pre_call_utils.py): only pass api_version if set 2024-08-20 16:00:46 -07:00
Ishaan Jaff
48eb4d2730 add docker image for non-root 2024-08-20 15:43:29 -07:00
Ishaan Jaff
143bbe32cb fix dockerfile 2024-08-20 15:38:11 -07:00
Ishaan Jaff
7080e3919d
Merge pull request #5302 from BerriAI/litellm_dont_cooldown_provider_deployments
[Fix Router] - Don't cooldown Default Provider deployment
2024-08-20 15:31:55 -07:00
Ishaan Jaff
1fdebfb0b7 working lakera ai during call hook 2024-08-20 14:39:04 -07:00
Ishaan Jaff
1a142053e5 fix make lakera ai free guardrail 2024-08-20 14:03:22 -07:00
Ishaan Jaff
cad0352f76 rename lakera ai 2024-08-20 13:44:39 -07:00
Ishaan Jaff
042350bd74 rename Aporia Guardrail 2024-08-20 13:42:55 -07:00
Ishaan Jaff
c25a69fa78 test test_using_default_working_fallback 2024-08-20 13:32:55 -07:00
Ishaan Jaff
cae9245b33 fix router retries tests 2024-08-20 13:02:24 -07:00
Ishaan Jaff
c4153f9340 test router fallbacks test 2024-08-20 13:00:00 -07:00
Ishaan Jaff
518be32a98 run test on sync function too 2024-08-20 12:57:22 -07:00
Ishaan Jaff
f6d97c25f2 fix run sync fallbacks 2024-08-20 12:55:36 -07:00