ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
17,021 Commits 9 Branches 7 Tags 935 MiB
bd4f63eebf
Commit Graph

17021 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Krrish Dholakia
bd4f63eebf fix(__init__.py): fix import 2024-08-27 19:35:03 -07:00
Krrish Dholakia
a6ce27ca29 feat(batch_embed_content_transformation.py): support google ai studio /batchEmbedContent endpoint 
Allows for multiple strings to be given for embedding
 2024-08-27 19:23:50 -07:00
Krrish Dholakia
bb42146ffe feat(embeddings_handler.py): support async gemini embeddings 2024-08-27 18:31:57 -07:00
Krrish Dholakia
5b29ddd2a6 fix(embeddings_handler.py): initial working commit for google ai studio text embeddings /embedContent endpoint 2024-08-27 18:14:56 -07:00
Krrish Dholakia
77e6da78a1 fix: initial commit 2024-08-27 17:35:56 -07:00
Krrish Dholakia
d29a7087f1 feat(vertex_ai_and_google_ai_studio): Support Google AI Studio Embeddings endpoint 
Closes https://github.com/BerriAI/litellm/issues/5385
 2024-08-27 16:53:11 -07:00
Krrish Dholakia
bd3057e495 test(test_proxy_exception_mapping): loosen assert 2024-08-27 16:14:30 -07:00
Krrish Dholakia
6431af0678 fix(bedrock_httpx.py): support 'Auth' header as extra_header 
Fixes https://github.com/BerriAI/litellm/issues/5389#issuecomment-2313677977
 2024-08-27 16:08:54 -07:00
Krrish Dholakia
1b2f73c220 fix(azure_text.py): fix streaming parsing 2024-08-27 15:52:55 -07:00
Ishaan Jaff
6ab8cbc105
Merge pull request #5391 from BerriAI/litellm_add_ai21_support 
[Feat] Add Vertex  AI21 support
 2024-08-27 15:06:26 -07:00
Krrish Dholakia
d2239e3c52 test(test_router_debug_logs.py): simplify test 2024-08-27 14:47:43 -07:00
Ishaan Jaff
33a3a01949 add mock test for ai21 2024-08-27 14:42:13 -07:00
Krrish Dholakia
deff357c92 fix(router.py): fix aembedding type hints 
Fixes https://github.com/BerriAI/litellm/issues/5383
 2024-08-27 14:29:18 -07:00
Krrish Dholakia
b91e5d3887 fix(openai.py): fix post call error logging for aembedding calls 2024-08-27 14:26:06 -07:00
Ishaan Jaff
3dee98dc47 add jamba-1.5 2024-08-27 14:20:06 -07:00
Krrish Dholakia
d2464052ec docs(bedrock.md): add doc on passing extra headers + custom api endpoints to bedrock 
Closes https://github.com/BerriAI/litellm/issues/5389
 2024-08-27 14:18:41 -07:00
Ishaan Jaff
3c8a19e343 use cost per token for jamba 2024-08-27 14:18:04 -07:00
Ishaan Jaff
5bfacce548 add doc on using jamba-1.5-large 2024-08-27 14:12:38 -07:00
Krrish Dholakia
89ac324676 docs(anthropic.md): cleanup docs 2024-08-27 14:05:39 -07:00
Ishaan Jaff
e9808346a7 add jamba-1.5-mini models 2024-08-27 14:02:02 -07:00
Krrish Dholakia
d43441ae5d fix(anthropic.py): support setting cache control headers, automatically 
Don't require user to manually pass in 'extra_headers' for anthropic cache control usage
 2024-08-27 13:57:03 -07:00
Krrish Dholakia
63adb3f940 fix(azure.py): fix raw response dump 2024-08-27 13:44:38 -07:00
Ishaan Jaff
093f7f15fd add test for test_partner_models_httpx_ai21 2024-08-27 13:36:47 -07:00
Ishaan Jaff
11c175a215 refactor partner models to include ai21 2024-08-27 13:35:22 -07:00
Krrish Dholakia
18731cf42b fix: fix linting errors 2024-08-27 12:14:23 -07:00
Krish Dholakia
415abc86c6
Merge pull request #5358 from BerriAI/litellm_fix_retry_after 
fix retry after - cooldown individual models based on their specific 'retry-after' header
 2024-08-27 11:50:14 -07:00
Krrish Dholakia
18b67a455e test: fix test 2024-08-27 10:46:57 -07:00
Ishaan Jaff
0fca960221 docs langfuse link 2024-08-27 08:14:03 -07:00
Krrish Dholakia
bf81b484c6 fix(sagemaker.py): fix streaming logic 2024-08-27 08:10:47 -07:00
Krrish Dholakia
c7bbfef846 docs(gemini.md): add context caching on google ai studio to docs 2024-08-27 08:02:52 -07:00
Krrish Dholakia
cd7dd2a511 fix(cooldown_cache.py): fix linting errors 2024-08-27 07:40:28 -07:00
Krrish Dholakia
e542475f39 build(config.yml): bump anyio version 2024-08-27 07:37:06 -07:00
Krrish Dholakia
6bfcb431cd fix(asyncify.py): fix linting errors 2024-08-27 07:37:06 -07:00
Krrish Dholakia
8d8c961b50 fix(asyncify.py): fix linting errors 2024-08-27 07:37:06 -07:00
Krrish Dholakia
2cf149fbad perf(sagemaker.py): asyncify hf prompt template check 
leads to 189% improvement in RPS @ 100 users
 2024-08-27 07:37:06 -07:00
Krrish Dholakia
b0f01e5b95 test: fix test 2024-08-27 07:14:14 -07:00
Krish Dholakia
ec2357f1d2
Merge pull request #5384 from miraclebakelaser/fix/cohere-tool-calls-content-field 
fix(factory.py): handle missing 'content' in cohere assistant messages
 2024-08-27 07:13:28 -07:00
miraclebakelaser
97f714d2b0 fix(factory.py): handle missing 'content' in cohere assistant messages 
Update cohere_messages_pt_v2 function to check for 'content' existence
 2024-08-27 19:38:37 +09:00
Krrish Dholakia
3ec8a0d25d fix: fix imports 2024-08-26 22:24:30 -07:00
Krish Dholakia
81e62aec16
Merge pull request #5381 from BerriAI/litellm_gemini_context_caching 
gemini context caching (openai format) support
 2024-08-26 22:22:23 -07:00
Krish Dholakia
08bd4788dc
Merge branch 'main' into litellm_gemini_context_caching 2024-08-26 22:22:17 -07:00
Krrish Dholakia
5aad9d2db7 fix: fix imports 2024-08-26 22:19:01 -07:00
Krrish Dholakia
4868a6cf55 fix: fix unbound var 2024-08-26 22:19:01 -07:00
Krrish Dholakia
0eea01dae9 feat(vertex_ai_context_caching.py): check gemini cache, if key already exists 2024-08-26 22:19:01 -07:00
Krrish Dholakia
b0cc1df2d6 feat(vertex_ai_context_caching.py): support making context caching calls to vertex ai in a normal chat completion call (anthropic caching format) 
Closes https://github.com/BerriAI/litellm/issues/5213
 2024-08-26 22:19:01 -07:00
Krish Dholakia
c503ff435e
Merge pull request #5368 from BerriAI/litellm_vertex_function_support 
feat(vertex_httpx.py): support 'functions' param for gemini google ai studio + vertex ai
 2024-08-26 22:11:42 -07:00
Krrish Dholakia
1a97362b6e fix(types/utils.py): map finish reason to openai compatible 2024-08-26 22:09:02 -07:00
Krish Dholakia
3a6412c9c3
Merge pull request #5376 from BerriAI/litellm_sagemaker_streaming_fix 
fix(sagemaker.py): support streaming for messages api
 2024-08-26 21:36:10 -07:00
Krrish Dholakia
75bb9ff7fe fix: fix imports 2024-08-26 21:36:04 -07:00
Krrish Dholakia
9ba1b78a8f fix(streaming_utils.py): fix generic_chunk_has_all_required_fields 2024-08-26 21:13:02 -07:00