Commit Graph

13940 Commits

Author SHA1 Message Date
Ishaan Jaff
f4521af1fd
Merge pull request #4366 from BerriAI/litellm_fix_in_mem_usage
[Fix-Proxy] Fix in memory caching memory leak
2024-06-27 21:12:14 -07:00
Ishaan Jaff
3bcf9dd9fb
Merge branch 'main' into litellm_fix_in_mem_usage 2024-06-27 21:12:06 -07:00
Ishaan Jaff
413877d1c6 fix pre call utils adding extra headers 2024-06-27 21:03:36 -07:00
Ishaan Jaff
511dd18e4b remove debug print statement 2024-06-27 20:58:29 -07:00
Ishaan Jaff
e776ac8ffc ci/cd run again 2024-06-27 20:25:09 -07:00
Ishaan Jaff
e82b321044 test fix secret detection 2024-06-27 20:20:47 -07:00
Ishaan Jaff
4cffcb5f28 fix error message on v2/model info 2024-06-27 20:20:47 -07:00
Ishaan Jaff
3faf668ac2 fix secret scanner 2024-06-27 20:20:46 -07:00
Ishaan Jaff
1ed2b008f1 add stricter secret detection 2024-06-27 20:20:46 -07:00
Ishaan Jaff
32bd8c0b0e feat - improve secret detection 2024-06-27 20:20:46 -07:00
Ishaan Jaff
758304f5c5 test - test_chat_completion_request_with_redaction 2024-06-27 20:20:46 -07:00
Ishaan Jaff
9b98269f59 fix secret redaction logic 2024-06-27 20:20:46 -07:00
Ishaan Jaff
28109faaff fix raise better error message on reaching failed vertex import 2024-06-27 20:20:46 -07:00
Ishaan Jaff
b95dd09a3f docs - fix model name on claude-3-5-sonnet-20240620 anthropic 2024-06-27 20:20:46 -07:00
Daniel Liden
01a6077ca5 undoes changes to proxy yaml api key/base 2024-06-27 20:20:46 -07:00
Daniel Liden
50bafd7af6 Update databricks.md
fixes a couple of examples to use correct endpoints/point to correct models
2024-06-27 20:20:46 -07:00
Daniel Liden
a975486df0 Update databricks.md
updates some references to predibase to refer to Databricks
2024-06-27 20:20:46 -07:00
Krrish Dholakia
77b78f6630 bump: version 1.40.28 → 1.40.29 2024-06-27 20:20:46 -07:00
Krrish Dholakia
345e0dfa8f fix(utils.py): handle arguments being None
Fixes https://github.com/BerriAI/litellm/issues/4440
2024-06-27 20:20:46 -07:00
Krrish Dholakia
6efe247708 fix(utils.py): add new special token for cleanup 2024-06-27 20:20:46 -07:00
Krrish Dholakia
8142891a5c docs(openai_compatible.md): doc on disabling system messages 2024-06-27 20:20:46 -07:00
Ishaan Jaff
c4f68851c0 ci/cd run again 2024-06-27 20:20:46 -07:00
Ishaan Jaff
b29b3fb3f4 bump: version 1.40.27 → 1.40.28 2024-06-27 20:20:46 -07:00
Ishaan Jaff
7f0c776246 fix gemini test 2024-06-27 20:20:46 -07:00
Ishaan Jaff
c27bfd76b6 vertex testing 2024-06-27 20:20:46 -07:00
Ishaan Jaff
76490690a1 add codechat-bison@latest 2024-06-27 20:20:46 -07:00
Ishaan Jaff
c9a27f9d9e add code-gecko-latest 2024-06-27 20:20:46 -07:00
Ishaan Jaff
d30ce40768 add code-bison 2024-06-27 20:20:46 -07:00
Ishaan Jaff
69b70121ef add chat-bison-32k@002 2024-06-27 20:20:46 -07:00
Ishaan Jaff
9441f75656 add vertex text-bison 2024-06-27 20:20:46 -07:00
Ishaan Jaff
0afe0a5466 fix gemini ultra info 2024-06-27 20:20:46 -07:00
Ishaan Jaff
80e520c8f0 add gemini-1.0-ultra-001 2024-06-27 20:20:46 -07:00
Ishaan Jaff
d499c4c767 add source for codestral pricing 2024-06-27 20:20:46 -07:00
Ishaan Jaff
df97848195 add codestral pricing 2024-06-27 20:20:46 -07:00
Ishaan Jaff
b9bc16590d forward otel traceparent in request headers 2024-06-27 20:20:46 -07:00
Ishaan Jaff
734d79ce80 test volcengine 2024-06-27 20:20:46 -07:00
Ishaan Jaff
124b80fc73 docs - volcengine 2024-06-27 20:20:46 -07:00
Ishaan Jaff
9d49747372 add initial support for volcengine 2024-06-27 20:20:46 -07:00
Ishaan Jaff
348a8cffc2 add volcengine as provider to litellm 2024-06-27 20:20:46 -07:00
Ishaan Jaff
9fb0a9cd0a fix - reuse client initialized on proxy config 2024-06-27 20:20:46 -07:00
Krrish Dholakia
d1cb4a195c fix(bedrock_httpx.py): Fix https://github.com/BerriAI/litellm/issues/4415 2024-06-27 20:20:46 -07:00
Ishaan Jaff
1821b32491 fix handle_openai_chat_completion_chunk 2024-06-27 20:20:46 -07:00
Ishaan Jaff
31905a69da Revert "Add return type annotations to util types"
This reverts commit faef56fe69.
2024-06-27 20:20:46 -07:00
Ishaan Jaff
e7b315af4c test_spend_logs_payload_whisper 2024-06-27 20:20:46 -07:00
Ishaan Jaff
c0c715b905 fix cost tracking for whisper 2024-06-27 20:20:46 -07:00
Josh Learn
ebc22a7593 Add return type annotations to util types 2024-06-27 20:20:46 -07:00
Ishaan Jaff
9d371f84e5 fix add ollama codegemma 2024-06-27 20:20:46 -07:00
Ishaan Jaff
612c950b15 test - fireworks ai param mapping 2024-06-27 20:20:46 -07:00
Ishaan Jaff
06a329a53a fix + test fireworks ai param mapping for tools 2024-06-27 20:20:46 -07:00
Ishaan Jaff
181986a684 test fireworks ai tool calling 2024-06-27 20:20:46 -07:00