Commit Graph

16083 Commits

Author SHA1 Message Date
Ishaan Jaff
55c2d7cb0c add groq through admin ui 2024-08-08 23:25:27 -07:00
Ishaan Jaff
716ee54ac5 ui show litellm model name 2024-08-08 23:25:27 -07:00
Ishaan Jaff
b9699d1746 bump: version 1.43.3 → 1.43.4 2024-08-08 23:25:27 -07:00
Ishaan Jaff
6f5b9a3970 docs vertex context caching 2024-08-08 23:25:27 -07:00
Ishaan Jaff
21fc7a7db4 docs vertex 2024-08-08 23:25:27 -07:00
Ishaan Jaff
6808aad6df docs cachedContent endpoint 2024-08-08 23:25:27 -07:00
Ishaan Jaff
65967d717c auto update the model in cachedContents request 2024-08-08 23:25:27 -07:00
Ishaan Jaff
7b0a50d188 add native cachedContents endpoint 2024-08-08 23:25:27 -07:00
Ishaan Jaff
5534499c08 doc on using litellm proxy with vertex ai content caching 2024-08-08 23:25:27 -07:00
Ishaan Jaff
d5c10778ff add example using litellm proxy with gemini context caching 2024-08-08 23:25:27 -07:00
Krrish Dholakia
37035d90e3 fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag
Relevant to - https://github.com/BerriAI/litellm/issues/5106
2024-08-08 23:25:27 -07:00
Krrish Dholakia
d1d242ae0d test: skip flaky langsmith tests 2024-08-08 23:25:27 -07:00
Krrish Dholakia
323192d756 test(test_langsmith.py): fix test 2024-08-08 23:25:27 -07:00
Krrish Dholakia
6b3ed35787 fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111 2024-08-08 23:25:27 -07:00
Krrish Dholakia
d87078c32d fix(anthropic.py): fix translation 2024-08-08 23:25:27 -07:00
Ishaan Jaff
a8dd9c2550 fix log to otel test 2024-08-08 23:25:27 -07:00
Ishaan Jaff
58e8a85288 docs vertex context caching 2024-08-08 23:25:27 -07:00
Ishaan Jaff
772f75a36a docs vertex 2024-08-08 23:25:27 -07:00
Ishaan Jaff
69cac2fc33 docs cachedContent endpoint 2024-08-08 23:25:27 -07:00
Ishaan Jaff
a061d75af8 auto update the model in cachedContents request 2024-08-08 23:25:27 -07:00
Ishaan Jaff
b911ccba47 add native cachedContents endpoint 2024-08-08 23:25:27 -07:00
Ishaan Jaff
bf38d14201 doc on using litellm proxy with vertex ai content caching 2024-08-08 23:25:27 -07:00
Ishaan Jaff
c723610c59 add example using litellm proxy with gemini context caching 2024-08-08 23:25:27 -07:00
Krrish Dholakia
ec0ea56b8d fix(anthropic.py): fix translation from /v1/messages format to openai format 2024-08-08 23:25:27 -07:00
Krrish Dholakia
b83253be78 fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag
Relevant to - https://github.com/BerriAI/litellm/issues/5106
2024-08-08 23:25:27 -07:00
Krrish Dholakia
bc487a2fac test: skip flaky langsmith tests 2024-08-08 23:25:27 -07:00
Krrish Dholakia
26cd9e8485 test(test_langsmith.py): fix test 2024-08-08 23:25:27 -07:00
Krrish Dholakia
ce4c5f8ab8 fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111 2024-08-08 23:25:27 -07:00
Krrish Dholakia
1d39c0fb7d fix(management_helpers/utils.py): use user_default max_budget, budget duration on new user upsert during team member add
Fixes https://github.com/BerriAI/litellm/issues/5106
2024-08-08 19:14:43 -07:00
Krrish Dholakia
6af9d9d2b3 test(test_proxy_server.py): unit testing to make sure internal user params don't impact admin 2024-08-08 17:59:30 -07:00
Krrish Dholakia
4b40563be3 fix(proxy_server.py): ensure internal_user params only apply to internal_user role 2024-08-08 17:50:29 -07:00
Krrish Dholakia
d1e6dd3551 build(requirements.txt): pin orjson dep 2024-08-08 17:40:16 -07:00
Krrish Dholakia
97d57b8449 fix(proxy_server.py): respect internal_user_budget_duration for sso user 2024-08-08 17:28:28 -07:00
Krrish Dholakia
0bfe9bee54 fix(utils.py): handle anthropic overloaded error 2024-08-08 17:19:12 -07:00
Ishaan Jaff
ebde2b88bb docs vertex context caching 2024-08-08 17:19:12 -07:00
Ishaan Jaff
67059266ca fix use get_file_check_sum 2024-08-08 17:19:12 -07:00
Krrish Dholakia
df7ffb5595 fix(factory.py): handle openai function message having tool call id 2024-08-08 17:19:12 -07:00
Ishaan Jaff
4c9c871125 docs readme 2024-08-08 17:19:12 -07:00
Ishaan Jaff
b2b505611c docs use (LLM Gateway) in some places 2024-08-08 17:19:12 -07:00
Ishaan Jaff
74af2041cc docs vertex ai 2024-08-08 17:19:12 -07:00
Ishaan Jaff
a1a11b2e08 add default_vertex_config 2024-08-08 17:19:12 -07:00
Ishaan Jaff
de7c667eb5 docs vertex 2024-08-08 17:19:12 -07:00
Ishaan Jaff
c7a3472641 docs cachedContent endpoint 2024-08-08 17:19:12 -07:00
Ishaan Jaff
a0385ff067 auto update the model in cachedContents request 2024-08-08 17:19:12 -07:00
Ishaan Jaff
cf054def4a add native cachedContents endpoint 2024-08-08 17:19:12 -07:00
Ishaan Jaff
0c9f240305 doc on using litellm proxy with vertex ai content caching 2024-08-08 17:19:12 -07:00
Ishaan Jaff
e2e5e46979 add example using litellm proxy with gemini context caching 2024-08-08 17:19:12 -07:00
Ishaan Jaff
3178724579 add tests to make sure correct vertex ai route is used 2024-08-08 17:19:12 -07:00
Ishaan Jaff
ed125b90fd use v1beta1 when using cached_content 2024-08-08 17:19:12 -07:00
Ishaan Jaff
594a71cec3 fix handle case when service logger has no attribute prometheusServicesLogger 2024-08-08 17:19:12 -07:00