Commit Graph

15531 Commits

Author SHA1 Message Date
Ishaan Jaff
48a773845b Update prompt_injection.md 2024-08-01 18:06:40 -07:00
Ishaan Jaff
1a598ff075 ci/cd - anyscale discontinued their API endoints - skip test 2024-08-01 18:06:40 -07:00
Ishaan Jaff
91d1ced313 fix model prices formatting 2024-08-01 18:06:40 -07:00
David Manouchehri
beef20ac1b Add new model for gemini-1.5-pro-exp-0801. 2024-08-01 18:06:40 -07:00
Ishaan Jaff
5449013e83 bump: version 1.42.8 → 1.42.9 2024-08-01 18:06:40 -07:00
Ishaan Jaff
98c8409e02 fix test_traceparent_not_added_by_default 2024-08-01 18:06:40 -07:00
Ishaan Jaff
70a4c15365 docs dbrx 2024-08-01 18:06:40 -07:00
Ishaan Jaff
b6c26f315f docs add new dbrx models 2024-08-01 18:06:40 -07:00
Ishaan Jaff
63e40fe68f add correct context window 2024-08-01 18:06:40 -07:00
Ishaan Jaff
50f67673c2 add new dbrx models 2024-08-01 18:06:40 -07:00
Ishaan Jaff
cfba52349f docs gcs buckets 2024-08-01 18:06:40 -07:00
lowjiansheng
3fa5504b4a update helm chart 2024-08-01 18:06:40 -07:00
Ishaan Jaff
99a4eff31c enforce premium user cheks on gcs bucket 2024-08-01 18:06:40 -07:00
Ishaan Jaff
53a4e6a2ba docs logging to GCS 2024-08-01 18:06:40 -07:00
Ishaan Jaff
74e1e63704 docs setting service accounts 2024-08-01 18:06:40 -07:00
Ishaan Jaff
88eca121d2 init gcs using gcs_bucket 2024-08-01 18:06:40 -07:00
Ishaan Jaff
07d8e243ac docs using gcs 2024-08-01 18:06:40 -07:00
Ishaan Jaff
bbd268e98f fix type errors 2024-08-01 18:06:40 -07:00
Ishaan Jaff
21192b7de9 delete object from gcs 2024-08-01 18:06:40 -07:00
Ishaan Jaff
6e9f84f161 test writing logs to GCS bucket 2024-08-01 18:06:40 -07:00
Ishaan Jaff
539447e1a9 feat gcs bucket log payload 2024-08-01 18:06:40 -07:00
Ishaan Jaff
186c3ccc07 add better debugging statements for vertex logging 2024-08-01 18:06:40 -07:00
Ishaan Jaff
6b8d3a745e basic gcs logging test 2024-08-01 18:06:40 -07:00
Krrish Dholakia
6e163d3c8a fix(vertex_ai_partner.py): add /chat/completion codestral support
Closes https://github.com/BerriAI/litellm/issues/4984
2024-08-01 18:06:40 -07:00
Krrish Dholakia
f04160df46 fix(google.py): fix cost tracking for vertex ai mistral models 2024-08-01 18:06:40 -07:00
Krrish Dholakia
bdcf8f6919 build(model_prices_and_context_window.json): add mistral nemo latest to model cost map 2024-08-01 18:06:40 -07:00
Krrish Dholakia
e163914b57 fix(databricks.py): fix error handling 2024-08-01 18:06:40 -07:00
Krrish Dholakia
45cd05ad54 fix: add type hints for APIError and AnthropicError status codes
Fixes https://github.com/BerriAI/litellm/issues/5000
2024-08-01 18:06:40 -07:00
Krrish Dholakia
0300690bd6 fix: fix linting errors 2024-08-01 17:35:05 -07:00
Krrish Dholakia
28c12e6702 fix(utils.py): fix togetherai streaming cost calculation 2024-08-01 15:03:08 -07:00
Krrish Dholakia
ca0a0bed46 fix(utils.py): fix anthropic streaming usage calculation
Fixes https://github.com/BerriAI/litellm/issues/4965
2024-08-01 14:45:54 -07:00
Krrish Dholakia
aad0bbb08c fix(cost_calculator.py): respect litellm.suppress_debug_info for cost calc
Fixes https://github.com/BerriAI/litellm/issues/4818#issuecomment-2263795765
2024-08-01 12:27:09 -07:00
Ishaan Jaff
dce8e3efb8 testing fix - skip rate limit errors from anthropic api 2024-08-01 12:12:50 -07:00
Ishaan Jaff
bae8be340e docs enterprise 2024-08-01 12:10:19 -07:00
Ishaan Jaff
81cd217847 docs enterprise feature 2024-08-01 12:05:49 -07:00
Ishaan Jaff
c494d8ac9a docs enterprise feature 2024-08-01 12:05:38 -07:00
Ishaan Jaff
220b839693 docs - team based logging 2024-08-01 11:58:40 -07:00
Ishaan Jaff
5c810ec326
Merge pull request #4997 from BerriAI/litellm_otel_fail_handler
[Fix-Proxy] Log attributes on failed LLM calls
2024-08-01 11:57:45 -07:00
Ishaan Jaff
c87f97bf6d
Merge pull request #4995 from BerriAI/litellm_otel_fwd_traceparent
[Fix-OTEL Proxy] Only forward traceparent to llm api when `litellm.forward_traceparent_to_llm_provider=True`
2024-08-01 11:57:35 -07:00
Ishaan Jaff
96af712605 fix _handle_failure for otel 2024-08-01 11:12:31 -07:00
Ishaan Jaff
cc9a597d37 ui new build 2024-08-01 09:59:24 -07:00
Ishaan Jaff
457436e12e ui fix entering custom model names for azure 2024-08-01 09:58:37 -07:00
Krrish Dholakia
d02d3d9712 build(model_prices_and_context_window.json): add azure gpt-4o-mini regional + global standard pricing to model cost map 2024-08-01 09:44:40 -07:00
Ishaan Jaff
4a39006b30 forward_traceparent_to_llm_provider 2024-08-01 09:40:45 -07:00
Ishaan Jaff
d12578e4ea test_traceparent_not_added_by_default 2024-08-01 09:36:09 -07:00
Krrish Dholakia
b6b86b2df4 fix(anthropic.py): respect timeouts
Fixes https://github.com/BerriAI/litellm/pull/4994
2024-08-01 09:16:19 -07:00
Ishaan Jaff
34838a29f9
Merge pull request #4989 from ec2ainun/fix/proxy-vertex-path
fix: support vertex filepath on proxy litellm_params definition
2024-08-01 09:15:24 -07:00
Ishaan Jaff
b8fa4a48d9 docs add info on forward_traceparent_to_llm_provider 2024-08-01 09:12:40 -07:00
Ishaan Jaff
70c836623d use itellm.forward_traceparent_to_llm_provider 2024-08-01 09:05:13 -07:00
Krrish Dholakia
c6fd2fef9b bump: version 1.42.7 → 1.42.8 2024-07-31 21:41:51 -07:00