Commit Graph

23118 Commits

Author SHA1 Message Date
Ishaan Jaff
c5020878e4 /spend/calculate use model aliases on this endpoint 2024-06-27 20:20:30 -07:00
Ishaan Jaff
08f83e6392 test - aliases on /spend/calculate 2024-06-27 20:20:30 -07:00
Krrish Dholakia
690c7f6e47 fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
2024-06-27 20:20:30 -07:00
Ishaan Jaff
7a961e8a0b docs control available public routes 2024-06-27 20:20:30 -07:00
Ishaan Jaff
412c1fc541 fix importing litellm 2024-06-27 20:20:29 -07:00
Ishaan Jaff
e7ff5014b1 example cofnig with public routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
fa5eb5c96f add helper to check route_in_additonal_public_routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
556ef8dd18 test - spend/calculate endpoints 2024-06-27 20:20:29 -07:00
Ishaan Jaff
2cb4d845ae feat - refactor /spend/calculate 2024-06-27 20:20:29 -07:00
Ishaan Jaff
bfae8c3da6 example config with public routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
e30410f700 feat - allow user to define public routes 2024-06-27 20:20:29 -07:00
Krrish Dholakia
a087596be0 fix(vertex_httpx.py): Return empty model response for content filter violations 2024-06-27 20:20:29 -07:00
Krrish Dholakia
6f2f89d7b2 fix(vertex_httpx.py): cover gemini content violation (on prompt) 2024-06-27 20:20:29 -07:00
Krrish Dholakia
438f65666b fix(utils.py): catch 422-status errors 2024-06-27 20:20:29 -07:00
Krrish Dholakia
82c6f31095 test(test_router.py): add testing 2024-06-27 20:20:29 -07:00
Krrish Dholakia
2e588c0685 fix(router.py): use user-defined model_input_tokens for pre-call filter checks 2024-06-27 20:20:29 -07:00
Krrish Dholakia
247d71db7a fix(utils.py): fix exception_mapping check for errors
If exception already mapped - don't attach traceback to it
2024-06-27 20:20:29 -07:00
Ishaan Jaff
6ac0f20099 docs - update telemetry 2024-06-27 20:20:29 -07:00
Ishaan Jaff
b2302bf224 fix ui login bug 2024-06-27 20:20:29 -07:00
7HR4IZ3
4e84147593 fix: Lunary integration
Fixes the bug of litellm not logging system messages to lunary
2024-06-27 20:20:29 -07:00
Krrish Dholakia
af21695f2b test: skip unstable tests 2024-06-27 20:20:29 -07:00
Krrish Dholakia
d2fe2b30a9 test(test_completion.py): handle replicate api error 2024-06-27 20:20:29 -07:00
Krrish Dholakia
b577f65798 test(test_proxy_server_langfuse.py): cleanup tests causing OOM issues. 2024-06-27 20:20:29 -07:00
Krrish Dholakia
c450dee681 fix(redact_messages.py): fix pr 2024-06-27 20:20:29 -07:00
Krrish Dholakia
3c92467ae8 fix(test_dynamic_rate_limit_handler.py): cleanup 2024-06-27 20:20:29 -07:00
Krrish Dholakia
2834a6395a fix(redact_messages.py): fix get 2024-06-27 20:20:29 -07:00
Krrish Dholakia
0971219470 docs(team_budgets.md): cleanup docs 2024-06-27 20:20:29 -07:00
Krrish Dholakia
544338bdf4 bump: version 1.40.24 → 1.40.25 2024-06-27 20:20:29 -07:00
Marc Abramowitz
379b834480 Document feature 2024-06-27 20:20:29 -07:00
Marc Abramowitz
d14138dbd9 Rename request header 2024-06-27 20:20:29 -07:00
Marc Abramowitz
efae9fa991 Turn on message logging via request header 2024-06-27 20:20:29 -07:00
Krrish Dholakia
7f54c90459 fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
Fixes https://github.com/BerriAI/litellm/issues/4338
2024-06-27 20:20:29 -07:00
Krrish Dholakia
e20e8c2e74 fix(vertex_httpx.py): flush remaining chunks from stream 2024-06-27 20:20:18 -07:00
Krrish Dholakia
b23181779f fix(vertex_httpx.py): ignore vertex finish reason - wait for stream to end
Fixes https://github.com/BerriAI/litellm/issues/4339
2024-06-27 20:20:18 -07:00
Krrish Dholakia
f479cd549f fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback
Exception maps azure content filter response exceptions
2024-06-27 20:20:18 -07:00
Ishaan Jaff
7bedb5ca52
Merge pull request #4451 from BerriAI/litellm_azure_fix_pre_post_logging
[Fix] Azure Post-API Call occurs before Pre-API Call in CustomLogger
2024-06-27 20:18:14 -07:00
Krrish Dholakia
94c069e869 fix(cost_calculator.py): infer provider name if not given
Fixes https://github.com/BerriAI/litellm/issues/4452
2024-06-27 18:41:04 -07:00
Krrish Dholakia
2faa6f704a fix(factory.py): get image type from response headers
Fixes https://github.com/BerriAI/litellm/issues/4441
2024-06-27 18:19:16 -07:00
Ishaan Jaff
96d3780a53 fix test secrets 2024-06-27 17:47:10 -07:00
Ishaan Jaff
eaa6441030 test fix secret detection 2024-06-27 17:42:44 -07:00
Ishaan Jaff
57ba0a46b7 azure - log post api call 2024-06-27 17:38:03 -07:00
Ishaan Jaff
a012f231b6 azure - fix custom logger on post call 2024-06-27 17:37:02 -07:00
Krrish Dholakia
c14cc35e52 feat(azure.py): azure tts support
Closes https://github.com/BerriAI/litellm/issues/4002
2024-06-27 16:59:25 -07:00
Ishaan Jaff
0cd25c250d
Merge pull request #4447 from BerriAI/litellm_fix_error_on_v2_model_info
[fix] error message on /v2/model info when no models exist
2024-06-27 16:33:19 -07:00
Ishaan Jaff
ed32fb71e7
Merge pull request #4444 from BerriAI/litellm_better_Secret_redact
[Feat] Improve secret detection call hook - catch more cases
2024-06-27 16:31:48 -07:00
Ishaan Jaff
0c6cd2c894 fix error message on v2/model info 2024-06-27 16:29:11 -07:00
Krrish Dholakia
d421486a45 fix(token_counter.py): New `get_modified_max_tokens' helper func
Fixes https://github.com/BerriAI/litellm/issues/4439
2024-06-27 15:38:09 -07:00
John HU
933101a3f8
Do not resolve project id from creds 2024-06-27 15:26:36 -07:00
Ishaan Jaff
baf55a86c9 fix secret scanner 2024-06-27 15:20:30 -07:00
Ishaan Jaff
84ee37086c add stricter secret detection 2024-06-27 15:12:13 -07:00