Commit Graph

30881 Commits

Author SHA1 Message Date
Krrish Dholakia
ec7fcc982d docs(index.md): add deepgram to release notes 2024-12-28 20:24:55 -08:00
Krrish Dholakia
bbf46913fa docs(deepgram.md): add table clarifying supported openai endpoint 2024-12-28 20:21:31 -08:00
Ishaan Jaff
cd59e62b40 doc update order 2024-12-28 20:20:12 -08:00
Krrish Dholakia
e18143dcba docs(deepgram.md): add deepgram model support to docs 2024-12-28 20:19:12 -08:00
Ishaan Jaff
8c569899c0 update release note 2024-12-28 20:15:30 -08:00
Ishaan Jaff
ea8f0913c2 test_e2e_batches_files 2024-12-28 19:54:04 -08:00
Krrish Dholakia
ed1e3e9dc1 ci(reset_stable.yml): fix to run on release created events 2024-12-28 19:53:18 -08:00
Krrish Dholakia
24a3403655 docs(spending_monitoring.md): add section on disabling spend logs to db 2024-12-28 19:48:50 -08:00
Ishaan Jaff
32e8bdef6f update clean up jobs 2024-12-28 19:45:19 -08:00
Krrish Dholakia
ab665dc7af docs(spend_monitoring.md): cleanup doc 2024-12-28 19:42:03 -08:00
Krish Dholakia
cfb6890b9f
Litellm dev 12 28 2024 p2 (#7458)
* docs(sidebar.js): docs for support model access groups for wildcard routes

* feat(key_management_endpoints.py): add check if user is premium_user when adding model access group for wildcard route

* refactor(docs/): make control model access a root-level doc in proxy sidebar

easier to discover how to control model access on litellm

* docs: more cleanup

* feat(fireworks_ai/): add document inlining support

Enables user to call non-vision models with images/pdfs/etc.

* test(test_fireworks_ai_translation.py): add unit testing for fireworks ai transform inline helper util

* docs(docs/): add document inlining details to fireworks ai docs

* feat(fireworks_ai/): allow user to dynamically disable auto add transform inline

allows client-side disabling of this feature for proxy users

* feat(fireworks_ai/): return 'supports_vision' and 'supports_pdf_input' true on all fireworks ai models

now true as fireworks ai supports document inlining

* test: fix tests

* fix(router.py): add unit testing for _is_model_access_group_for_wildcard_route
2024-12-28 19:38:06 -08:00
Ishaan Jaff
3eb962c594 update - new test for test_text_completion_health_check 2024-12-28 19:36:23 -08:00
Ishaan Jaff
6409de6291 fix ft job test - add resource cleanup 2024-12-28 19:28:54 -08:00
Krish Dholakia
5af438ed89
Litellm dev 12 28 2024 p3 (#7464)
* feat(deepgram/): initial e2e support for deepgram stt

Uses deepgram's `/listen` endpoint to transcribe speech to text

 Closes https://github.com/BerriAI/litellm/issues/4875

* fix: fix linting errors

* test: fix test
2024-12-28 19:18:58 -08:00
Ishaan Jaff
4d648ee335 fix ahealth_check 2024-12-28 19:16:28 -08:00
Ishaan Jaff
f719743d4a cleanup_azure_ft_models 2024-12-28 19:10:23 -08:00
Ishaan Jaff
a688967132 bump: version 1.56.3 → 1.56.4 2024-12-28 18:41:38 -08:00
Ishaan Jaff
1e06ee3162
(Refactor) - Re use litellm.completion/litellm.embedding etc for health checks (#7455)
* add mode: realtime

* add _realtime_health_check

* test_realtime_health_check

* azure _realtime_health_check

* _realtime_health_check

* Realtime Models

* fix code quality

* delete OAI / Azure custom health check code

* simplest version of ahealth check

* update tests

* working health check post refactor

* working aspeech health check

* fix realtime health checks

* test_audio_transcription_health_check

* use get_audio_file_for_health_check

* test_text_completion_health_check

* ahealth_check

* simplify health check code

* update ahealth_check

* fix import

* fix unused imports

* fix ahealth_check

* fix local testing

* test_async_realtime_health_check
2024-12-28 18:38:54 -08:00
Ishaan Jaff
4e65722a00
(Bug Fix) Add health check support for realtime models (#7453)
* add mode: realtime

* add _realtime_health_check

* test_realtime_health_check

* azure _realtime_health_check

* _realtime_health_check

* Realtime Models

* fix code quality
2024-12-28 18:15:00 -08:00
Ishaan Jaff
5c1e8b60d4 ui new build 2024-12-28 18:14:36 -08:00
paul-gauthier
406b7f43a8
fix OR deepseek (#7425)
* fix OR deepseek

* updated context limits

* restore or deepseek-coder

* OR deepseek supports prompt caching
2024-12-28 17:08:43 -08:00
Ishaan Jaff
3158dcf88b
(Security fix) - Upgrade to fastapi==0.115.5 (#7447)
* fix upgrade fast api

* bump fastapi

* update a proxy startup tests

* remove unused test file

* update tests

* bump fast api
2024-12-28 17:08:19 -08:00
Ishaan Jaff
978fc0e7a8
(Admin UI - 2) UI chat should render the output in markdown (#7460)
* chat ui improvement

* ui - handle md text
2024-12-28 16:47:08 -08:00
Ishaan Jaff
65bf83b163
chat ui improvement (#7459) 2024-12-28 16:39:31 -08:00
Ishaan Jaff
49fa6515c0
docs spend monitoring (#7461) 2024-12-28 16:39:24 -08:00
Ishaan Jaff
0e39ebefb2
remove unused code (#7456) 2024-12-28 12:32:05 -08:00
superpoussin22
82a869a9b6
Update model_prices_and_context_window.json (#7452)
correct the mistral-large-2411 definition on vertex
2024-12-28 08:38:34 -08:00
Ishaan Jaff
8610c7bf93 docs release notes 2024-12-27 21:41:21 -08:00
Ishaan Jaff
a962d88822 add keywords 2024-12-27 21:39:46 -08:00
Ishaan Jaff
570ab5498e v1.56.3 release notes 2024-12-27 21:36:49 -08:00
Krrish Dholakia
fc8c45634d build: bump version 2024-12-27 20:11:00 -08:00
Krish Dholakia
0924df4971
Litellm dev 12 27 2024 p2 1 (#7449)
* fix(azure_ai/transformation.py): route ai.services.azure calls to the azure provider route

requires token to be passed in as 'api-key'

Closes https://github.com/BerriAI/litellm/issues/7275

* fix(key_management_endpoints.py): enforce user is member of team, if team_id set and team_id exists in team table

* fix(key_management_endpoints.py): handle assigned_user_id = none

* feat(create_key_button.tsx): allow assigning keys to other users

allows proxy admin to easily assign other people keys

* build(create_key_button.tsx): fix error message display

don't swallow the error message for key creation failure

* build(create_key_button.tsx): allow proxy admin to edit team id

* build(create_key_button.tsx): allow proxy admin to assign keys to other users

* build(edit_user.tsx): clarify how 'user budgets' are applied

* test: remove dup test

* fix(key_management_endpoints.py): don't raise error if team not in db

'

* test: fix test
2024-12-27 20:02:32 -08:00
Krish Dholakia
67b39bacf7
LiteLLM Minor Fixes & Improvements (12/27/2024) - p1 (#7448)
* feat(main.py): mock_response() - support 'litellm.ContextWindowExceededError' in mock response

enabled quicker router/fallback/proxy debug on context window errors

* feat(exception_mapping_utils.py): extract special litellm errors from error str if calling `litellm_proxy/` as provider

Closes https://github.com/BerriAI/litellm/issues/7259

* fix(user_api_key_auth.py): specify 'Received Proxy Server Request' is span kind server

Closes https://github.com/BerriAI/litellm/issues/7298
2024-12-27 19:04:39 -08:00
superpoussin22
cca9cfe667
Update model_prices_and_context_window.json (#7345)
* Update model_prices_and_context_window.json

add mistral large 2411 and correct a few vertex prices

* Update model_prices_and_context_window.json

correct typo
2024-12-27 17:08:35 -08:00
Ishaan Jaff
2ece919f01
(Feat) - new endpoint GET /v1/fine_tuning/jobs/{fine_tuning_job_id:path} (#7427)
* init commit ft jobs logging

* add ft logging

* add logging for FineTuningJob

* simple FT Job create test

* simplify Azure fine tuning to use all methods in OAI ft

* update doc string

* add aretrieve_fine_tuning_job

* re use from litellm.proxy.utils import handle_exception_on_proxy

* fix naming

* add /fine_tuning/jobs/{fine_tuning_job_id:path}

* remove unused imports

* update func signature

* run ci/cd again

* ci/cd run again

* fix code qulity

* ci/cd run again
2024-12-27 17:01:14 -08:00
Ishaan Jaff
5e8c64f128
(Bug fix) missing model_group field in logs for aspeech call types (#7392)
* fix use _update_kwargs_before_fallbacks

* test assert standard_logging_object includes model_group

* test_datadog_non_serializable_messages

* update test
2024-12-27 17:00:39 -08:00
Ishaan Jaff
79c783e83f docs guardrails 2024-12-27 16:31:03 -08:00
Ishaan Jaff
0b4ef57172 docs add guardrail spec 2024-12-27 15:47:43 -08:00
Ishaan Jaff
b53861f3fb docs update gemini/ link 2024-12-27 15:32:50 -08:00
Igor Ribeiro Lima
11932d0576
Add Gemini embedding doc (#7436) 2024-12-27 15:27:26 -08:00
Ishaan Jaff
62753eea69
(Feat) Log Guardrails run, guardrail response on logging integrations (#7445)
* add guardrail_information to SLP

* use standard_logging_guardrail_information

* track StandardLoggingGuardrailInformation

* use log_guardrail_information

* use log_guardrail_information

* docs guardrails

* docs guardrails

* update quick start

* fix presidio logging for sync functions

* update Guardrail type

* enforce add_standard_logging_guardrail_information_to_request_data

* update gd docs
2024-12-27 15:01:56 -08:00
Ishaan Jaff
d1686eef72 ci/cd run again 2024-12-27 14:53:10 -08:00
paul-gauthier
c258eb7cc7
add openrouter o1 (#7424) 2024-12-27 14:37:21 -08:00
Ishaan Jaff
3e7794d880
(feat) /guardrails/list show guardrail info params (#7442)
* add GuardrailInfoResponse

* add list_guardrails

* test_get_guardrails_list_response
2024-12-27 14:35:00 -08:00
Ishaan Jaff
8ef5b4e94c test_langfuse_logging_audio_transcriptions 2024-12-27 14:34:08 -08:00
Ishaan Jaff
d36152f9eb fix ft testing 2024-12-27 14:33:16 -08:00
Krish Dholakia
c00952607d
Revert "Refresh VoyageAI models and prices and context (#7443)" (#7446)
This reverts commit 349a2c0316.
2024-12-27 14:12:46 -08:00
fzowl
349a2c0316
Refresh VoyageAI models and prices and context (#7443) 2024-12-27 14:11:29 -08:00
Krish Dholakia
d88de268dd
Litellm dev 12 26 2024 p4 (#7439)
* fix(model_dashboard.tsx): support setting model_info params - e.g. mode on ui

Closes https://github.com/BerriAI/litellm/issues/5270

* fix(lowest_tpm_rpm_v2.py): deployment rpm over limit check

fixes selection error when getting potential deployments below known tpm/rpm limit

 Fixes https://github.com/BerriAI/litellm/issues/7395

* fix(test_tpm_rpm_routing_v2.py): add unit test for https://github.com/BerriAI/litellm/issues/7395

* fix(lowest_tpm_rpm_v2.py): fix tpm key name in dict post rpm update

* test: rename test to run earlier

* test: skip flaky test
2024-12-27 12:01:42 -08:00
Ishaan Jaff
7cf347918e ci/cd run again 2024-12-27 11:44:26 -08:00