Commit Graph

30881 Commits

Author SHA1 Message Date
Ishaan Jaff
68665ea028 DNS lookup for Redis host 2025-03-26 09:25:14 -07:00
Krrish Dholakia
a97d0563b4 build(model_prices_and_context_window.json): add commercial rate limits for gemini 2.0 flash lite 2025-03-26 08:58:35 -07:00
Ishaan Jaff
c3dc4a2ecd fix DNS resolution 2025-03-26 08:55:18 -07:00
Ishaan Jaff
e5a5dca777 fix load_testing 2025-03-26 08:46:23 -07:00
Ishaan Jaff
7123b69cca fix caching unit tests 2025-03-26 08:42:55 -07:00
Ishaan Jaff
22dfc4dea9 fix user_api_key_auth example config 2025-03-26 08:36:11 -07:00
Ishaan Jaff
e7a8b5a809 run ci/cd again 2025-03-26 08:12:51 -07:00
Ishaan Jaff
fafbaf6302 Merge branch 'main' into litellm_stability_fixes 2025-03-26 07:16:31 -07:00
Ishaan Jaff
fb31006cd8 select_model_for_request_transformation 2025-03-26 07:12:25 -07:00
Ishaan Jaff
27c085cc56 fix util vertex 2025-03-26 00:08:16 -07:00
Ishaan Jaff
2bef0481af _transform_request_body 2025-03-26 00:05:45 -07:00
Ishaan Jaff
830ecbdb8c fix get_optional_params 2025-03-25 23:54:57 -07:00
Ishaan Jaff
aa8ba9b8f2 fix base_model in param mapping 2025-03-25 23:54:29 -07:00
Ishaan Jaff
efce84815a test_gemini_fine_tuned_model_request_consistency 2025-03-25 23:54:06 -07:00
Krish Dholakia
6fd18651d1
Support litellm.api_base for vertex_ai + gemini/ across completion, embedding, image_generation (#9516)
* test(tests): add unit testing for litellm_proxy integration

* fix(cost_calculator.py): fix tracking cost in sdk when calling proxy

* fix(main.py): respect litellm.api_base on `vertex_ai/` and `gemini/` routes

* fix(main.py): consistently support custom api base across gemini + vertexai on embedding + completion

* feat(vertex_ai/): test

* fix: fix linting error

* test: set api base as None before starting loadtest
2025-03-25 23:46:20 -07:00
Ishaan Jaff
8657816477 fix gemini/gemini-2.0-flash-lite on model cost map 2025-03-25 23:20:43 -07:00
Ishaan Jaff
6e5d2b1ac7 handle failed db connections 2025-03-25 23:14:44 -07:00
Krrish Dholakia
e0880734d9 docs(config_settings.md): cleanup docs 2025-03-25 23:11:45 -07:00
Krrish Dholakia
24b3e80eba ci: update github action 2025-03-25 23:11:45 -07:00
Ishaan Jaff
c61214dcf1
Merge pull request #9523 from BerriAI/litellm_add_gemini_flash_lite
[Feat - New Model] Add VertexAI `gemini-2.0-flash-lite` and Google AI Studio `gemini-2.0-flash-lite`
2025-03-25 23:11:44 -07:00
Ishaan Jaff
c473e2b1c2 setup_google_dns 2025-03-25 23:02:02 -07:00
Ishaan Jaff
3725ba4f63 setup_google_dns 2025-03-25 22:52:31 -07:00
Nicholas Grabar
f68cc26f15 8864 Add support for anyOf union type while handling null fields 2025-03-25 22:37:28 -07:00
Ishaan Jaff
61816dfd04 litellm_assistants_api_testing bump python 2025-03-25 22:31:16 -07:00
Ishaan Jaff
24a329ea5b Set DNS 2025-03-25 22:29:40 -07:00
Ishaan Jaff
9aec7c3878 test_create_delete_assistants 2025-03-25 22:08:06 -07:00
Ishaan Jaff
79ef184345 run ci/cd again 2025-03-25 21:57:45 -07:00
Ishaan Jaff
0a401ee468 test_litellm_proxy_server_config_no_general_settings 2025-03-25 19:27:15 -07:00
Ishaan Jaff
6572ba7a0e fix startup 2025-03-25 19:25:47 -07:00
Ishaan Jaff
b4e745323a add test config 2025-03-25 19:21:51 -07:00
Ishaan Jaff
9d10befa09 test_litellm_proxy_server_config_no_general_settings 2025-03-25 19:16:34 -07:00
Ishaan Jaff
4386558582 litellm_proxy_reliability_tests 2025-03-25 19:11:13 -07:00
Ishaan Jaff
53d9e33e78 fix setup toxi proxy 2025-03-25 18:59:26 -07:00
Ishaan Jaff
9e2d230339 litellm_proxy_reliability_tests 2025-03-25 18:23:52 -07:00
Ishaan Jaff
6f138c79a7 run toxi proxy tests 2025-03-25 18:19:11 -07:00
Ishaan Jaff
83b41f95e7 Setup Toxiproxy 2025-03-25 18:05:41 -07:00
Ishaan Jaff
bf7241abd1 litellm_proxy_reliability_tests 2025-03-25 18:02:01 -07:00
Ishaan Jaff
53a586e876 TOXI_PROXY_DATABASE_URL 2025-03-25 17:59:38 -07:00
Krish Dholakia
6cd6ff801f
ci(publish-migrations.yml): add action for publishing prisma db migrations (#9537) 2025-03-25 17:55:59 -07:00
Ishaan Jaff
34c3825d13 fix path 2025-03-25 17:53:30 -07:00
Ishaan Jaff
7b09d88680 fix setup 2025-03-25 17:52:12 -07:00
Ishaan Jaff
c6d5793bf6 add toxi proxy tests to ci/cd 2025-03-25 17:50:27 -07:00
Ishaan Jaff
ce49e27217 fixes for auth checks 2025-03-25 15:44:13 -07:00
Ishaan Jaff
59040167ac fix ProxyErrorTypes 2025-03-25 14:40:11 -07:00
Ishaan Jaff
4c87084ff7 UserAPIKeyAuthExceptionHandler 2025-03-25 14:07:14 -07:00
Krrish Dholakia
e8c4cd8c1a docs: cleanup docs 2025-03-25 12:25:42 -07:00
Krrish Dholakia
1a58e8bfe5 docs(admin_ui_sso.md): add logout url 2025-03-25 12:25:16 -07:00
Krrish Dholakia
ff61ce6751 docs: update release note with patch 2025-03-25 10:17:34 -07:00
Ishaan Jaff
0af9a5e8d0 add gemini/gemini-2.0-flash-lite 2025-03-25 07:51:42 -07:00
Ishaan Jaff
62bb7d6605 add vertex gemini-2.0-flash-lite 2025-03-25 07:48:33 -07:00