Commit Graph

23118 Commits

Author SHA1 Message Date
Krrish Dholakia
8464f06df7 docs(config_settings.md): cleanup 2025-03-19 12:06:07 -07:00
Krrish Dholakia
041d5391eb test(test_proxy_server.py): make test work on ci/cd 2025-03-19 12:01:37 -07:00
Krrish Dholakia
79db96dd13 docs(config_settings.md): update env var information 2025-03-19 11:47:14 -07:00
Krrish Dholakia
858da57b3c test(test_proxy_server.py): add unit test to ensure get credentials only called behind feature flag 2025-03-19 11:44:00 -07:00
Krrish Dholakia
c13f6514bf fix(proxy_server.py): move db credential check to only run behind feature flag 2025-03-19 11:35:14 -07:00
Ishaan Jaff
08c362e1b1
Merge pull request #9375 from colesmcintosh/fix-litellm-proxy-docs
docs(litellm_proxy): correct parameter assignment in litellm proxy docs
2025-03-19 11:14:19 -07:00
Cole McIntosh
c5687ce94b docs(litellm_proxy): update parameter assignment for streaming call 2025-03-19 11:13:17 -06:00
Cole McIntosh
e2caf21131 docs(litellm_proxy): correct parameter assignment in sample litellm proxy call docs 2025-03-19 11:08:34 -06:00
Krrish Dholakia
edc38280ea docs(enterprise.md): clarify sla's 2025-03-19 09:09:02 -07:00
azdolinski
95c762e572 sync_latest_changes 2025-03-19 14:47:34 +00:00
Artur Zdolinski
3be8e07d46
Merge branch 'BerriAI:main' into litellm_fix_icons 2025-03-19 15:40:49 +01:00
azdolinski
044508e075 set_local_icons 2025-03-19 14:37:57 +00:00
Grayson Chen
f3a0261bb4 feat: Add support for custom OPENROUTER_API_BASE via get_secret in completion function 2025-03-19 21:09:03 +08:00
James Guthrie
437dbe7246 fix: VertexAI outputDimensionality configuration
VertexAI's API documentation [1] is an absolute mess. In it, they
describe the parameter to configure output dimensionality as
`output_dimensionality`. In the API example, they switch to using snake
case `outputDimensionality`, which is the correct variant.

[1]: https://cloud.google.com/vertex-ai/generative-ai/docs/model-reference/text-embeddings-api#generative-ai-get-text-embedding-drest
2025-03-19 11:07:36 +01:00
Krish Dholakia
01c6cbd270
Merge pull request #9363 from BerriAI/litellm_dev_03_18_2025_p3
fix(common_utils.py): handle cris only model
2025-03-18 23:36:12 -07:00
Krrish Dholakia
9adad381b4 fix(common_utils.py): handle cris only model
Fixes https://github.com/BerriAI/litellm/issues/9161#issuecomment-2734905153
2025-03-18 23:35:43 -07:00
Ishaan Jaff
e32aee9124
Merge pull request #9353 from BerriAI/litellm_arize_dynamic_logging
[Feat] - API - Allow using dynamic Arize AI Spaces on LiteLLM
2025-03-18 23:35:28 -07:00
Krish Dholakia
6347b694ee
Merge pull request #9335 from BerriAI/litellm_dev_03_17_2025_p3
Contributor PR: Fix sagemaker too little data for content error
2025-03-18 23:24:07 -07:00
Ishaan Jaff
8690873488 test_arize_dynamic_params 2025-03-18 23:22:55 -07:00
Ishaan Jaff
8568caf532 test_arize_dynamic_params 2025-03-18 23:18:07 -07:00
Krrish Dholakia
2c69b5d221 fix(base_routing_strategy.py): refactor for cleaner code 2025-03-18 22:57:05 -07:00
Krish Dholakia
c83e19e8c7
Merge pull request #9361 from BerriAI/litellm_fix_azure_gpt_4o_pricing
build(model_prices_and_context_window.json): fix azure gpt-4o pricing
2025-03-18 22:42:38 -07:00
Krrish Dholakia
084e8c425c refactor(base_routing_strategy.py): fix function names 2025-03-18 22:41:02 -07:00
Krrish Dholakia
0194c18820 build(model_prices_and_context_window.json): fix azure gpt-4o pricing
fix default to use latest global pricing
2025-03-18 22:34:58 -07:00
Ishaan Jaff
f5ef0c3cb7 fix code quality checks 2025-03-18 22:34:43 -07:00
Krrish Dholakia
3033c40739 fix(base_routing_strategy.py): fix base to handle no running event loop
run in a separate thread
2025-03-18 22:20:39 -07:00
Ishaan Jaff
0f2e095b6b _arize_otel_logger 2025-03-18 22:19:51 -07:00
Ishaan Jaff
57e5c94360 Merge branch 'main' into litellm_arize_dynamic_logging 2025-03-18 22:13:35 -07:00
Ishaan Jaff
c101fe9b5d
Merge pull request #9352 from BerriAI/litellm_arize_mar_18
[Bug Fix] Arize AI Logging Integration with LiteLLM
2025-03-18 22:12:46 -07:00
Ishaan Jaff
412ad0d64e test_arize_callback 2025-03-18 20:21:23 -07:00
Krrish Dholakia
a3d000baaa fix(test_base_routing_strategy.py): add unit testing for new base routing strategy test 2025-03-18 19:59:06 -07:00
Krrish Dholakia
ef008138a3 feat(base_routing_strategy.py): handle updating in-memory keys 2025-03-18 19:44:04 -07:00
Krrish Dholakia
1328afe612 fix(lowest_tpm_rpm_v2.py): support batch writing increments to redis 2025-03-18 19:09:53 -07:00
Ishaan Jaff
19a7bfa6b5 test_arize_callback 2025-03-18 18:49:06 -07:00
Ishaan Jaff
00795f2bbf test arize logging 2025-03-18 18:40:39 -07:00
Ishaan Jaff
65083ca8da get_openai_client_cache_key 2025-03-18 18:35:50 -07:00
Krish Dholakia
24fbadf072
Merge pull request #9355 from BerriAI/litellm_dev_03_18_2025_p1
Litellm dev 03 18 2025 p1
2025-03-18 18:34:06 -07:00
Ishaan Jaff
40418c7bd8 test_openai_client_reuse 2025-03-18 18:13:36 -07:00
Ishaan Jaff
d5150e000d test openai common utils 2025-03-18 18:08:24 -07:00
Ishaan Jaff
3daef0d740 fix common utils 2025-03-18 17:59:46 -07:00
Ishaan Jaff
a45830dac3 use common caching logic for openai/azure clients 2025-03-18 17:57:03 -07:00
Ishaan Jaff
f73e9047dc use common logic for re-using openai clients 2025-03-18 17:56:32 -07:00
Krrish Dholakia
a34cc2031d fix(response_metadata.py): log the litellm_model_name
make it easier to track the model sent to the provider
2025-03-18 17:46:33 -07:00
Krrish Dholakia
8ed3483adb test(test_tpm_rpm_routing_v2.py): initial test, for asserting async pre call check works as expected 2025-03-18 17:36:55 -07:00
Ishaan Jaff
bdf77f6f4b fix ensure async client test 2025-03-18 17:29:10 -07:00
Ishaan Jaff
c010cdef59 test_dynamic_azure_params 2025-03-18 17:26:23 -07:00
Krrish Dholakia
453729b6c9 fix(litellm_logging.py): fix update 2025-03-18 17:18:58 -07:00
Krrish Dholakia
39ac9e3eca fix(lowest_tpm_rpm_v2.py): fix updating limits 2025-03-18 17:10:17 -07:00
Ishaan Jaff
78a5dde31f fix code qa 2025-03-18 17:07:44 -07:00
Ishaan Jaff
bd122f631e fix arize config 2025-03-18 16:54:31 -07:00