Ishaan Jaff
|
40418c7bd8
|
test_openai_client_reuse
|
2025-03-18 18:13:36 -07:00 |
|
Ishaan Jaff
|
d5150e000d
|
test openai common utils
|
2025-03-18 18:08:24 -07:00 |
|
Ishaan Jaff
|
3daef0d740
|
fix common utils
|
2025-03-18 17:59:46 -07:00 |
|
Ishaan Jaff
|
a45830dac3
|
use common caching logic for openai/azure clients
|
2025-03-18 17:57:03 -07:00 |
|
Ishaan Jaff
|
f73e9047dc
|
use common logic for re-using openai clients
|
2025-03-18 17:56:32 -07:00 |
|
Krrish Dholakia
|
a34cc2031d
|
fix(response_metadata.py): log the litellm_model_name
make it easier to track the model sent to the provider
|
2025-03-18 17:46:33 -07:00 |
|
Krrish Dholakia
|
8ed3483adb
|
test(test_tpm_rpm_routing_v2.py): initial test, for asserting async pre call check works as expected
|
2025-03-18 17:36:55 -07:00 |
|
Ishaan Jaff
|
bdf77f6f4b
|
fix ensure async client test
|
2025-03-18 17:29:10 -07:00 |
|
Ishaan Jaff
|
c010cdef59
|
test_dynamic_azure_params
|
2025-03-18 17:26:23 -07:00 |
|
Krrish Dholakia
|
453729b6c9
|
fix(litellm_logging.py): fix update
|
2025-03-18 17:18:58 -07:00 |
|
Krrish Dholakia
|
39ac9e3eca
|
fix(lowest_tpm_rpm_v2.py): fix updating limits
|
2025-03-18 17:10:17 -07:00 |
|
Ishaan Jaff
|
78a5dde31f
|
fix code qa
|
2025-03-18 17:07:44 -07:00 |
|
Ishaan Jaff
|
bd122f631e
|
fix arize config
|
2025-03-18 16:54:31 -07:00 |
|
Krrish Dholakia
|
cfe94c86cc
|
fix(lowest_tpm_rpm_routing_v2.py): fix deployment update to use correct keys
|
2025-03-18 16:28:37 -07:00 |
|
Krrish Dholakia
|
9bf6028f14
|
fix(lowest_tpm_rpm_v2.py): update key to use model name
|
2025-03-18 16:19:47 -07:00 |
|
Ishaan Jaff
|
de97cda445
|
refactor create_litellm_proxy_request_started_spen
|
2025-03-18 16:12:16 -07:00 |
|
Ishaan Jaff
|
f4b7b49e9a
|
fix arize logging
|
2025-03-18 15:51:58 -07:00 |
|
Ishaan Jaff
|
7a5726fc88
|
fix - Arize - only log LLM I/O
|
2025-03-18 15:50:38 -07:00 |
|
Ishaan Jaff
|
41d9cc14be
|
test_async_dynamic_arize_config
|
2025-03-18 15:02:22 -07:00 |
|
Ishaan Jaff
|
f8c49175ec
|
fix _get_span_processor
|
2025-03-18 14:59:13 -07:00 |
|
Ishaan Jaff
|
b940c969fd
|
use _get_headers_dictionary
|
2025-03-18 14:55:39 -07:00 |
|
Ishaan Jaff
|
57d08531a1
|
add arize_api_key to StandardCallbackDynamicParams
|
2025-03-18 14:46:55 -07:00 |
|
Ishaan Jaff
|
3e0df0fc1e
|
test_arize_set_attributes
|
2025-03-18 14:31:34 -07:00 |
|
Ishaan Jaff
|
48663a0920
|
use safe dumps for arize ai
|
2025-03-18 14:30:00 -07:00 |
|
Ishaan Jaff
|
959299c8ea
|
Merge pull request #9338 from nate-mar/arize-integration-fixes
Arize integration Fix
|
2025-03-18 14:28:25 -07:00 |
|
Ishaan Jaff
|
55ea2370ba
|
Union[TranscriptionResponse, Coroutine[Any, Any, TranscriptionResponse]]:
|
2025-03-18 14:23:14 -07:00 |
|
Ishaan Jaff
|
7384d45ef0
|
fix type errors on transcription azure
|
2025-03-18 14:22:30 -07:00 |
|
Ishaan Jaff
|
b20a69f9fc
|
fix code quality
|
2025-03-18 12:58:59 -07:00 |
|
Emerson Gomes
|
1cc832f53e
|
Fix TTFT prioritization for streaming in LowestLatencyLoggingHandler
|
2025-03-18 14:58:55 -05:00 |
|
Ishaan Jaff
|
dc3d7b3afc
|
test_azure_instruct
|
2025-03-18 12:56:11 -07:00 |
|
Ishaan Jaff
|
2cd49ef096
|
fix test_ensure_initialize_azure_sdk_client_always_used
|
2025-03-18 12:46:55 -07:00 |
|
Ishaan Jaff
|
b60178f534
|
fix azure chat logic
|
2025-03-18 12:42:24 -07:00 |
|
Ishaan Jaff
|
80a5cfa01d
|
test_azure_embedding_max_retries_0
|
2025-03-18 12:35:34 -07:00 |
|
Ishaan Jaff
|
b316911120
|
fix typing errors
|
2025-03-18 12:31:44 -07:00 |
|
Ishaan Jaff
|
6987a73e36
|
initialize_azure_sdk_client
|
2025-03-18 12:27:17 -07:00 |
|
Ishaan Jaff
|
842625a6f0
|
:test_completion_azure_ad_toke
|
2025-03-18 12:25:32 -07:00 |
|
Krrish Dholakia
|
00b338cb9c
|
test: refactor testing to handle routing correctly
|
2025-03-18 12:24:12 -07:00 |
|
Ishaan Jaff
|
d4b3082ca2
|
fix azure embedding test
|
2025-03-18 12:19:12 -07:00 |
|
Ishaan Jaff
|
5e892a1e92
|
ui new build
|
2025-03-18 11:46:23 -07:00 |
|
Ishaan Jaff
|
807054cadd
|
ui fix linting error
|
2025-03-18 11:45:22 -07:00 |
|
Ishaan Jaff
|
38e2dd00cc
|
fix amebedding issue on ssl azure
|
2025-03-18 11:42:11 -07:00 |
|
Ishaan Jaff
|
dfd7a7d547
|
fix linting error
|
2025-03-18 11:38:31 -07:00 |
|
Krrish Dholakia
|
267084a1af
|
test(test_get_llm_provider.py): cover scenario where xai not in model name
|
2025-03-18 11:04:59 -07:00 |
|
Ishaan Jaff
|
3458c69eb0
|
fix common utils
|
2025-03-18 11:04:02 -07:00 |
|
Krrish Dholakia
|
2c094c2356
|
fix(get_llm_provider.py): Fixes https://github.com/BerriAI/litellm/issues/9291
|
2025-03-18 10:48:28 -07:00 |
|
Ishaan Jaff
|
c1e0cb136e
|
fix using azure openai clients
|
2025-03-18 10:47:29 -07:00 |
|
Krrish Dholakia
|
aeec703c4e
|
test(test_get_llm_provider.py): Minimal repro for https://github.com/BerriAI/litellm/issues/9291
|
2025-03-18 10:35:50 -07:00 |
|
Ishaan Jaff
|
e34be5a3b6
|
use get_azure_openai_client
|
2025-03-18 10:28:39 -07:00 |
|
Ishaan Jaff
|
a0c5fb81b8
|
fix logic for intializing openai clients
|
2025-03-18 10:23:30 -07:00 |
|
Ishaan Jaff
|
0601768bb8
|
use ssl on initialize_azure_sdk_client
|
2025-03-18 10:14:51 -07:00 |
|