Ishaan Jaff 1bb9e1bde8 [Feat] Add vllm batch+files API support (#15823) ... * add OPENAI_COMPATIBLE_BATCH_AND_FILES_PROVIDERS * fix use OPENAI_COMPATIBLE_BATCH_AND_FILES_PROVIDERS * add _get_batch_job_total_usage_from_file_content * fixes for vLLM + 12 labs async invoke * fix: vLLM Batch APIs * afile_retrieve * test_hosted_vllm_full_workflow * fix SERVER_URL for test		2025-12-02 08:41:50 -08:00
..
batch_job_results_furniture.jsonl
batch_small.jsonl	[Feat] Add support for Batch API Rate limiting - PR1 adds support for input based rate limits (#16075)	2025-10-29 18:28:52 -07:00
bedrock_batch_completions.jsonl	[Feat] Bedrock Batches - Working e2e flow to upload file + create batch (#14518)	2025-09-12 15:37:09 -07:00
conftest.py	[Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905)	2025-08-23 13:13:23 -07:00
openai_batch_completions.jsonl
pathrise-convert-1606954137718.json	use pathrise-convert-1606954137718	2025-01-05 14:14:43 -08:00
test_batch_rate_limits.py	[Feat] Add support for Batch API Rate limiting - PR1 adds support for input based rate limits (#16075)	2025-10-29 18:28:52 -07:00
test_batches_logging_unit_tests.py	Store batch output file id in DB + Store batch file status in DB + (experimental) BATCH API COST TRACKING	2025-06-25 22:41:22 -07:00
test_bedrock_files_and_batches.py	[Feat] Bedrock Batches - Add support for custom KMS encryption keys in Bedrock Batch operations (#16662)	2025-11-14 16:00:43 -08:00
test_fine_tuning_api.py	Litellm managed file updates combined (#11040)	2025-05-22 17:20:41 -07:00
test_hosted_vllm_batches_and_files.py	[Feat] Add vllm batch+files API support (#15823)	2025-12-02 08:41:50 -08:00
test_openai_batches_and_files.py	new mocked	2025-11-25 17:28:02 +05:30
vertex_batch_completions.jsonl