History

Krish Dholakia d895ae827d Litellm batch api background cost calc (#12125 ) * feat(check_batch_cost.py): emit spend log on successful request ensures cost tracked for batch requests * feat(proxy_server.py): add background job to poll completed batch jobs used for calculating cost for batch jobs * fix(proxy_server.py): run batch cost tracking job every hour batch jobs take time to complete, no need to run every few seconds * feat(proxy_server.py): run batch cost tracking job every hour		2025-06-27 21:46:25 -07:00
..
auth	fix(user_api_key_auth.py): handle user custom auth set with no custom settings	2025-05-23 21:30:44 -07:00
common_utils	Litellm batch api background cost calc (#12125 )	2025-06-27 21:46:25 -07:00
guardrails	[Feat - Guardrails] Expose /apply_guardrail endpoint for directly calling guardrail (#10867 )	2025-05-15 14:52:24 -07:00
hooks	Store batch output file id in DB + Store batch file status in DB + (experimental) BATCH API COST TRACKING	2025-06-25 22:41:22 -07:00
management_endpoints	Teams - Support default key expiry + UI - support enforcing access for members of specific SSO Group (#12023 )	2025-06-24 21:58:07 -07:00
vector_stores
audit_logging_endpoints.py	style: cleanup prints in enterprise	2025-05-24 11:29:15 -07:00
enterprise_routes.py	Show remaining users on UI (#11568 )	2025-06-09 22:04:45 -07:00
proxy_server.py	style: cleanup prints in enterprise	2025-05-24 11:29:15 -07:00
readme.md	Expose `/list` and `/info` endpoints for Audit Log events (#11102 )	2025-05-23 22:54:59 -07:00
utils.py

readme.md

LiteLLM Proxy Enterprise Features - Readme

Overview

This directory contains enterprise features used on the LiteLLM proxy.

Format

Create a file for every group of endpoints (e.g. key_management_endpoints.py, user_management_endpoints.py, etc.)

If there is a broader semantic group of endpoints, create a folder for that group (e.g. management_endpoints, auth_endpoints, etc.)