bbd8ca3b3d
- Add Prometheus metrics for managed batch and file operations - Track batch creation, file size, duration, and deletion events - Add CheckBatchCost polling metrics (jobs polled/processed, errors) - Record metrics in managed_files hook and check_batch_cost utility - Metrics include labels for model, provider, user, and status Made-with: Cursor |
||
|---|---|---|
| .. | ||
| auth | ||
| common_utils | ||
| hooks | ||
| management_endpoints | ||
| vector_stores | ||
| __init__.py | ||
| audit_logging_endpoints.py | ||
| enterprise_routes.py | ||
| proxy_server.py | ||
| readme.md | ||
| utils.py | ||
LiteLLM Proxy Enterprise Features - Readme
Overview
This directory contains enterprise features used on the LiteLLM proxy.
Format
Create a file for every group of endpoints (e.g. key_management_endpoints.py, user_management_endpoints.py, etc.)
If there is a broader semantic group of endpoints, create a folder for that group (e.g. management_endpoints, auth_endpoints, etc.)