LiteLLM's cache appears to be updated in the background. Without this `time.sleep()` call, both responses take `0.8s` to return, but after adding it, the second response returns in `0.006s`. |
||
|---|---|---|
| .. | ||
| all_caches.md | ||
| caching_api.md | ||
| local_caching.md | ||
LiteLLM's cache appears to be updated in the background. Without this `time.sleep()` call, both responses take `0.8s` to return, but after adding it, the second response returns in `0.006s`. |
||
|---|---|---|
| .. | ||
| all_caches.md | ||
| caching_api.md | ||
| local_caching.md | ||