docs: add proxy req/s

2023-12-08 07:33:33 -08:00 · 2023-12-08 07:33:33 -08:00 · d548836903
commit d548836903
parent 0406e01c6d
1 changed files with 2 additions and 0 deletions
--- a/docs/my-website/docs/proxy/deploy.md
+++ b/docs/my-website/docs/proxy/deploy.md
@ -76,6 +76,8 @@ Your LiteLLM container should be running now on the defined port e.g. `8000`.

 ## LiteLLM Proxy Performance

+LiteLLM proxy has been load tested to handle 1500 req/s.
+
 ### Throughput - 30% Increase
 LiteLLM proxy + Load Balancer gives **30% increase** in throughput compared to Raw OpenAI API
 <Image img={require('../img/throughput.png')} />