docs(load_balancing.md): have proxy routing docs point to sdk routing docs
This commit is contained in:
parent
e049858266
commit
d1a40ecacf
@ -2,6 +2,14 @@
|
||||
Load balance multiple instances of the same model
|
||||
|
||||
The proxy will handle routing requests (using LiteLLM's Router). **Set `rpm` in the config if you want maximize throughput**
|
||||
|
||||
|
||||
:::info
|
||||
|
||||
For more details on routing strategies / params, see [Routing](../routing.md)
|
||||
|
||||
:::
|
||||
|
||||
## Quick Start - Load Balancing
|
||||
### Step 1 - Set deployments on config
|
||||
|
||||
|
||||
Loading…
Reference in New Issue
Block a user