AI Load Balancer
Sustained demand is exceeding current capacity — consider bringing another machine online.
Name
Host
Port
Tier
Max Concurrency
Status
Active
Queue
Models
Enabled
Add Machine
Name
Host
Port
Tier (lower = weaker, tried first)
Max Concurrency
Add Machine