sglang-router
High-performance Rust-based load balancer for SGLang with multiple routing algorithms and prefill-decode disaggregation support
pip install sglang-router High-performance Rust-based load balancer for SGLang with multiple routing algorithms and prefill-decode disaggregation support
pip install sglang-router