Environment:Sgl project Sglang ROCm

Sgl_project_Sglang_ROCm is the AMD ROCm GPU runtime environment for SGLang, providing HIP-based GPU acceleration on AMD Instinct (MI250X/MI300X) hardware.

Requirements

• AMD Instinct GPU (MI250X, MI300X, or compatible)
• ROCm 6.0+ driver stack
• PyTorch (ROCm build)
• `sgl-kernel` (ROCm build)
• `rocm-smi` for GPU memory queries
• Python 3.10+
• HIP runtime (accessed via PyTorch's CUDA compatibility layer)

Required By

• Implementation:Sgl_project_Sglang_Benchmark_MoE_ROCm
• Implementation:Sgl_project_Sglang_Quick_AllReduce
• Implementation:Sgl_project_Sglang_Quick_AllReduce_Base

See Also

• Environment:Sgl_project_Sglang_CUDA_GPU_Runtime
• Environment:Sgl_project_Sglang_Multi_Platform_Accelerators