Jump to content

Connect Leeroopedia MCP: Equip your AI agents to search best practices, build plans, verify code, diagnose failures, and look up hyperparameter defaults.

Environment:Sgl project Sglang CPU

From Leeroopedia


Sgl_project_Sglang_CPU is the CPU-only inference runtime environment for SGLang, enabling model serving without any GPU hardware.

Requirements

  • Linux (x86_64 or ARM64)
  • Python 3.10+
  • PyTorch (CPU build)
  • `sglang-cpu` package
  • Environment variable `SGLANG_USE_CPU_ENGINE=1`
  • Intel AMX tile support recommended for x86 (Xeon 4th Gen+)

Required By

See Also

Page Connections

Double-click a node to navigate. Hold to expand connections.
Principle
Implementation
Heuristic
Environment
Retrieved from "https://leeroopedia.com/index.php?title=Environment:Sgl_project_Sglang_CPU&oldid=27587"