Jump to content

Connect SuperML | Leeroopedia MCP: Equip your AI agents with best practices, code verification, and debugging knowledge. Powered by Leeroo — building Organizational Superintelligence. Contact us at founders@leeroo.com.

Environment:Sgl project Sglang CPU

From Leeroopedia
Revision as of 18:41, 16 February 2026 by Admin (talk | contribs) (Auto-imported from environments/Sgl_project_Sglang_CPU.md)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)


Sgl_project_Sglang_CPU is the CPU-only inference runtime environment for SGLang, enabling model serving without any GPU hardware.

Requirements

  • Linux (x86_64 or ARM64)
  • Python 3.10+
  • PyTorch (CPU build)
  • `sglang-cpu` package
  • Environment variable `SGLANG_USE_CPU_ENGINE=1`
  • Intel AMX tile support recommended for x86 (Xeon 4th Gen+)

Required By

See Also

Page Connections

Double-click a node to navigate. Hold to expand connections.
Principle
Implementation
Heuristic
Environment
Retrieved from "https://leeroopedia.com/index.php?title=Environment:Sgl_project_Sglang_CPU&oldid=27587"