Principle:LMCache LMCache Disaggregated Shutdown
| Knowledge Sources | |
|---|---|
| Domains | Infrastructure, Resource_Management |
| Last Updated | 2026-02-09 00:00 GMT |
Overview
A graceful shutdown pattern that terminates all processes and releases network resources in a disaggregated prefill-decode deployment.
Description
Disaggregated Shutdown handles orderly termination of the multi-process disaggregated deployment. It sends kill signals to prefiller, decoder, and proxy processes, waits for cleanup, and ensures NIXL transfer channels and ZMQ contexts are properly destroyed.
Usage
Trigger shutdown via Ctrl+C or SIGTERM to the orchestration script, which propagates signals to all child processes.
Theoretical Basis
Cleanup order:
- Send SIGTERM to prefiller, decoder, proxy processes
- PDBackend.close() joins background threads and closes NIXL channels
- ZMQ contexts are terminated
- PID files are removed
Related Pages
Implemented By
Page Connections
Double-click a node to navigate. Hold to expand connections.
Principle
Implementation
Heuristic
Environment