Principle:LMCache LMCache P2P Configuration
| Knowledge Sources | |
|---|---|
| Domains | Configuration, Distributed_Systems |
| Last Updated | 2026-02-09 00:00 GMT |
Overview
A per-instance configuration pattern that specifies P2P networking, controller registration, and NIXL transfer settings for cross-instance KV cache sharing.
Description
P2P Configuration extends the base LMCacheEngineConfig with fields for peer-to-peer KV cache sharing. Each vLLM instance gets a unique configuration specifying its NIXL bind host and ports, its unique instance ID, the controller's ZMQ endpoints, and worker communication ports.
Validation ensures that when enable_p2p=True, all required fields (controller URLs, worker ports, P2P host, init/lookup ports, transfer channel) are set.
Usage
Create a YAML config file per vLLM instance with unique instance IDs and P2P ports, all pointing to the same controller endpoints.
Theoretical Basis
P2P configuration follows a per-instance identity model where each node has a unique ID and network address, but shares a common controller endpoint for coordination.