Principle:Risingwavelabs Risingwave CDC Pipeline Coordination
| Knowledge Sources | |
|---|---|
| Domains | CDC, Connectors, Pipeline_Orchestration |
| Last Updated | 2026-02-09 07:00 GMT |
Overview
Coordination of CDC pipeline components including snapshot, streaming, and schema change phases.
Description
CDC Pipeline Coordination manages the lifecycle and transitions between the major phases of a CDC pipeline: initial snapshot capture, ongoing streaming replication, and schema change handling. The coordinator orchestrates when to start the snapshot phase, when to transition to streaming mode, and how to handle schema changes that arrive during replication. It manages the interaction between the change event source (which reads from the database transaction log), the schema history (which tracks DDL changes), and the change event consumer (which forwards events downstream). This ensures orderly processing and prevents data loss during phase transitions.
Usage
Apply this principle when modifying the CDC pipeline lifecycle, adding new CDC source types, or debugging issues with snapshot-to-streaming transitions.