Jump to content

Connect Leeroopedia MCP: Equip your AI agents to search best practices, build plans, verify code, diagnose failures, and look up hyperparameter defaults.

Principle:Apache Kafka Coordinator Metadata Propagation

From Leeroopedia


Knowledge Sources
Domains Distributed_Systems, Metadata_Management
Last Updated 2026-02-09 12:00 GMT

Overview

A metadata distribution mechanism that propagates cluster metadata changes to all active coordinator instances.

Description

Coordinator Metadata Propagation updates coordinator instances when the cluster metadata changes (e.g., topic creation, broker changes). The runtime receives metadata deltas and new images from the KRaft controller, updates the global metadata image, and pushes an update event to each active coordinator. Only coordinators in the ACTIVE state receive updates.

Usage

Use this principle to understand how coordinators stay synchronized with cluster metadata changes. This is essential for coordinators that need to react to topology changes.

Theoretical Basis

  1. Delta-Based Updates: Metadata changes are delivered as deltas (what changed) along with the new complete image.
  2. Per-Coordinator Distribution: Each active coordinator receives its own update event to process independently.
  3. State Filtering: Only ACTIVE coordinators receive metadata updates; LOADING or CLOSED coordinators are skipped.

Related Pages

Implemented By

Page Connections

Double-click a node to navigate. Hold to expand connections.
Principle
Implementation
Heuristic
Environment