Jump to content

Connect Leeroopedia MCP: Equip your AI agents to search best practices, build plans, verify code, diagnose failures, and look up hyperparameter defaults.

Heuristic:Apache Beam Warning Deprecated Twister2 Runner

From Leeroopedia




Knowledge Sources
Domains Runner_Infrastructure, Deprecation
Last Updated 2026-02-09 00:00 GMT

Overview

Deprecation warning: the Twister2 Runner is deprecated and scheduled for removal in Apache Beam 3.0.

Description

The Twister2 Runner (Twister2Runner) is officially deprecated as of the Apache Beam 2.x release cycle. The @Deprecated annotation is present on the main Twister2Runner class, and the deprecation is documented in the official Beam website, roadmap, and CHANGES.md changelog. All Twister2-related APIs (Twister2PipelineOptions, Twister2BatchPipelineTranslator, Twister2Runner.zipDependencies(), BeamBatchWorker.execute(), DoFnFunction, GroupByWindowFunction) are affected by this deprecation.

Usage

This warning applies when selecting a runner for batch workloads. Do not choose Twister2Runner for new projects. Users with existing Twister2 pipelines should plan migration to an actively maintained runner (e.g., DirectRunner for local testing, DataflowRunner or FlinkRunner for production) before Beam 3.0.

The Insight (Rule of Thumb)

  • Action: Migrate away from Twister2Runner before Apache Beam 3.0.
  • Value: All Twister2 APIs will be removed in Beam 3.0.
  • Trade-off: Migration requires re-testing pipelines on the target runner; Twister2-specific HPC cluster configurations will not transfer directly.

Reasoning

The Twister2 project has become inactive and the Beam community has decided to remove the runner to reduce maintenance burden. The deprecation was formally announced in the Beam changelog and tracked under GitHub issue #35905. The @Deprecated Java annotation on Twister2Runner ensures compile-time warnings are generated for any code referencing the class.

Related Pages

Page Connections

Double-click a node to navigate. Hold to expand connections.
Principle
Implementation
Heuristic
Environment