Skip to content

[flink] Report pending finished tiering tables on enumerator shutdown - #4703

Open
yangshangqing95 wants to merge 1 commit into
apache:mainfrom
yangshangqing95:fix/ci/paimon-testLookupExpiredPartition
Open

yangshangqing95 wants to merge 1 commit into
apache:mainfrom
yangshangqing95:fix/ci/paimon-testLookupExpiredPartition

Conversation

@yangshangqing95

Copy link
Copy Markdown
Contributor

Purpose

Fix #4702

TieringSourceEnumerator may lose completed tiering reports if it is closed before a scheduled asynchronous heartbeat executes.

Previously, close() only reported failed tables, leaving pending entries in finishedTables unreported. This could leave the Coordinator treating an already completed table as still being tiered, delaying subsequent tiering rounds.

Brief change log

  • Report both pending finished and failed tables through the existing heartbeat mechanism during enumerator shutdown.
  • Ensure heartbeat failures do not prevent resource cleanup.

Tests

Added two regression tests in TieringSourceEnumeratorTest:

  • testCloseReportsFinishedAndRunningTablesBeforePendingHeartbeat: Verifies that finished and running tables are correctly reported when the enumerator closes before the pending heartbeat executes.
  • testCloseReleasesRpcClientWhenHeartbeatFails: Verifies that the RPC client is still closed when the shutdown heartbeat fails.

API and Format

No changes.

Documentation

Not applicable.

@yangshangqing95
yangshangqing95 force-pushed the fix/ci/paimon-testLookupExpiredPartition branch from 0e6680c to ff108cb Compare October 18, 2026 05:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[flink] TieringSourceEnumerator may lose finished tiering reports during shutdown

1 participant