Skip to content

HDDS-15966. Fix flaky TestScmHAFinalization#testSnapshotFinalization - #10863

Closed
errose28 wants to merge 2 commits into
apache:HDDS-14496-zdufrom
errose28:HDDS-15966-flaky-finalize-test
Closed

HDDS-15966. Fix flaky TestScmHAFinalization#testSnapshotFinalization#10863
errose28 wants to merge 2 commits into
apache:HDDS-14496-zdufrom
errose28:HDDS-15966-flaky-finalize-test

Conversation

@errose28

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Failed here with a timeout at:

	at org.apache.ozone.test.GenericTestUtils.waitFor(GenericTestUtils.java:137)
	at org.apache.hadoop.hdds.upgrade.HddsUpgradeTestUtils.waitForScmToFinalize(HddsUpgradeTestUtils.java:125)
	at org.apache.hadoop.hdds.upgrade.HddsUpgradeTestUtils.waitForScmsToFinalize(HddsUpgradeTestUtils.java:119)
	at org.apache.hadoop.hdds.upgrade.TestScmHAFinalization.testSnapshotFinalization(TestScmHAFinalization.java:173)
	at java.base/java.lang.reflect.Method.invoke(Method.java:565)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:511)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1450)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:2019)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:187)

Logs show that it timed out waiting for scm2 to exit safemode. Safemode exit is this is no longer required for SCM finalization in the new upgrade framework, it is only required to instruct OMs to finalize which is not covered by this test. We can remove the safemode check from the wait.

What is the link to the Apache JIRA

HDDS-15966

How was this patch tested?

100 runs on my fork: https://github.com/errose28/ozone/actions/runs/30111725666/job/89543515225
This run was built off #10678 in case the failure was caused by the PR's changes. The test passed with a fix independent of the PR though.

@errose28
errose28 requested a review from dombizita July 24, 2026 17:52
@github-actions github-actions Bot added the zdu Pull requests for Zero Downtime Upgrade (ZDU) https://issues.apache.org/jira/browse/HDDS-14496 label Jul 24, 2026

@ayushtkn ayushtkn left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanx @errose28

it is only required to instruct OMs to finalize which is not covered by this test.

We are changing the common util here, so if there is case where it is required. Do you think we should rather not do this?

Logs show that it timed out waiting for scm2 to exit safemode.

btw why scm2 wasn't coming out Safemode?

@dombizita

Copy link
Copy Markdown
Contributor

We are changing the common util here, so if there is case where it is required. Do you think we should rather not do this?

This PR is open to the HDDS-14496-zdu branch, where I think there won't be any case where it's required.

@github-actions

Copy link
Copy Markdown

This PR has been marked as stale due to 21 days of inactivity. Please comment or remove the stale label to keep it open. Otherwise, it will be automatically closed in 7 days.

@github-actions github-actions Bot added the stale label Aug 18, 2026
@github-actions

Copy link
Copy Markdown

Thank you for your contribution. This PR is being closed due to inactivity. Please contact a maintainer if you would like to reopen it.

@github-actions github-actions Bot closed this Aug 25, 2026
@errose28

errose28 commented Sep 3, 2026

Copy link
Copy Markdown
Contributor Author

Two fixes and a full root cause are present in #11200

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

stale zdu Pull requests for Zero Downtime Upgrade (ZDU) https://issues.apache.org/jira/browse/HDDS-14496

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants