Skip to content

[hive] Bug fix for stuck thread on hive prepareCommit failure#8142

Open
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/hive-abort-tolerant-precommit
Open

[hive] Bug fix for stuck thread on hive prepareCommit failure#8142
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/hive-abort-tolerant-precommit

Conversation

@ArnavBalyan
Copy link
Copy Markdown
Member

@ArnavBalyan ArnavBalyan commented Jun 6, 2026

Purpose

  • Today, any hive job writing to Paimon table failing before precommit, causes job to be permanently stuck and does not exit cleanly.
  • This is due to Paimon throwing another exception in the cleanup process, (when there are no files to be cleaned up). In such scenarios, Paimon throws unchecked runtime exception not caught at caller.
  • Causing the parent thread to be permanently stuck waiting job failure to arrive.
  • Ensure that we avoid unprotected file access, and can handle exceptions when precommit files are not generated.
  • This also fixes an issue of CI being stuck and timing out in some cases when the UT has a failure.

Tests

  • UT

@ArnavBalyan
Copy link
Copy Markdown
Member Author

cc @JingsongLi @leaves12138 could you PTAL thanks!

@ArnavBalyan ArnavBalyan force-pushed the arnavb/hive-abort-tolerant-precommit branch from 8bfdafa to 122e74d Compare June 6, 2026 12:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant