Skip to content

Core: Add all manifests over-pruning test - #17714

Open
yangshangqing95 wants to merge 1 commit into
apache:mainfrom
yangshangqing95:fix/add-test-all-manifests-ignore-residuals-pruning
Open

Core: Add all manifests over-pruning test#17714
yangshangqing95 wants to merge 1 commit into
apache:mainfrom
yangshangqing95:fix/add-test-all-manifests-ignore-residuals-pruning

Conversation

@yangshangqing95

Copy link
Copy Markdown
Contributor

Follow-up to #17522.

Add coverage to verify that non-snapshot filters do not over-prune snapshots when residuals are ignored.

@github-actions github-actions Bot added the core label Aug 18, 2026
TableScan scan =
allManifestsTable
.newScan()
.filter(Expressions.equal("content", ManifestContent.DATA.id()))

@dramaticlly dramaticlly Aug 18, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we change the filter ? (either notEqual to DATA.id or equal to DELETES.id())

I think the test goal is that to ensure non-REF_SNAPSHOT_ID based filter + ignoreResiduals shall not prune the scan results. Current predicate of content == 0 return positive result for all 4 snapshots, regardless of setting the ignoreResiduals(),

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

make sense, changed to

filter(Expressions.equal("content", ManifestContent.DELETES.id()))

@yangshangqing95
yangshangqing95 force-pushed the fix/add-test-all-manifests-ignore-residuals-pruning branch from 316ce95 to 394135d Compare August 19, 2026 20:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants