Tracking issues of Iceberg Rust 0.8 Release

[kevinjqliu]

This issue is used to track tasks of the iceberg rust 0.8 release.

Tasks

Blockers

Blockers are the tasks that must be completed before the release.

• feat(reader): null struct default values in create_column #1847
• feat(reader): Add binary support to get_arrow_datum for equality deletes with binary type #1848
• feat(reader): Add PartitionSpec support to FileScanTask and RecordBatchTransformer #1821
• feat: Don't drop additional statistics #1849
• Glue catalog concurrent write issue #1868
• iceberg-catalog-s3tables crate on crates.io #1886

Build Release

GitHub Side

• Bump version in project
• Update docs
• Generate dependencies list
• Push release candidate tag to GitHub

ASF Side

• Create an ASF Release
• Upload artifacts to the SVN dist repo

Voting

• Start VOTE at iceberg community

Official Release

• Push the release git tag
• Publish artifacts to SVN RELEASE branch
• Change Iceberg Rust Website download link
• Send the announcement

For details of each step, please refer to: https://rust.iceberg.apache.org/release

[kevinjqliu]

would be great to include #1849 to complete #1714

[mbutrovich]

I added Iceberg Java 1.10.0 (in addition to 1.8.1 and 1.9.1) to Comet's testing this morning and found a couple of new gaps to close in Iceberg Rust functionality. I believe these are the remaining immediate issues that prevent us from merging apache/datafusion-comet#2528.

• feat(reader): null struct default values in create_column #1847
• feat(reader): Add binary support to get_arrow_datum for equality deletes with binary type #1848
• feat(reader): Add PartitionSpec support to FileScanTask and RecordBatchTransformer #1821 (I think this one is close after lots of work with @liurenjie1024, and is the most important one in my mind)

There is still more work to do to support additional features, and I'm happy to keep hacking on them over the coming months, but I'd love those in the 0.8 release.

[CTTY]

There is a critical bug with how we persist tables using GlueCatalog and would be nice if we can fix this in 0.8.0: #1868

[liurenjie1024]

There is a critical bug with how we persist tables using GlueCatalog and would be nice if we can fix this in 0.8.0: #1868

Added to blockers.