[DRAFT] Make Storage a trait #4

CTTY · 2025-10-17T02:20:55Z

Which issue does this PR close?

Closes #.

What changes are included in this PR?

Are these changes tested?

## Which issue does this PR close? - Closes apache#1572 apache#1573 ## What changes are included in this PR? New: - Added new `partitioning` module with `PartitioningWriter` trait - `ClusteredWriter`: Optimized for pre-sorted data, requires writing in partition order - `FanoutWriter`: Flexible writer that can handle data from any partition at any time Modification: - (BREAKING) Modified `DataFileWriterBuilder` to support dynamic partition assignment - Updated DataFusion integration to use the new writer API ## Are these changes tested? Added unit tests

## Which issue does this PR close? - Closes apache#1626 ## What changes are included in this PR? - Introduced a new `SqlCatalogBuilder` implementation for `iceberg::CatalogBuilder`. - By transitioning the builder implementation from `SqlCatalogConfig` to `SqlCatalogBuilder`, we've simplified the process for creating `SqlCatalog` objects. - Enabled generation of `Box<dyn BoxedCatalogBuilder>` for the `SqlCatalog` via the `load` function　(apache#1260) ## Are these changes tested? Yes (only tested whether it could be made） --------- Co-authored-by: Yoshiki Kudo <actionstar619@yahoo.co.jp>

…#1757) ## Which issue does this PR close?  - Closes apache#1756 ## What changes are included in this PR?  Fix broken orbstack and podman links in CONTRIBUTING.md ## Are these changes tested? N/A

Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.47.1 to 1.48.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/tokio-rs/tokio/releases">tokio's releases</a>.</em></p> <blockquote> <h2>Tokio v1.48.0</h2> <h1>1.48.0 (October 14th, 2025)</h1> <p>The MSRV is increased to 1.71.</p> <h3>Added</h3> <ul> <li>fs: add <code>File::max_buf_size</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7594">#7594</a>)</li> <li>io: export <code>Chain</code> of <code>AsyncReadExt::chain</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7599">#7599</a>)</li> <li>net: add <code>SocketAddr::as_abstract_name</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7491">#7491</a>)</li> <li>net: add <code>TcpStream::quickack</code> and <code>TcpStream::set_quickack</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7490">#7490</a>)</li> <li>net: implement <code>AsRef<Self></code> for <code>TcpStream</code> and <code>UnixStream</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7573">#7573</a>)</li> <li>task: add <code>LocalKey::try_get</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7666">#7666</a>)</li> <li>task: implement <code>Ord</code> for <code>task::Id</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7530">#7530</a>)</li> </ul> <h3>Changed</h3> <ul> <li>deps: bump windows-sys to version 0.61 (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7645">#7645</a>)</li> <li>fs: preserve <code>max_buf_size</code> when cloning a <code>File</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7593">#7593</a>)</li> <li>macros: suppress <code>clippy::unwrap_in_result</code> in <code>#[tokio::main]</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7651">#7651</a>)</li> <li>net: remove <code>PollEvented</code> noise from Debug formats (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7675">#7675</a>)</li> <li>process: upgrade <code>Command::spawn_with</code> to use <code>FnOnce</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7511">#7511</a>)</li> <li>sync: remove inner mutex in <code>SetOnce</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7554">#7554</a>)</li> <li>sync: use <code>UnsafeCell::get_mut</code> in <code>Mutex::get_mut</code> and <code>RwLock::get_mut</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7569">#7569</a>)</li> <li>time: reduce the generated code size of <code>Timeout<T>::poll</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7535">#7535</a>)</li> </ul> <h3>Fixed</h3> <ul> <li>macros: fix hygiene issue in <code>join!</code> and <code>try_join!</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7638">#7638</a>)</li> <li>net: fix copy/paste errors in udp peek methods (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7604">#7604</a>)</li> <li>process: fix error when runtime is shut down on nightly-2025-10-12 (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7672">#7672</a>)</li> <li>runtime: use release ordering in <code>wake_by_ref()</code> even if already woken (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7622">#7622</a>)</li> <li>sync: close the <code>broadcast::Sender</code> in <code>broadcast::Sender::new()</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7629">#7629</a>)</li> <li>sync: fix implementation of unused <code>RwLock::try_*</code> methods (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7587">#7587</a>)</li> </ul> <h3>Unstable</h3> <ul> <li>tokio: use cargo features instead of <code>--cfg</code> flags for <code>taskdump</code> and <code>io_uring</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7655">#7655</a>, <a href="https://redirect.github.com/tokio-rs/tokio/issues/7621">#7621</a>)</li> <li>fs: support <code>io_uring</code> in <code>fs::write</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7567">#7567</a>)</li> <li>fs: support <code>io_uring</code> with <code>File::open()</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7617">#7617</a>)</li> <li>fs: support <code>io_uring</code> with <code>OpenOptions</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7321">#7321</a>)</li> <li>macros: add <code>local</code> runtime flavor (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7375">#7375</a>, <a href="https://redirect.github.com/tokio-rs/tokio/issues/7597">#7597</a>)</li> </ul> <h3>Documented</h3> <ul> <li>io: clarify the zero capacity case of <code>AsyncRead::poll_read</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7580">#7580</a>)</li> <li>io: fix typos in the docs of <code>AsyncFd</code> readiness guards (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7583">#7583</a>)</li> <li>net: clarify socket gets closed on drop (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7526">#7526</a>)</li> <li>net: clarify the behavior of <code>UCred::pid()</code> on Cygwin (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7611">#7611</a>)</li> <li>net: clarify the supported platform of <code>set_reuseport()</code> and <code>reuseport()</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7628">#7628</a>)</li> </ul>  </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/tokio-rs/tokio/commit/556820ff84030b37e74e11b86b7733f5795770ea"><code>556820f</code></a> chore: prepare Tokio v1.48.0 (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7677">#7677</a>)</li> <li><a href="https://github.com/tokio-rs/tokio/commit/fd1659a05222858b675d5515ef609ca39d825bff"><code>fd1659a</code></a> chore: prepare tokio-macros v2.6.0 (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7676">#7676</a>)</li> <li><a href="https://github.com/tokio-rs/tokio/commit/53e8acac641a614b89e35912ebed0520c6dbcf93"><code>53e8aca</code></a> ci: update nightly version to 2025-10-12 (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7670">#7670</a>)</li> <li><a href="https://github.com/tokio-rs/tokio/commit/9e5527d1d5eadbeed46f4d5d4eb22cd96c72a39a"><code>9e5527d</code></a> process: fix error when runtime is shut down on nightly-2025-10-12 (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7672">#7672</a>)</li> <li><a href="https://github.com/tokio-rs/tokio/commit/25a24de0e661d86fa059779e87e0605909465f4a"><code>25a24de</code></a> net: remove PollEvented noise from Debug formats (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7675">#7675</a>)</li> <li><a href="https://github.com/tokio-rs/tokio/commit/c1fa25f3009d6f5374e337b999fe4fe926c8e7f2"><code>c1fa25f</code></a> task: clarify the behavior of several <code>spawn_local</code> methods (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7669">#7669</a>)</li> <li><a href="https://github.com/tokio-rs/tokio/commit/e7e02fcf0f16fc906c0fac48aafd6a168ae3cf24"><code>e7e02fc</code></a> fs: use <code>FileOptions</code> inside <code>fs::File</code> to support uring (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7617">#7617</a>)</li> <li><a href="https://github.com/tokio-rs/tokio/commit/f7a7f62959aafd03fd40a07a4f511476dff1e57f"><code>f7a7f62</code></a> ci: remove cargo-deny Unicode-DFS-2016 license exception config (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7619">#7619</a>)</li> <li><a href="https://github.com/tokio-rs/tokio/commit/d1f1499f630c34c1d319acdc2cc86d7a1008c4b4"><code>d1f1499</code></a> tokio: use cargo feature for taskdump support instead of cfg (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7655">#7655</a>)</li> <li><a href="https://github.com/tokio-rs/tokio/commit/ad6f6189529b1067bd4628d1c62abf9a3a64281e"><code>ad6f618</code></a> runtime: clarify the behavior of <code>Handle::block_on</code> (<a href="https://redirect.github.com/tokio-rs/tokio/issues/7665">#7665</a>)</li> <li>Additional commits viewable in <a href="https://github.com/tokio-rs/tokio/compare/tokio-1.47.1...tokio-1.48.0">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=tokio&package-manager=cargo&previous-version=1.47.1&new-version=1.48.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [backon](https://github.com/Xuanwo/backon) from 1.5.2 to 1.6.0. <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/Xuanwo/backon/commit/e24dc92742e201f7320868d46a12ff59eb82ef72"><code>e24dc92</code></a> Bump to version 1.6.0 (<a href="https://redirect.github.com/Xuanwo/backon/issues/218">#218</a>)</li> <li><a href="https://github.com/Xuanwo/backon/commit/7c53db065452e3e15aee399ce34ebfc4bec8014f"><code>7c53db0</code></a> chore(deps): update embassy-time requirement from 0.4 to 0.5 (<a href="https://redirect.github.com/Xuanwo/backon/issues/210">#210</a>)</li> <li><a href="https://github.com/Xuanwo/backon/commit/b60c28c8c537d3dd114be0fa899853f61e3bd09c"><code>b60c28c</code></a> chore: Migrate CLAUDE.md to AGENTS.md (<a href="https://redirect.github.com/Xuanwo/backon/issues/217">#217</a>)</li> <li><a href="https://github.com/Xuanwo/backon/commit/f31c9ca73a530d5a8e362d37a90d1489f144ef33"><code>f31c9ca</code></a> chore(deps): bump actions/setup-node from 4 to 6 (<a href="https://redirect.github.com/Xuanwo/backon/issues/214">#214</a>)</li> <li><a href="https://github.com/Xuanwo/backon/commit/2506e571ae0791ecb93dceb688f23c1cbdb14e0a"><code>2506e57</code></a> refactor: Bump edition to 2024 and MSRV to 1.85 (<a href="https://redirect.github.com/Xuanwo/backon/issues/216">#216</a>)</li> <li><a href="https://github.com/Xuanwo/backon/commit/dba17424f9e2bfc8e575d71d2741a95bfb4c70be"><code>dba1742</code></a> chore: Migrate doc_auto_cfg (<a href="https://redirect.github.com/Xuanwo/backon/issues/215">#215</a>)</li> <li><a href="https://github.com/Xuanwo/backon/commit/de0a04105bb6cb42fecb82122e7afbee28c24cd5"><code>de0a041</code></a> refactor: drop constraint on Future's Output (<a href="https://redirect.github.com/Xuanwo/backon/issues/213">#213</a>)</li> <li><a href="https://github.com/Xuanwo/backon/commit/f68b793a2a7e9a99f01436dae4ad3b39a11b1cab"><code>f68b793</code></a> chore(deps): bump actions/checkout from 4 to 5 (<a href="https://redirect.github.com/Xuanwo/backon/issues/209">#209</a>)</li> <li>See full diff in <a href="https://github.com/Xuanwo/backon/compare/v1.5.2...v1.6.0">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=backon&package-manager=cargo&previous-version=1.5.2&new-version=1.6.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…les, and fix partition scoped matching to consider spec id (apache#1758) ## Which issue does this PR close?  - Closes apache#1759. ## What changes are included in this PR? This changes scan planning of equality deletes so that: 1. we only match against eq deletes which are strictly older than the data file. Right now it looks like we incorrectly over-apply based on the seq number for global equality deletes. 2. Partition scoped deletes (both equality and position) are compared correctly by also factoring in the spec ID. It's not quite enough to compare just off the tuple, we should also compare based off the spec ID as well. ## Are these changes tested? Added unit tests which are scoped to testing delete index matching logic. If tests are not included in your PR, please explain why (for example, are they covered by existing tests)? -->

…1760) Bumps [apache/skywalking-eyes](https://github.com/apache/skywalking-eyes) from 0.7.0 to 0.8.0. <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/skywalking-eyes/commit/61275cc80d0798a405cb070f7d3a8aaf7cf2c2c1"><code>61275cc</code></a> Add fsf-free and osi-approved options (<a href="https://redirect.github.com/apache/skywalking-eyes/issues/250">#250</a>)</li> <li><a href="https://github.com/apache/skywalking-eyes/commit/d1a97dfe935d8d66f1cea93d05a763f7efd08d27"><code>d1a97df</code></a> Update example workflow in the README for the Ruby scenario (<a href="https://redirect.github.com/apache/skywalking-eyes/issues/248">#248</a>)</li> <li><a href="https://github.com/apache/skywalking-eyes/commit/2ca7b4de66bc42c76dc23a9a63a9899a31434fd1"><code>2ca7b4d</code></a> fix: Gemfile / Gemspec parser to ignore commented dependencies (<a href="https://redirect.github.com/apache/skywalking-eyes/issues/249">#249</a>)</li> <li><a href="https://github.com/apache/skywalking-eyes/commit/454b8ead48f7073cd40ea20487fdfb2409247e69"><code>454b8ea</code></a> feat: add some compatibility licenses (<a href="https://redirect.github.com/apache/skywalking-eyes/issues/247">#247</a>)</li> <li><a href="https://github.com/apache/skywalking-eyes/commit/36f75de28f410b0d4eab1534a685ea59435171da"><code>36f75de</code></a> feat: Compatibility matrix: MIT & Ruby (<a href="https://redirect.github.com/apache/skywalking-eyes/issues/209">#209</a>)</li> <li><a href="https://github.com/apache/skywalking-eyes/commit/18cb362bacae99d5a5c940d67847b52e19741e85"><code>18cb362</code></a> GemfileLockResolver adjusted to exclude all specs when runtime dependencies a...</li> <li><a href="https://github.com/apache/skywalking-eyes/commit/5a19c655ba4cb6befa50c1bc4c1f03b6a68ce871"><code>5a19c65</code></a> Fixed a panic caused by nil dependency specs in Ruby Gemfile.lock resolver (#...</li> <li><a href="https://github.com/apache/skywalking-eyes/commit/0d9c4df441f742f91faefd840d3ca48b49f28d2b"><code>0d9c4df</code></a> fix: return error in license check, add MIT header (<a href="https://redirect.github.com/apache/skywalking-eyes/issues/206">#206</a>)</li> <li><a href="https://github.com/apache/skywalking-eyes/commit/3655e78854be6a56ae72a0c9a847aedd133c3b74"><code>3655e78</code></a> Ruby dependency license scanning support via Gemfile.lock. (<a href="https://redirect.github.com/apache/skywalking-eyes/issues/205">#205</a>)</li> <li><a href="https://github.com/apache/skywalking-eyes/commit/07a607ff5b0759f5ed47306c865aac50fe9b3985"><code>07a607f</code></a> Bump golang.org/x/oauth2 from 0.5.0 to 0.27.0 (<a href="https://redirect.github.com/apache/skywalking-eyes/issues/204">#204</a>)</li> <li>Additional commits viewable in <a href="https://github.com/apache/skywalking-eyes/compare/v0.7.0...v0.8.0">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=apache/skywalking-eyes&package-manager=github_actions&previous-version=0.7.0&new-version=0.8.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [rust_decimal](https://github.com/paupino/rust-decimal) from 1.38.0 to 1.39.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/paupino/rust-decimal/releases">rust_decimal's releases</a>.</em></p> <blockquote> <h2>1.39.0</h2> <h2>What's Changed</h2> <ul> <li>v1 <code>postgres</code> -> <code>postgres_backend</code> by <a href="https://github.com/Logarithmus"><code>@Logarithmus</code></a> in <a href="https://redirect.github.com/paupino/rust-decimal/pull/751">paupino/rust-decimal#751</a></li> <li>Remove doc_auto_cfg and address lifetime warnings by <a href="https://github.com/paupino"><code>@paupino</code></a> in <a href="https://redirect.github.com/paupino/rust-decimal/pull/755">paupino/rust-decimal#755</a></li> <li>Version 1.39.0 by <a href="https://github.com/paupino"><code>@paupino</code></a> in <a href="https://redirect.github.com/paupino/rust-decimal/pull/756">paupino/rust-decimal#756</a></li> </ul> <h2>New Contributors</h2> <ul> <li><a href="https://github.com/Logarithmus"><code>@Logarithmus</code></a> made their first contribution in <a href="https://redirect.github.com/paupino/rust-decimal/pull/751">paupino/rust-decimal#751</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/paupino/rust-decimal/compare/1.38.0...1.39.0">https://github.com/paupino/rust-decimal/compare/1.38.0...1.39.0</a></p> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/paupino/rust-decimal/commit/a028cf43fe1c383cc6927ed2dbd4b6aac443e99c"><code>a028cf4</code></a> Version 1.39.0 (<a href="https://redirect.github.com/paupino/rust-decimal/issues/756">#756</a>)</li> <li><a href="https://github.com/paupino/rust-decimal/commit/c52f1f12931dcd21956189e3f48e8baedb7e3f31"><code>c52f1f1</code></a> Remove doc_auto_cfg and address lifetime warnings (<a href="https://redirect.github.com/paupino/rust-decimal/issues/755">#755</a>)</li> <li><a href="https://github.com/paupino/rust-decimal/commit/4bf40bd105edec473e1a19e9a0a83c16615786d0"><code>4bf40bd</code></a> Merge pull request <a href="https://redirect.github.com/paupino/rust-decimal/issues/751">#751</a> from Logarithmus/postgres-backend</li> <li><a href="https://github.com/paupino/rust-decimal/commit/9da94d0be903d4c7a4a6f3f7c2aeb6713fcfcd70"><code>9da94d0</code></a> <code>postgres</code> -> <code>postgres_backend</code></li> <li>See full diff in <a href="https://github.com/paupino/rust-decimal/compare/1.38.0...1.39.0">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=rust_decimal&package-manager=cargo&previous-version=1.38.0&new-version=1.39.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Renjie Liu <liurenjie2008@gmail.com>

…umns (apache#1602) ## Which issue does this PR close? - Closes apache#1542 ## What changes are included in this PR? Implement a physical execution plan node that projects Iceberg partition columns from source data, supporting nested fields and all Iceberg transforms. ## Are these changes tested? Yes, with unit tests --------- Signed-off-by: Florian Valeye <florian.valeye@gmail.com>

## Which issue does this PR close? - Closes #. There was no open issue for this. I noticed this while trying out iceberg-rust. ## What changes are included in this PR? The first line in the method `SnapshotProducer::write_added_manifest` (`let added_data_files = std::mem::take(&mut self.added_data_files);`) sets the `self.added_data_files` to an empty vec. `SnapshotProducer::write_added_manifest` is called via the call chain `SnapshotProducer::commit` -> `SnapshotProducer::manifest_file` -> `SnapshotProducer::write_added_manifest`). Hence, if `SnapshotProducer::summary` is called after calling `SnapshotProducer::manifest_file`, the summary produced was empty due to empty `self.added_data_files`. This PR rearranges the code in `SnapshotProducer::commit` to make sure the produced summary is not empty. ## Are these changes tested? No new tests have been added for this as there were no previous tests.

## Which issue does this PR close? - Closes apache#1745 ## What changes are included in this PR? - As title, added examples and documentation ## Are these changes tested?

…ntegration (apache#1764) ## Which issue does this PR close? - Relates to apache#1211 - Part of apache#1621 - Add support for iceberg datafusion integration with sqllogictests ## What changes are included in this PR? * Add sqllogictests entry point `sqllogictests.rs` * Update `Schedule` to track `EngineRunner` instead of `Engine` * Update datafusion engine to run slt file with sqllogictest ## Are these changes tested? * `cargo test --test sqllogictests` ``` Finished `test` profile [unoptimized + debuginfo] target(s) in 0.46s Running tests/sqllogictests.rs (target/debug/deps/sqllogictests-8ee6c1e0fdedebe4) running 1 test test schedule: df_test.toml ... ok test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s ``` --------- Co-authored-by: Renjie Liu <liurenjie2008@gmail.com>

## Which issue does this PR close? - A minor followup of apache#1783 ## What changes are included in this PR? - Update Cargo.lock to add home ## Are these changes tested? No

Bumps [rand](https://github.com/rust-random/rand) from 0.8.5 to 0.9.2. <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/rust-random/rand/blob/master/CHANGELOG.md">rand's changelog</a>.</em></p> <blockquote> <h2>[0.9.2 — 2025-07-20]</h2> <h3>Deprecated</h3> <ul> <li>Deprecate <code>rand::rngs::mock</code> module and <code>StepRng</code> generator (<a href="https://redirect.github.com/rust-random/rand/issues/1634">#1634</a>)</li> </ul> <h3>Additions</h3> <ul> <li>Enable <code>WeightedIndex<usize></code> (de)serialization (<a href="https://redirect.github.com/rust-random/rand/issues/1646">#1646</a>)</li> </ul> <h2>[0.9.1] - 2025-04-17</h2> <h3>Security and unsafe</h3> <ul> <li>Revise "not a crypto library" policy again (<a href="https://redirect.github.com/rust-random/rand/issues/1565">#1565</a>)</li> <li>Remove <code>zerocopy</code> dependency from <code>rand</code> (<a href="https://redirect.github.com/rust-random/rand/issues/1579">#1579</a>)</li> </ul> <h3>Fixes</h3> <ul> <li>Fix feature <code>simd_support</code> for recent nightly rust (<a href="https://redirect.github.com/rust-random/rand/issues/1586">#1586</a>)</li> </ul> <h3>Changes</h3> <ul> <li>Allow <code>fn rand::seq::index::sample_weighted</code> and <code>fn IndexedRandom::choose_multiple_weighted</code> to return fewer than <code>amount</code> results (<a href="https://redirect.github.com/rust-random/rand/issues/1623">#1623</a>), reverting an undocumented change (<a href="https://redirect.github.com/rust-random/rand/issues/1382">#1382</a>) to the previous release.</li> </ul> <h3>Additions</h3> <ul> <li>Add <code>rand::distr::Alphabetic</code> distribution. (<a href="https://redirect.github.com/rust-random/rand/issues/1587">#1587</a>)</li> <li>Re-export <code>rand_core</code> (<a href="https://redirect.github.com/rust-random/rand/issues/1604">#1604</a>)</li> </ul> <h2>[0.9.0] - 2025-01-27</h2> <h3>Security and unsafe</h3> <ul> <li>Policy: "rand is not a crypto library" (<a href="https://redirect.github.com/rust-random/rand/issues/1514">#1514</a>)</li> <li>Remove fork-protection from <code>ReseedingRng</code> and <code>ThreadRng</code>. Instead, it is recommended to call <code>ThreadRng::reseed</code> on fork. (<a href="https://redirect.github.com/rust-random/rand/issues/1379">#1379</a>)</li> <li>Use <code>zerocopy</code> to replace some <code>unsafe</code> code (<a href="https://redirect.github.com/rust-random/rand/issues/1349">#1349</a>, <a href="https://redirect.github.com/rust-random/rand/issues/1393">#1393</a>, <a href="https://redirect.github.com/rust-random/rand/issues/1446">#1446</a>, <a href="https://redirect.github.com/rust-random/rand/issues/1502">#1502</a>)</li> </ul> <h3>Dependencies</h3> <ul> <li>Bump the MSRV to 1.63.0 (<a href="https://redirect.github.com/rust-random/rand/issues/1207">#1207</a>, <a href="https://redirect.github.com/rust-random/rand/issues/1246">#1246</a>, <a href="https://redirect.github.com/rust-random/rand/issues/1269">#1269</a>, <a href="https://redirect.github.com/rust-random/rand/issues/1341">#1341</a>, <a href="https://redirect.github.com/rust-random/rand/issues/1416">#1416</a>, <a href="https://redirect.github.com/rust-random/rand/issues/1536">#1536</a>); note that 1.60.0 may work for dependents when using <code>--ignore-rust-version</code></li> <li>Update to <code>rand_core</code> v0.9.0 (<a href="https://redirect.github.com/rust-random/rand/issues/1558">#1558</a>)</li> </ul> <h3>Features</h3> <ul> <li>Support <code>std</code> feature without <code>getrandom</code> or <code>rand_chacha</code> (<a href="https://redirect.github.com/rust-random/rand/issues/1354">#1354</a>)</li> <li>Enable feature <code>small_rng</code> by default (<a href="https://redirect.github.com/rust-random/rand/issues/1455">#1455</a>)</li> <li>Remove implicit feature <code>rand_chacha</code>; use <code>std_rng</code> instead. (<a href="https://redirect.github.com/rust-random/rand/issues/1473">#1473</a>)</li> <li>Rename feature <code>serde1</code> to <code>serde</code> (<a href="https://redirect.github.com/rust-random/rand/issues/1477">#1477</a>)</li> <li>Rename feature <code>getrandom</code> to <code>os_rng</code> (<a href="https://redirect.github.com/rust-random/rand/issues/1537">#1537</a>)</li> <li>Add feature <code>thread_rng</code> (<a href="https://redirect.github.com/rust-random/rand/issues/1547">#1547</a>)</li> </ul> <h3>API changes: rand_core traits</h3> <ul> <li>Add fn <code>RngCore::read_adapter</code> implementing <code>std::io::Read</code> (<a href="https://redirect.github.com/rust-random/rand/issues/1267">#1267</a>)</li> <li>Add trait <code>CryptoBlockRng: BlockRngCore</code>; make <code>trait CryptoRng: RngCore</code> (<a href="https://redirect.github.com/rust-random/rand/issues/1273">#1273</a>)</li> <li>Add traits <code>TryRngCore</code>, <code>TryCryptoRng</code> (<a href="https://redirect.github.com/rust-random/rand/issues/1424">#1424</a>, <a href="https://redirect.github.com/rust-random/rand/issues/1499">#1499</a>)</li> <li>Rename <code>fn SeedableRng::from_rng</code> -> <code>try_from_rng</code> and add infallible variant <code>fn from_rng</code> (<a href="https://redirect.github.com/rust-random/rand/issues/1424">#1424</a>)</li> <li>Rename <code>fn SeedableRng::from_entropy</code> -> <code>from_os_rng</code> and add fallible variant <code>fn try_from_os_rng</code> (<a href="https://redirect.github.com/rust-random/rand/issues/1424">#1424</a>)</li> <li>Add bounds <code>Clone</code> and <code>AsRef</code> to associated type <code>SeedableRng::Seed</code> (<a href="https://redirect.github.com/rust-random/rand/issues/1491">#1491</a>)</li> </ul> <h3>API changes: Rng trait and top-level fns</h3> <ul> <li>Rename fn <code>rand::thread_rng()</code> to <code>rand::rng()</code> and remove from the prelude (<a href="https://redirect.github.com/rust-random/rand/issues/1506">#1506</a>)</li> </ul>  </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/rust-random/rand/commit/d3dd4157052e5431ce42e157b544968560a68b95"><code>d3dd415</code></a> Prepare rand_core 0.9.2 (<a href="https://redirect.github.com/rust-random/rand/issues/1605">#1605</a>)</li> <li><a href="https://github.com/rust-random/rand/commit/99fabd20e9b39d0af7c2ed6c31dbcad83a1703fd"><code>99fabd2</code></a> Prepare rand_core 0.9.2</li> <li><a href="https://github.com/rust-random/rand/commit/c7fe1c43b5ba53aacad5fbac94a8b88788564049"><code>c7fe1c4</code></a> rand: re-export <code>rand_core</code> (<a href="https://redirect.github.com/rust-random/rand/issues/1604">#1604</a>)</li> <li><a href="https://github.com/rust-random/rand/commit/db2b1e0bb41b0a1435b9fecaa1b7bdb531183204"><code>db2b1e0</code></a> rand: re-export <code>rand_core</code></li> <li><a href="https://github.com/rust-random/rand/commit/ee1d96f9f527dbe6f873c8a5ccf47d60a6b8f7b7"><code>ee1d96f</code></a> rand_core: implement reborrow for <code>UnwrapMut</code> (<a href="https://redirect.github.com/rust-random/rand/issues/1595">#1595</a>)</li> <li><a href="https://github.com/rust-random/rand/commit/e0eb2ee0fcc0b07afb901465f4a8ba7f07128f87"><code>e0eb2ee</code></a> rand_core: implement reborrow for <code>UnwrapMut</code></li> <li><a href="https://github.com/rust-random/rand/commit/975f602f5dbbdab0a024e0c5e8b527907426bd8c"><code>975f602</code></a> fixup clippy 1.85 warnings</li> <li><a href="https://github.com/rust-random/rand/commit/775b05be1b8a4fdef17c6601cd223551fbf67edc"><code>775b05b</code></a> Relax <code>Sized</code> requirements for blanket impls (<a href="https://redirect.github.com/rust-random/rand/issues/1593">#1593</a>)</li> <li><a href="https://github.com/rust-random/rand/commit/ec6d5c06a5384c14563a2164bb4a038100a5bb78"><code>ec6d5c0</code></a> Prepare rand_core v0.9.1 (<a href="https://redirect.github.com/rust-random/rand/issues/1591">#1591</a>)</li> <li><a href="https://github.com/rust-random/rand/commit/6a06056e8a892bfa181ec24a8ea16aa9f2fe97d3"><code>6a06056</code></a> rand_core: introduce an UnwrapMut wrapper (<a href="https://redirect.github.com/rust-random/rand/issues/1589">#1589</a>)</li> <li>Additional commits viewable in <a href="https://github.com/rust-random/rand/compare/0.8.5...rand_core-0.9.2">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=rand&package-manager=cargo&previous-version=0.8.5&new-version=0.9.2)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Renjie Liu <liurenjie2008@gmail.com>

Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 5 to 6. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/actions/download-artifact/releases">actions/download-artifact's releases</a>.</em></p> <blockquote> <h2>v6.0.0</h2> <h2>What's Changed</h2> <p><strong>BREAKING CHANGE:</strong> this update supports Node <code>v24.x</code>. This is not a breaking change per-se but we're treating it as such.</p> <ul> <li>Update README for download-artifact v5 changes by <a href="https://github.com/yacaovsnc"><code>@yacaovsnc</code></a> in <a href="https://redirect.github.com/actions/download-artifact/pull/417">actions/download-artifact#417</a></li> <li>Update README with artifact extraction details by <a href="https://github.com/yacaovsnc"><code>@yacaovsnc</code></a> in <a href="https://redirect.github.com/actions/download-artifact/pull/424">actions/download-artifact#424</a></li> <li>Readme: spell out the first use of GHES by <a href="https://github.com/danwkennedy"><code>@danwkennedy</code></a> in <a href="https://redirect.github.com/actions/download-artifact/pull/431">actions/download-artifact#431</a></li> <li>Bump <code>@actions/artifact</code> to <code>v4.0.0</code></li> <li>Prepare <code>v6.0.0</code> by <a href="https://github.com/danwkennedy"><code>@danwkennedy</code></a> in <a href="https://redirect.github.com/actions/download-artifact/pull/438">actions/download-artifact#438</a></li> </ul> <h2>New Contributors</h2> <ul> <li><a href="https://github.com/danwkennedy"><code>@danwkennedy</code></a> made their first contribution in <a href="https://redirect.github.com/actions/download-artifact/pull/431">actions/download-artifact#431</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/actions/download-artifact/compare/v5...v6.0.0">https://github.com/actions/download-artifact/compare/v5...v6.0.0</a></p> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/actions/download-artifact/commit/018cc2cf5baa6db3ef3c5f8a56943fffe632ef53"><code>018cc2c</code></a> Merge pull request <a href="https://redirect.github.com/actions/download-artifact/issues/438">#438</a> from actions/danwkennedy/prepare-6.0.0</li> <li><a href="https://github.com/actions/download-artifact/commit/815651c680ffe1c95719d0ed08aba1a2f9d5c177"><code>815651c</code></a> Revert "Remove <code>github.dep.yml</code>"</li> <li><a href="https://github.com/actions/download-artifact/commit/bb3a066a8babc8ed7b3e4218896c548fe34e7115"><code>bb3a066</code></a> Remove <code>github.dep.yml</code></li> <li><a href="https://github.com/actions/download-artifact/commit/fa1ce46bbd11b8387539af12741055a76dfdf804"><code>fa1ce46</code></a> Prepare <code>v6.0.0</code></li> <li><a href="https://github.com/actions/download-artifact/commit/4a24838f3d5601fd639834081e118c2995d51e1c"><code>4a24838</code></a> Merge pull request <a href="https://redirect.github.com/actions/download-artifact/issues/431">#431</a> from danwkennedy/patch-1</li> <li><a href="https://github.com/actions/download-artifact/commit/5e3251c4ff5a32e4cf8dd4adaee0e692365237ae"><code>5e3251c</code></a> Readme: spell out the first use of GHES</li> <li><a href="https://github.com/actions/download-artifact/commit/abefc31eafcfbdf6c5336127c1346fdae79ff41c"><code>abefc31</code></a> Merge pull request <a href="https://redirect.github.com/actions/download-artifact/issues/424">#424</a> from actions/yacaovsnc/update_readme</li> <li><a href="https://github.com/actions/download-artifact/commit/ac43a6070aa7db8a41e756e7a2846221edca7027"><code>ac43a60</code></a> Update README with artifact extraction details</li> <li><a href="https://github.com/actions/download-artifact/commit/de96f4613b77ec03b5cf633e7c350c32bd3c5660"><code>de96f46</code></a> Merge pull request <a href="https://redirect.github.com/actions/download-artifact/issues/417">#417</a> from actions/yacaovsnc/update_readme</li> <li><a href="https://github.com/actions/download-artifact/commit/7993cb44e9052f2f08f9b828ae5ef3ecca7d2ac7"><code>7993cb4</code></a> Remove migration guide for artifact download changes</li> <li>Additional commits viewable in <a href="https://github.com/actions/download-artifact/compare/v5...v6">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=actions/download-artifact&package-manager=github_actions&previous-version=5&new-version=6)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Renjie Liu <liurenjie2008@gmail.com>

…apache#1779)

…atchPartitionSplitter (apache#1781) ## Which issue does this PR close? - Closes apache#1786 - Covered some of changes from the previous draft: apache#1769 ## What changes are included in this PR? - Move PartitionValueCalculator to core/arrow so it can be reused by RecordBatchPartitionSplitter - Allow skipping partition value calculation in partition splitter for projected batches - Return <PartitionKey, RecordBatch> rather than <Struct, RecordBatch> pairs in RecordBatchPartitionSplitter::split ## Are these changes tested? Added uts

## Which issue does this PR close? Closes apache#1702 ## What changes are included in this PR? - a dependency upgrade from Datafusion 48 to 49 - a dependency specificity change from an exact pinned patch version to a broader major version (IMO this is better for broader compatibility) - fixes to breaking APIs ## Are these changes tested?  --------- Signed-off-by: Xuanwo <github@xuanwo.io> Co-authored-by: Xuanwo <github@xuanwo.io>

## Which issue does this PR close?  - Closes #. ## What changes are included in this PR?  Revert of apache#1737 pydantic release a fix in 2.12.3 which will be automatically used by resolver (see simliar in pyiceberg, apache/iceberg-python#2635) ## Are these changes tested?

…umn (apache#1792) ## Which issue does this PR close?  - Partially address apache#1749. Iceberg Java has a test that does a schema change requires the `RecordBatchTransformer` to add a Date32 column, which it currently does not support. ## What changes are included in this PR?  Add match arms for `Date32` type in `create_column`. ## Are these changes tested?  New test that mirrors Iceberg Java's `TestSelect.readAndWriteWithBranchAfterSchemaChange` --------- Co-authored-by: Xuanwo <github@xuanwo.io>

## Which issue does this PR close?  - Addresses the S3Table part of apache#1389 ## What changes are included in this PR? - Implemented update_table for S3TablesCatalog  ## Are these changes tested? added a test  --------- Signed-off-by: Xuanwo <github@xuanwo.io> Co-authored-by: Xuanwo <github@xuanwo.io>

## Which issue does this PR close?  - Closes #. ## What changes are included in this PR?  ## Are these changes tested?  --------- Signed-off-by: Xuanwo <github@xuanwo.io> Co-authored-by: Xuanwo <github@xuanwo.io>

## Which issue does this PR close? - Closes apache#1794 ## What changes are included in this PR? Migrate to uv ## Are these changes tested? --------- Signed-off-by: Xuanwo <github@xuanwo.io>

## Which issue does this PR close? - Closes #. ## What changes are included in this PR? This PR is going to relax the MSRV check thanks to rust 2024. Since starts from rust 2024, cargo has [msrv aware dep resolve](https://doc.rust-lang.org/edition-guide/rust-2024/cargo-resolver.html). This means that dep's upgrade no a problem now. ## Are these changes tested? Signed-off-by: Xuanwo <github@xuanwo.io> Co-authored-by: Renjie Liu <liurenjie2008@gmail.com>

Fixes `TestSparkReaderDeletes.testPosDeletesOnParquetFileWithMultipleRowGroups` in Iceberg Java 1.10 with DataFusion Comet. ## Which issue does this PR close? - Partially address apache#1749. ## What changes are included in this PR? - While `RecordBatchTransformer` does not have exhaustive nested type support yet, this adds logic to `create_column` in the specific scenario for a schema evolution with a new struct column that uses the default NULL value. - If the column has a default value other than NULL defined, it will fall into the existing match arm and say it is unsupported. ## Are these changes tested? New test to reflect what happens with Iceberg Java 1.10's `TestSparkReaderDeletes.testPosDeletesOnParquetFileWithMultipleRowGroups`. The test is misleading, since I figured testing positional deletes would just be a delete vector and be schema agnostic, but [it includes schema change with binary and struct types so we need default NULL values](https://github.com/apache/iceberg/blob/53c046efda5d6c6ac67caf7de29849ab7ac6d406/data/src/test/java/org/apache/iceberg/data/DeleteReadTests.java#L65).

…n methods (apache#1853) ## Which issue does this PR close? - Closes #. ## What changes are included in this PR? ## Summary Refactor `SnapshotProducer` validation methods to use internal state instead of requiring redundant parameters. ## Problem I've noticed that while the current **SnapshotProducer** API design already equips SnapshotProducer with all necessary state, the current invocations still redundantly pass parameters externally. I believe this could lead to some issues. 1. **Data mismatch risk**: Callers could pass different data than what's stored in `SnapshotProducer`, leading to validating one set of files but committing another 2. **API complexity**: As more validations are added (e.g., delete files, file existence checks), each method would require additional parameters, making the API harder to use 3. **Redundant passing**: The same data that was already provided during construction has to be passed again ## Changes - Modified `validate_added_data_files()` and `validate_duplicate_files()` to operate on `self.added_data_files` directly - Updated `FastAppendAction::commit()` to call validation methods without passing `added_data_files` parameter ## Motivation Previously, `added_data_files` was passed as a parameter to validation methods even though it was already stored in `SnapshotProducer`: ```rust // Before snapshot_producer.validate_added_data_files(&self.added_data_files)?; // After snapshot_producer.validate_added_data_files()?; ``` ## Benefits 1. Better encapsulation - validation operates on object's own state 2. Safer API - eliminates possibility of data mismatch 3. Simpler interface - no redundant parameters needed ## Discussion Since **SnapshotProducer** already holds all necessary state, can we further refine validation by performing it during the **new** function's execution to improve data consistency and encapsulation? ## Are these changes tested?

## Which issue does this PR close? - Closes #. ## What changes are included in this PR? Follow up to apache#1836 Also add `verbose: true` to `pypa/gh-action-pypi-publish` in `.github/workflows/release_python.yml` ## Are these changes tested?

…pache#1857) ## Which issue does this PR close?  - Closes #. ## What changes are included in this PR? This should fix CI, currently broken with ``` 795 | RecordBatchTransformer::build(snapshot_schema, &projected_iceberg_field_ids); | ^^^^^ function or associated item not found in `RecordBatchTransformer` ``` Likely due to merge conflict between https://github.com/apache/iceberg-rust/pull/1847/files#diff-640415fbb0b37eac6f774eff524fb364c4e54c02da3a3c0e355af5caa941007cR637 and https://github.com/apache/iceberg-rust/pull/1821/files#diff-640415fbb0b37eac6f774eff524fb364c4e54c02da3a3c0e355af5caa941007cR149  ## Are these changes tested?

Bumps [bytes](https://github.com/tokio-rs/bytes) from 1.10.1 to 1.11.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/tokio-rs/bytes/releases">bytes's releases</a>.</em></p> <blockquote> <h2>Bytes v1.11.0</h2> <h1>1.11.0 (November 14th, 2025)</h1> <ul> <li>Bump MSRV to 1.57 (<a href="https://redirect.github.com/tokio-rs/bytes/issues/788">#788</a>)</li> </ul> <h3>Fixed</h3> <ul> <li>fix: <code>BytesMut</code> only reuse if src has remaining (<a href="https://redirect.github.com/tokio-rs/bytes/issues/803">#803</a>)</li> <li>Specialize <code>BytesMut::put::<Bytes></code> (<a href="https://redirect.github.com/tokio-rs/bytes/issues/793">#793</a>)</li> <li>Reserve capacity in <code>BytesMut::put</code> (<a href="https://redirect.github.com/tokio-rs/bytes/issues/794">#794</a>)</li> <li>Change <code>BytesMut::remaining_mut</code> to use <code>isize::MAX</code> instead of <code>usize::MAX</code> (<a href="https://redirect.github.com/tokio-rs/bytes/issues/795">#795</a>)</li> </ul> <h3>Internal changes</h3> <ul> <li>Guarantee address in <code>slice()</code> for empty slices. (<a href="https://redirect.github.com/tokio-rs/bytes/issues/780">#780</a>)</li> <li>Rename <code>Vtable::to_*</code> -> <code>Vtable::into_*</code> (<a href="https://redirect.github.com/tokio-rs/bytes/issues/776">#776</a>)</li> <li>Fix latest clippy warnings (<a href="https://redirect.github.com/tokio-rs/bytes/issues/787">#787</a>)</li> <li>Ignore <code>BytesMut::freeze</code> doctest on wasm (<a href="https://redirect.github.com/tokio-rs/bytes/issues/790">#790</a>)</li> <li>Move <code>drop_fn</code> of <code>from_owner</code> into vtable (<a href="https://redirect.github.com/tokio-rs/bytes/issues/801">#801</a>)</li> </ul> </blockquote> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/tokio-rs/bytes/blob/master/CHANGELOG.md">bytes's changelog</a>.</em></p> <blockquote> <h1>1.11.0 (November 14th, 2025)</h1> <ul> <li>Bump MSRV to 1.57 (<a href="https://redirect.github.com/tokio-rs/bytes/issues/788">#788</a>)</li> </ul> <h3>Fixed</h3> <ul> <li>fix: <code>BytesMut</code> only reuse if src has remaining (<a href="https://redirect.github.com/tokio-rs/bytes/issues/803">#803</a>)</li> <li>Specialize <code>BytesMut::put::<Bytes></code> (<a href="https://redirect.github.com/tokio-rs/bytes/issues/793">#793</a>)</li> <li>Reserve capacity in <code>BytesMut::put</code> (<a href="https://redirect.github.com/tokio-rs/bytes/issues/794">#794</a>)</li> <li>Change <code>BytesMut::remaining_mut</code> to use <code>isize::MAX</code> instead of <code>usize::MAX</code> (<a href="https://redirect.github.com/tokio-rs/bytes/issues/795">#795</a>)</li> </ul> <h3>Internal changes</h3> <ul> <li>Guarantee address in <code>slice()</code> for empty slices. (<a href="https://redirect.github.com/tokio-rs/bytes/issues/780">#780</a>)</li> <li>Rename <code>Vtable::to_*</code> -> <code>Vtable::into_*</code> (<a href="https://redirect.github.com/tokio-rs/bytes/issues/776">#776</a>)</li> <li>Fix latest clippy warnings (<a href="https://redirect.github.com/tokio-rs/bytes/issues/787">#787</a>)</li> <li>Ignore <code>BytesMut::freeze</code> doctest on wasm (<a href="https://redirect.github.com/tokio-rs/bytes/issues/790">#790</a>)</li> <li>Move <code>drop_fn</code> of <code>from_owner</code> into vtable (<a href="https://redirect.github.com/tokio-rs/bytes/issues/801">#801</a>)</li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/tokio-rs/bytes/commit/a7952fb4478f6dc226f623b217432fbc6f8dad24"><code>a7952fb</code></a> chore: prepare bytes v1.11.0 (<a href="https://redirect.github.com/tokio-rs/bytes/issues/804">#804</a>)</li> <li><a href="https://github.com/tokio-rs/bytes/commit/60cbb776f22e4ef2268c026e88a24d6ed75b3776"><code>60cbb77</code></a> fix: <code>BytesMut</code> only reuse if src has remaining (<a href="https://redirect.github.com/tokio-rs/bytes/issues/803">#803</a>)</li> <li><a href="https://github.com/tokio-rs/bytes/commit/7ce330f5192a322fb1efefe7ac9a3850b27162a1"><code>7ce330f</code></a> Move drop_fn of from_owner into vtable (<a href="https://redirect.github.com/tokio-rs/bytes/issues/801">#801</a>)</li> <li><a href="https://github.com/tokio-rs/bytes/commit/4b53a29eb26716592ef2f00f925ef58ccb182e61"><code>4b53a29</code></a> Tweak BytesMut::remaining_mut (<a href="https://redirect.github.com/tokio-rs/bytes/issues/795">#795</a>)</li> <li><a href="https://github.com/tokio-rs/bytes/commit/016fdbdc7a95f6764186dacfcaeef94d77e89cd1"><code>016fdbd</code></a> Reserve capacity in BytesMut::put (<a href="https://redirect.github.com/tokio-rs/bytes/issues/794">#794</a>)</li> <li><a href="https://github.com/tokio-rs/bytes/commit/ef7f25736cfe48db5b42f2aa3225cace4126d2ac"><code>ef7f257</code></a> Specialize BytesMut::put::<Bytes> (<a href="https://redirect.github.com/tokio-rs/bytes/issues/793">#793</a>)</li> <li><a href="https://github.com/tokio-rs/bytes/commit/8b4f54d0f317724bfeab29232f8a9333b3d8625e"><code>8b4f54d</code></a> Ignore BytesMut::freeze doctest on wasm (<a href="https://redirect.github.com/tokio-rs/bytes/issues/790">#790</a>)</li> <li><a href="https://github.com/tokio-rs/bytes/commit/16132ad2593402aa7dbd882b0ce22a40bfacfd96"><code>16132ad</code></a> Fix latest clippy warnings (<a href="https://redirect.github.com/tokio-rs/bytes/issues/787">#787</a>)</li> <li><a href="https://github.com/tokio-rs/bytes/commit/3e44f88f5fae6dfcd3aa0779b804b3ff18afdee3"><code>3e44f88</code></a> Bump MSRV to 1.57 (<a href="https://redirect.github.com/tokio-rs/bytes/issues/788">#788</a>)</li> <li><a href="https://github.com/tokio-rs/bytes/commit/f29e93951da599095f54d57667c1988960ceff71"><code>f29e939</code></a> Add some tests for Limit, BytesMut and Reader (<a href="https://redirect.github.com/tokio-rs/bytes/issues/785">#785</a>)</li> <li>Additional commits viewable in <a href="https://github.com/tokio-rs/bytes/compare/v1.10.1...v1.11.0">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=bytes&package-manager=cargo&previous-version=1.10.1&new-version=1.11.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Liu <kevinjqliu@users.noreply.github.com>

Bumps [serde_with](https://github.com/jonasbb/serde_with) from 3.15.1 to 3.16.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/jonasbb/serde_with/releases">serde_with's releases</a>.</em></p> <blockquote> <h2>serde_with v3.16.0</h2> <h3>Added</h3> <ul> <li>Added support for <code>smallvec</code> v1 under the <code>smallvec_1</code> feature flag by <a href="https://github.com/isharma228"><code>@isharma228</code></a> (<a href="https://redirect.github.com/jonasbb/serde_with/issues/895">#895</a>)</li> <li>Add <code>JsonSchemaAs</code> implementation for <code>json::JsonString</code> by <a href="https://github.com/yogevm15"><code>@yogevm15</code></a> (<a href="https://redirect.github.com/jonasbb/serde_with/issues/901">#901</a>)</li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/jonasbb/serde_with/commit/066b9d4019ffd33408bd6829184c0a90bf559cc2"><code>066b9d4</code></a> Bump version to 3.16.0 (<a href="https://redirect.github.com/jonasbb/serde_with/issues/903">#903</a>)</li> <li><a href="https://github.com/jonasbb/serde_with/commit/961a0b9e26a2ef47a5927fb288e35eb8ea907c18"><code>961a0b9</code></a> Bump version to 3.16.0</li> <li><a href="https://github.com/jonasbb/serde_with/commit/ac1f5d0355aeb59f9a1bce5d990c50e15236c7c6"><code>ac1f5d0</code></a> Add support for smallvec v1 (<a href="https://redirect.github.com/jonasbb/serde_with/issues/895">#895</a>)</li> <li><a href="https://github.com/jonasbb/serde_with/commit/c83c4fcc2aa1824082fce42576a034c05616a399"><code>c83c4fc</code></a> Sort the crate features and remove alloc feature</li> <li><a href="https://github.com/jonasbb/serde_with/commit/af734ff59efc3d80be54f9f87ffb01a77749dfd0"><code>af734ff</code></a> Add support for <code>smallvec</code> v1</li> <li><a href="https://github.com/jonasbb/serde_with/commit/ec0ffa377816e4f90f4cb06ba7b54b71f349b9c7"><code>ec0ffa3</code></a> Add <code>JsonSchemaAs</code> implementation for <code>json::JsonString</code> (<a href="https://redirect.github.com/jonasbb/serde_with/issues/901">#901</a>)</li> <li><a href="https://github.com/jonasbb/serde_with/commit/b0c119c9749c5979f19da92048b4b5ddc7b437c4"><code>b0c119c</code></a> Add <code>JsonSchemaAs</code> implementation for <code>json::JsonString</code></li> <li>See full diff in <a href="https://github.com/jonasbb/serde_with/compare/v3.15.1...v3.16.0">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=serde_with&package-manager=cargo&previous-version=3.15.1&new-version=3.16.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Liu <kevinjqliu@users.noreply.github.com>

Bumps [fs-err](https://github.com/andrewhickman/fs-err) from 3.1.3 to 3.2.0. <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/andrewhickman/fs-err/blob/main/CHANGELOG.md">fs-err's changelog</a>.</em></p> <blockquote> <h1>fs-err Changelog</h1> <ul> <li> <p>Introduce <code>debug</code> and <code>debug_tokio</code> feature. Debug filesystem errors faster by exposing more information (<a href="https://redirect.github.com/andrewhickman/fs-err/pull/81">#81</a>). Without this feature on, errors might look like this:</p> <pre><code>failed to open file `file.txt`: The system cannot find the file specified. (os error 2) </code></pre> <p>With this feature on, it will include additional information. For example:</p> <pre><code>failed to open file `file.txt`: The system cannot find the file specified. (os error 2) <p>Path does not exist <code>file.txt</code></p> <ul> <li>Absolute path <code>/path/to/dir/file.txt</code></li> <li>Missing <code>file.txt</code> from parent directory:<br /> <code>/path/to/dir</code><br /> └── <code>file.md</code><br /> └── <code>different.txt</code><br /> </code></pre></li> </ul> <p>It's suggested to enable this feature in <code>dev-dependencies</code> for security and performance reasons.</p> </li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li>See full diff in <a href="https://github.com/andrewhickman/fs-err/commits">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=fs-err&package-manager=cargo&previous-version=3.1.3&new-version=3.2.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Liu <kevinjqliu@users.noreply.github.com>

Bumps [crate-ci/typos](https://github.com/crate-ci/typos) from 1.39.0 to 1.39.2. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/crate-ci/typos/releases">crate-ci/typos's releases</a>.</em></p> <blockquote> <h2>v1.39.2</h2> <h2>[1.39.2] - 2025-11-13</h2> <h3>Fixes</h3> <ul> <li>Don't offer <code>entry</code> as a correction for <code>entrys</code></li> </ul> <h2>v1.39.1</h2> <h2>[1.39.1] - 2025-11-12</h2> <h3>Features</h3> <ul> <li>Make <code>--help</code> more vibrant</li> </ul> </blockquote> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/crate-ci/typos/blob/master/CHANGELOG.md">crate-ci/typos's changelog</a>.</em></p> <blockquote> <h2>[1.39.2] - 2025-11-13</h2> <h3>Fixes</h3> <ul> <li>Don't offer <code>entry</code> as a correction for <code>entrys</code></li> </ul> <h2>[1.39.1] - 2025-11-12</h2> <h3>Features</h3> <ul> <li>Make <code>--help</code> more vibrant</li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/crate-ci/typos/commit/626c4bedb751ce0b7f03262ca97ddda9a076ae1c"><code>626c4be</code></a> chore: Release</li> <li><a href="https://github.com/crate-ci/typos/commit/c6b458db05d00c3037bc9a1102b84febc9fff2f4"><code>c6b458d</code></a> docs: Update changelog</li> <li><a href="https://github.com/crate-ci/typos/commit/eed04198a67af7f32b16141261aa8f911cba1f5f"><code>eed0419</code></a> Merge pull request <a href="https://redirect.github.com/crate-ci/typos/issues/1423">#1423</a> from epage/entrys</li> <li><a href="https://github.com/crate-ci/typos/commit/40383f41a2f90743ef28b8c8b1c2d5a42b7651a0"><code>40383f4</code></a> fix(dict): Don't offer 'entry' as a correction for 'entrys'</li> <li><a href="https://github.com/crate-ci/typos/commit/1af53e3774f068183ffd0c7193eb061a2b65a531"><code>1af53e3</code></a> chore: Release</li> <li><a href="https://github.com/crate-ci/typos/commit/e5d291b81a9bd645c218da268c94df78b6e5e605"><code>e5d291b</code></a> docs: Update changelog</li> <li><a href="https://github.com/crate-ci/typos/commit/55474f5ff9f9a923f4e1a218c9b39271517d847e"><code>55474f5</code></a> Merge pull request <a href="https://redirect.github.com/crate-ci/typos/issues/1417">#1417</a> from starsep/colorful_help</li> <li><a href="https://github.com/crate-ci/typos/commit/78b93759507833a789853c44a1d9a767fcd15024"><code>78b9375</code></a> feat: Enable colors for typos --help</li> <li><a href="https://github.com/crate-ci/typos/commit/308f8f5788c91e7d099279f046cdbc3662956dcd"><code>308f8f5</code></a> Merge pull request <a href="https://redirect.github.com/crate-ci/typos/issues/1409">#1409</a> from crate-ci/renovate/actions-download-artifact-6.x</li> <li><a href="https://github.com/crate-ci/typos/commit/cf03418f507191943e33099ce6ba74c4c79b0257"><code>cf03418</code></a> Merge pull request <a href="https://redirect.github.com/crate-ci/typos/issues/1410">#1410</a> from crate-ci/renovate/actions-setup-python-6.x</li> <li>Additional commits viewable in <a href="https://github.com/crate-ci/typos/compare/v1.39.0...v1.39.2">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=crate-ci/typos&package-manager=github_actions&previous-version=1.39.0&new-version=1.39.2)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Liu <kevinjqliu@users.noreply.github.com>

## Which issue does this PR close?  - Closes #. ## What changes are included in this PR?  ## Are these changes tested?

## Which issue does this PR close? - Closes #. ## What changes are included in this PR? Notify ci-jobs@iceberg.apache.org when Github Workflow fails For more context, see https://lists.apache.org/thread/sx7hz7tcs39tcfgywdh97gvbrtpdftxl ## Are these changes tested?

…letes with binary type (apache#1848)

## Which issue does this PR close? apache#1868 ## What changes are included in this PR? As referenced in the issue, the optimistic concurrency was not working correctly as we need to check the glue table version has not incremented before we make our update, so we can get back the error if there is a concurrent modification. This changes the `update_table` to properly handle this case. Also changed the `load_table` to `load_table_with_version_id`, and `load_table` now just uses that.  ## Are these changes tested? I have tested them using my specific setup with concurrent writers to iceberg tables in aws glue, but not generically. Writing a test case doesn't seem feasible as one needs a glue table.  --------- Co-authored-by: Jem Bishop <jem@lo.tech>

## Which issue does this PR close?  - Closes apache#1837 ## What changes are included in this PR? Used the [`pypi-cleanup`](https://github.com/arcivanov/pypi-cleanup) utility to bulk cleanup old artifacts of pyiceberg-core from testpypi for apache#1837. The alternative is to do this manually in the UI for each artifact. Adding this as reminder / instruction when the nightly pipeline fails again  ## Are these changes tested?  Co-authored-by: Fokko Driesprong <fokko@apache.org>

## Which issue does this PR close? None ## What changes are included in this PR? Upgrades `apache-avro` from `0.20.0` to `0.21.0` in order to get rid of the deprecated `xz2` crate. ## Are these changes tested? Build & tests succeeds

## Which issue does this PR close? - Closes #. ## What changes are included in this PR? While refreshing myself on the internals of iceberg-rust, I felt that `SnapshotproduceOperation` should have documentation to be more clear to anybody who wants to work on Iceberg-rust ## Use of LLM Clarification I did use LLM to generate these docs however I reviewed it myself.

…ic table provider (apache#1879)

## Which issue does this PR close?  - Closes #. ## What changes are included in this PR?  Previous use of `del_branch_on_merge` ``` github: del_branch_on_merge: true ``` is deprecated, https://github.com/apache/infrastructure-asfyaml?tab=readme-ov-file#delete-branch-on-merge New way is to ``` github: pull_requests: del_branch_on_merge: true ``` https://github.com/apache/infrastructure-asfyaml?tab=readme-ov-file#pull_requests ## Are these changes tested?

## What changes are included in this PR? Dependency upgrade is supposed to perform automatically via dependabot, but somehow I didn't see it this weekend. ## Are these changes tested? Checked with local iceberg unit tests and seem fine.

Bumps [crate-ci/typos](https://github.com/crate-ci/typos) from 1.39.2 to 1.40.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/crate-ci/typos/releases">crate-ci/typos's releases</a>.</em></p> <blockquote> <h2>v1.40.0</h2> <h2>[1.40.0] - 2025-11-26</h2> <h3>Features</h3> <ul> <li>Updated the dictionary with the <a href="https://redirect.github.com/crate-ci/typos/issues/1405">November 2025</a> changes</li> </ul> </blockquote> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/crate-ci/typos/blob/master/CHANGELOG.md">crate-ci/typos's changelog</a>.</em></p> <blockquote> <h2>[1.40.0] - 2025-11-26</h2> <h3>Features</h3> <ul> <li>Updated the dictionary with the <a href="https://redirect.github.com/crate-ci/typos/issues/1405">November 2025</a> changes</li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/crate-ci/typos/commit/2d0ce569feab1f8752f1dde43cc2f2aa53236e06"><code>2d0ce56</code></a> chore: Release</li> <li><a href="https://github.com/crate-ci/typos/commit/efbd900f8db9952781b6bd1ad83baa38ebd153e3"><code>efbd900</code></a> chore: Release</li> <li><a href="https://github.com/crate-ci/typos/commit/863fd15db8bf16bfe9117ec1a83ea7b6e802e9f3"><code>863fd15</code></a> docs: Update changelog</li> <li><a href="https://github.com/crate-ci/typos/commit/9a27b16791dd73549457a07f247bc4920f787919"><code>9a27b16</code></a> Merge pull request <a href="https://redirect.github.com/crate-ci/typos/issues/1432">#1432</a> from epage/nov</li> <li><a href="https://github.com/crate-ci/typos/commit/3dbd9d4eacab7f22586ea581e4d403c3ca9dbbb7"><code>3dbd9d4</code></a> feat(dict): November additions</li> <li><a href="https://github.com/crate-ci/typos/commit/a1a16c7b7c25d1c27cc750525aada8b9ae68b716"><code>a1a16c7</code></a> Merge pull request <a href="https://redirect.github.com/crate-ci/typos/issues/1427">#1427</a> from deining/bump-github-action</li> <li><a href="https://github.com/crate-ci/typos/commit/cb8d2e78ff23c82fca05340ed256b04513d022b9"><code>cb8d2e7</code></a> docs: Bump GitHub checkout action in 'github-action.md'</li> <li><a href="https://github.com/crate-ci/typos/commit/9f99fb8dfe87b8a3441863fb2e5d5da88a2aa9a2"><code>9f99fb8</code></a> docs(ref): Clarify extend-words / extend-identifiers</li> <li>See full diff in <a href="https://github.com/crate-ci/typos/compare/v1.39.2...v1.40.0">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=crate-ci/typos&package-manager=github_actions&previous-version=1.39.2&new-version=1.40.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Renjie Liu <liurenjie2008@gmail.com>

…ed data (apache#1618)

CTTY force-pushed the ctty/storage-trait branch from 40b7077 to 0047470 Compare October 17, 2025 02:38

CTTY and others added 3 commits October 17, 2025 18:02

fix: fix read parquert file when schema change (apache#1750)

fa07ec6

CTTY force-pushed the ctty/storage-trait branch from e9d56e4 to f0bd0ab Compare October 17, 2025 23:39

petern48 and others added 25 commits October 18, 2025 11:13

docs: Add examples for PartitioningWriter (apache#1754)

915778e

## Which issue does this PR close? - Closes apache#1745 ## What changes are included in this PR? - As title, added examples and documentation ## Are these changes tested?

fix(build): Pin home version after merging apache#1764 (apache#1783)

ddbcae4

minor: Update Cargo.lock to add home (apache#1785)

104a016

## Which issue does this PR close? - A minor followup of apache#1783 ## What changes are included in this PR? - Update Cargo.lock to add home ## Are these changes tested? No

chore(deps): Bump aws-sdk-s3tables from 1.40.0 to 1.41.0 (apache#1790)

1691419

fix(reader): filter row groups when FileScanTask contains byte ranges (…

cd60057

…apache#1779)

ci: Migrate to uv for python (apache#1796)

a76e738

## Which issue does this PR close? - Closes apache#1794 ## What changes are included in this PR? Migrate to uv ## Are these changes tested? --------- Signed-off-by: Xuanwo <github@xuanwo.io>

mbutrovich and others added 14 commits November 13, 2025 18:21

feat(reader): Add binary support to get_arrow_datum for equality de…

a667539

…letes with binary type (apache#1848)

Make Storage a trait

a9d8fdf

CTTY force-pushed the ctty/storage-trait branch from 569736e to a9d8fdf Compare November 21, 2025 17:40

dependabot bot and others added 15 commits November 24, 2025 14:54

Update apache-avro to v0.21.0 (apache#1881)

18a7577

## Which issue does this PR close? None ## What changes are included in this PR? Upgrades `apache-avro` from `0.20.0` to `0.21.0` in order to get rid of the deprecated `xz2` crate. ## Are these changes tested? Build & tests succeeds

feat(datafusion): Split IcebergTableProvider into static and non-stat…

bf984c7

…ic table provider (apache#1879)

Upgrade opendal to v0.55 (apache#1895)

2871b47

## What changes are included in this PR? Dependency upgrade is supposed to perform automatically via dependabot, but somehow I didn't see it this weekend. ## Are these changes tested? Checked with local iceberg unit tests and seem fine.

feat(datafusion): Add sort_by_partition to sort the input partition…

5724fc5

…ed data (apache#1618)

Merge branch 'main' into ctty/storage-trait

5cf42f6

remane to factory

4ecae74

typetag serde for Storage

b5ae637

rename to delete_prefix

3cedfe1

typetag serde for StorageFactory

8922ccd

minor

77f8b1d

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[DRAFT] Make Storage a trait #4

[DRAFT] Make Storage a trait #4

Uh oh!

CTTY commented Oct 17, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

[DRAFT] Make Storage a trait #4

Are you sure you want to change the base?

[DRAFT] Make Storage a trait #4

Uh oh!

Conversation

CTTY commented Oct 17, 2025

Which issue does this PR close?

What changes are included in this PR?

Are these changes tested?

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants