Repository navigation
Release DataFusion 56.0.0 (Oct/Nov 2026) #24461
Copy link
Copy link
Open
Description
Is your feature request related to a problem or challenge?
Previous release is #22393 (Jul / Aug 2026) so next major release would be approximately Sep / Oct 2026.
Steps:
- Create a
branch-56branch - Update version and changelog
- Test with DataFusion Python
- Test with DataFusion Comet - deps: upgrade to DataFusion 56.0.0 datafusion-comet#7249
- Test with DataFusion Ballista
- Test with delta.rs
- Test vortex
- Test with iceberg-rust
- Test with LakeSail
- Test with parquet viewer
- Test with datafusion-materialized-views
- Voting Thread
- Publish to crates.io
- Create ticket for next release: Release DataFusion
56.1.0(minor/patch) Release (Nov 2026) #24463 / Release DataFusion57.0.0(Dec 2026 / Jan 2027) #25901 - Create blog post
Features to mention in the blog (if they make it)
-
ASOFjoins from @Xuanwo : ASOF join support / Specialize Range Joins #318 - Enable TopK per Partition (
datafusion.optimizer.enable_window_topn) by default #24608 - Push down topk through join #21621
- Add write support to Avro format #24925 from @pepijnve
- Add support for SQL based registration of external catalogs #25111 from @pepijnve
Bugs/issues that should be fixed
- Side effects from
serde_json/preserve_orderfeature impact user applications #25883 @adriangb - [dbolympics] fix: cast outer projection expr to declared field type in SingleDistinctToGroupBy #26211 from @jayzhan211
- Rename
LogicalPlan::DescribeTabletoLogicalPlan::Showmove statement implementations out ofsqlmodule #26057 from @pepijnve (to reduce API churn) - refactor: register proto decoders with
T::register_protoinstead of a free function #26565 from @adriangb (so it is not a breaking change later) - feat: allow extension DataSources to decode via a per-type registry #26555 from @gabotechs (so the proto type-registry refactor from feat: allow extension
ExecutionPlans to decode via a per-type registry instead ofPhysicalExtensionCodec#24631 / feat: allow extensionPhysicalExprs to decode via a per-type registry #24628 does not ship in an intermediate state) -
DISTINCT ONwith nested payloads can fail memory reservation after spilling #26744 from @shehabgamin
Community Wishlist
- Further improve performance of IN list evaluation #19241
- [EPIC] A Collection of Wrong Results Bugs - Q4 2026 #26672 from @alamb
- datafusion-physical-expr: add
DynamicFilterPhysicalExpr::update_from(Self)method #26534 @jayshrivastava - feat: store start/end bounds in
Partitioning::Range#26593 @jayshrivastava
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels
Activity
[-]Release DataFusion `56.0.0` (Sep / Oct 2026)[/-][+]Release DataFusion `56.0.0` (Oct 2026)[/+]xudong963 commentedon Aug 26, 2026
I can help with this release!
Xuanwo commentedon Sep 9, 2026
Really hope #318 can deliever in v56.0, let's rock!
alamb commentedon Sep 9, 2026
318 -- perhaps the lowest issue number left open that tracks something useful. A long standing request
Xuanwo commentedon Sep 14, 2026
One more question: what testing needs to be done for releases? Perhaps we could also include
lance. I'm willing to take on all the related work.alamb commentedon Sep 15, 2026
Thanks @Xuanwo -- I think what we typically do is to use the release ticket to coordinate testing with downstream crates that wish to help as we get close to making a release candidate. So for example, @AdamGS often tests with Vortex as part of that process.
Here is an example in the 55 release ticket where we were disucssing it
55.0.0(Jul / Aug 2026) #22393 (comment)alamb commentedon Sep 15, 2026
Since this release will have an update to arrow/parquet to version 60, perhaps this would be a good candidate to try out "LTS" / Long term support: #16622
kumarUjjawal commentedon Sep 15, 2026
Datafusion 56.0 will be in a good stable condition for downstream consumers and should be good starting point for new projects. So LTS makes sense.
alamb commentedon Sep 16, 2026
FYI @hareshkh who was asking about a more stable branch / backports in the call today
[-]Release DataFusion `56.0.0` (Oct 2026)[/-][+]Release DataFusion `56.0.0` (Oct/Nov 2026)[/+]alamb commentedon Sep 28, 2026
Adjusting date from Oct --> Oct/Nov as we are also working on a 55.2:
55.2.0(patch) Release (Oct 2026) #25758adriangb commentedon Sep 30, 2026
I would like to land a fix for #25883 before next release
[branch-55] fix: frame IPC messages when reading spill files so batch…
jayshrivastava commentedon Oct 22, 2026
👋🏽 Flagging a couple changes I would like to see in df56 :)
DynamicFilterPhysicalExpr::update_from(Self)method #26534Partitioning::Range#26593jayzhan211 commentedon Oct 24, 2026
I'd like #26211 in 56.0.0. It fixes a regression on
main: this query works on 55.0.0 and fails onmain.It starts failing at #24859, which lets
SingleDistinctToGroupByrewrite an aggregate with acount(*)next to the distinct aggregate, and so exposes the rule's decimal type bug (#26193). With #26211 it returns the same rows as 55.0.0. Query q158 of the dbolympics benchmark (#26661) fails the same way.alamb commentedon Oct 25, 2026
I would also like to burn down the wrong results bugs on main as well
alamb commentedon Oct 25, 2026
What is our thinking about timing of this release? Given I just helped @Jefffrey do a bunch of arrow releases (though Jeffrey I personally don't feel like I have the bandwidth to run a release this upcoming week (Oct 26)
Perhaps we could aim to make an RC the first week of Nov?
pepijnve commentedon Oct 26, 2026
The mentioned PR #25887 introduced support for per-catalog information schemas and a 'system' catalog that is used to implement
SHOWstatements which still need to be able to report across all catalogs.PR #26057 follows this up with full decoupling of
SHOWstatements from the information schema tables. This obviates the need for that 'system' catalog. It would be great if we could get #26057 merged for 56.0 still so that we don't introduce something new only to remove it in the next release.xudong963 commentedon Oct 26, 2026
Makes sense, I'll work on it
alamb commentedon Oct 26, 2026
I will try and prioritize reviewing and merging the issues linked to this ticket in the next week or so. Thank you @xudong963
nuno-faria commentedon Oct 26, 2026
To prepare the release, I have this PR that updates the update-version script so it modifies in all places currently in use: #26007
I think the versions need to be updated on main as soon as the new branch is cut as otherwise the new PRs' release labels (#25776) will refer to a wrong version.
alamb commentedon Oct 26, 2026
Awesome -- I also want to start publishing versioned docs
This is sounding like our existing release process is going to get more complicated. I agree more automation would be great...
alamb commentedon Oct 26, 2026
Like maybe we should change the version on main to 56.0.0-dev or something, so that when we make a release branch we can immediately change main to 57.0.0-dev 🤔
adriangb commentedon Oct 26, 2026
I would love to land #26565 in this release so that it's not a breaking change later.
mbutrovich commentedon Oct 27, 2026
I've always been surprised that main doesn't bump to the next version when a release branch is cut.
gabotechs commentedon Oct 27, 2026
Would be nice to get this on landed as well cc @adriangb:
As other wise the proto type-registry refactor will be shipped in an intermediate state (#24631 and #24628 by @adriangb).