Skip to content

[WIP] Backport of #106020: Multi-stage distributed queries#1999

Open
ianton-ru wants to merge 2 commits into
antalya-26.3from
backport/antalya-26.3/106020
Open

[WIP] Backport of #106020: Multi-stage distributed queries#1999
ianton-ru wants to merge 2 commits into
antalya-26.3from
backport/antalya-26.3/106020

Conversation

@ianton-ru

Copy link
Copy Markdown

Backport of ClickHouse#106020 by @davenger

Changelog category (leave one):

  • Experimental Feature

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Multi-stage distributed queries (ClickHouse#106020 by @davenger)

Documentation entry for user-facing changes

Multi-stage distributed query execution: the planner splits the query plan into stages connected by scatter / broadcast / gather / shuffle exchanges and dispatches the plan fragments to worker nodes. The data between stages is streamed via TCP or passed via temporary files in shared object storage, the path supports distributed shuffle and broadcast hash joins, shuffle aggregation, and distributed sort. The feature is experimental and is disabled by default.

CI/CD Options

Exclude tests:

  • Fast test
  • Integration Tests
  • Stateless tests
  • Stateful tests
  • Performance tests
  • Aarch64 tests
  • All with ASAN
  • All with TSAN
  • All with MSAN
  • All with UBSAN
  • All with Coverage
  • All Regression
  • Disable CI Cache

Regression jobs to run:

  • Fast suites (mostly <1h)
  • Aggregate Functions (2h)
  • Alter (1.5h)
  • Benchmark (30m)
  • ClickHouse Keeper (1h)
  • Iceberg (2h)
  • LDAP (1h)
  • OAuth (5m)
  • Parquet (1.5h)
  • RBAC (1.5h)
  • SSL Server (1h)
  • S3 (2h)
  • S3 Export (2h)
  • Swarms (30m)
  • Tiered Storage (2h)

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown

Workflow [PR], commit [4087e7a]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants