Skip to content

Stop requiring microbenchmark tests (amd64) check - #26811

Merged
alamb merged 1 commit into
apache:mainfrom
kosiew:ci-microbench-asf-24868
Oct 27, 2026
Merged

alamb merged 1 commit into
apache:mainfrom
kosiew:ci-microbench-asf-24868

Conversation

@kosiew

@kosiew kosiew commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Rationale for this change

#26766 removes the microbenchmark tests (amd64) job. Branch protection is read from .asf.yaml on main, so while that check is still listed as required, #26766 is BLOCKED waiting for a check that no longer exists. Dropping the requirement first, in its own PR, breaks the deadlock.

What changes are included in this PR?

What is the testing strategy for this PR?

python ci/scripts/check_asf_yaml_status_checks.py passes locally (36 required checks, all matching existing jobs).

Are there any user-facing changes?

No.

LLM-generated code disclosure

This PR includes LLM-generated code and comments. All LLM-generated content has been manually reviewed.

Prerequisite for apache#26766, which removes the job. Branch protection is read
from .asf.yaml on main, so the required check must be dropped before the
job is removed, otherwise apache#26766 waits forever for a check that never runs.

@alamb alamb left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @kosiew

@alamb alamb added the development-process Related to development process of DataFusion label Oct 27, 2026
@alamb
alamb added this pull request to the merge queue Oct 27, 2026
@github-merge-queue
github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Oct 27, 2026
@alamb
alamb added this pull request to the merge queue Oct 27, 2026
Merged via the queue into apache:main with commit acbad14 Oct 27, 2026
45 of 46 checks passed
Sruhvx-jpg pushed a commit to Sruhvx-jpg/datafusion that referenced this pull request Oct 28, 2026
## Which issue does this PR close?

- Follow up to apache#25836
[comment](apache#25836 (comment))

## Rationale for this change

The required `microbenchmark tests (amd64)` job consumes approximately
10 runner minutes per merge-queue run. This recurring cost is not
justified under the current maintainer resource constraints.

This PR moves full microbenchmark health checks to local-only execution,
eliminating their automatic CI cost and merge requirement. Runtime-only
failures may remain undetected until a contributor explicitly runs the
benchmarks.

## What changes are included in this PR?

- Remove the microbenchmark job from `.github/workflows/extended.yml`,
including automatic execution on merge groups and release pushes.
- Depends on apache#26811, which removes `microbenchmark tests (amd64)` from
the required checks in `.asf.yaml`. That must merge first: branch
protection is read from `main`, so this PR stays blocked on the removed
check until then.
- Retain the existing local `cargo xtask ci step test microbenchmarks`
command and its execution semantics without introducing a dedicated
hosted workflow.
- Update the contributor guide with local execution instructions,
expectations for benchmark-related PRs, and the accepted risk of delayed
runtime-failure detection.

## What is the testing strategy for this PR?

No new automated tests are included. This change modifies CI
configuration and documentation without changing the benchmark
implementation.

Existing Clippy checks retain benchmark compilation coverage, while the
full benchmark health-check command remains available locally.

The patch does not establish that the required-check validator, local
benchmark command, documentation formatting checks, or affected
workflow-policy tests have been run. Merge-queue behavior must also be
verified after merge.

## Are there any user-facing changes?

No changes to DataFusion's public APIs or query behavior.

For contributors and maintainers, full microbenchmark health checks are
no longer automatically executed or required for merging. They must be
run locally using:

```shell
cargo xtask ci step test microbenchmarks
```

No dedicated GitHub Actions workflow is provided. The contributor
documentation has been updated accordingly.

## LLM-generated code disclosure

This PR includes LLM-generated code and comments. All LLM-generated
content has been manually reviewed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

development-process Related to development process of DataFusion v56.0.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants