Skip to content

arrow: add oversized coalesce take benchmarks#9799

Open
ClSlaid wants to merge 1 commit intoapache:mainfrom
ClSlaid:benchmark-pr-8991-followup
Open

arrow: add oversized coalesce take benchmarks#9799
ClSlaid wants to merge 1 commit intoapache:mainfrom
ClSlaid:benchmark-pr-8991-followup

Conversation

@ClSlaid
Copy link
Copy Markdown
Contributor

@ClSlaid ClSlaid commented Apr 23, 2026

Summary

  • add coalesce_kernels take benchmarks alongside the existing filter coverage for primitive, view, utf8, and dictionary schemas
  • add oversized repeated-index benchmark cases that stress the materialized push_batch_with_indices fallback with a configured biggest_coalesce_batch_size
  • extend the benchmark harness so take benchmarks can use explicit output lengths and optionally drain all completed batches while running

Verification

  • cargo fmt -p arrow
  • cargo clippy -p arrow --bench coalesce_kernels --features test_utils -- -D warnings
  • cargo bench -p arrow --bench coalesce_kernels --features test_utils -- 'extra_large_repeat'

Signed-off-by: 蔡略 <cailue@apache.org>
@github-actions github-actions Bot added the arrow Changes to the arrow crate label Apr 23, 2026
@ClSlaid
Copy link
Copy Markdown
Contributor Author

ClSlaid commented Apr 23, 2026

@Dandandan PTAL.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

arrow Changes to the arrow crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant