Issues

• [EPIC] Comet Native Executors: run Spark queries on native executors built on DataFusion Ballista

  enhancementEPICrequires-triage
  apache/datafusion-comet#7288 · Filter by author andygrove opened on Oct 28, 2026 · 2.0.0
  

• make_date under a codegen-dispatched parent falls back to Spark since #7261

  requires-triage
  apache/datafusion-comet#7284 · Filter by author dwsmith1983 opened on Oct 28, 2026
  2

  

• Offset overflow - Filter merge buffers are not tracked by the memory pool

  bug
  apache/datafusion-comet#7279 · Filter by author parthchandra opened on Oct 27, 2026
  

• Offset overflow - MergeRows and aggregate emit build batches larger than the batch size

  bug
  apache/datafusion-comet#7278 · Filter by author parthchandra opened on Oct 27, 2026
  

• Offset overflow - In-memory table cache ignores spark.comet.batchSize

  bug
  apache/datafusion-comet#7277 · Filter by author parthchandra opened on Oct 27, 2026
  

• Offset overflow - Broadcast exchange merges every batch into one

  bug
  apache/datafusion-comet#7276 · Filter by author parthchandra opened on Oct 27, 2026
  

• Offset overflow - Read large string/binary columns as view types

  bug
  apache/datafusion-comet#7275 · Filter by author parthchandra opened on Oct 27, 2026
  

• Offset overflow - BoundedWindowAggExec concatenates the unfinished partition buffer

  bug
  apache/datafusion-comet#7274 · Filter by author parthchandra opened on Oct 27, 2026
  

• Offset overflow - Hash join and nested loop join build side concatenated into one batch (upstream)

  bug
  apache/datafusion-comet#7273 · Filter by author parthchandra opened on Oct 27, 2026
  

• Offset overflow - TopK emit interleaves all K rows into one batch (upstream)

  bug
  apache/datafusion-comet#7272 · Filter by author parthchandra opened on Oct 27, 2026
  

• Offset overflow - Byte limit in arrow BatchCoalescer and DataFusion LimitedBatchCoalescer (upstream)

  bug
  apache/datafusion-comet#7271 · Filter by author parthchandra opened on Oct 27, 2026
  

• Offset overflow - WindowAggExec concatenates the whole task input into one batch

  bug
  apache/datafusion-comet#7270 · Filter by author parthchandra opened on Oct 27, 2026
  

• Offset overflow- Native shuffle writer: retry with fewer rows on offset overflow

  requires-triage
  apache/datafusion-comet#7269 · Filter by author parthchandra opened on Oct 27, 2026
  

• Offset overflow - Pass the session batch size to native FilterExec

  bug
  apache/datafusion-comet#7268 · Filter by author parthchandra opened on Oct 27, 2026
  

• [EPIC] Native operators overflow Arrow's 2 GiB offset limit on large string/binary columns

  bug
  apache/datafusion-comet#7267 · Filter by author parthchandra opened on Oct 27, 2026
  

• perf: coalesce small native shuffle batches before broadcast serialization

  requires-triage
  apache/datafusion-comet#7257 · Filter by author sunchao opened on Oct 27, 2026

• Nested dictionary-encoded BINARY read as string overflows Utf8 offsets when flattened per batch

  area:scanbugnative_datafusionrequires-triage
  apache/datafusion-comet#7254 · Filter by author manuzhang opened on Oct 27, 2026

• Run user-defined generators (Hive UDTFs, custom Generators) in the Comet pipeline

  area:udfenhancementrequires-triage
  apache/datafusion-comet#7252 · Filter by author andygrove opened on Oct 26, 2026

• Native execution fails with offset overflow when a large scalar string is expanded to the batch length

  area:aggregationarea:expressionsarea:shufflebugpriority:highrequires-triage
  apache/datafusion-comet#7247 · Filter by author andygrove opened on Oct 26, 2026
  1

  

• Native OR, AND, IN, concat, NULL operands and later top-K sort keys evaluate operands Spark skips, raising ANSI errors

  area:expressionsbugpriority:mediumrequires-triage
  apache/datafusion-comet#7246 · Filter by author andygrove opened on Oct 26, 2026

• Native lpad and rpad fail when the string argument evaluates to a scalar, such as a scalar subquery inside IF

  area:expressionsbugpriority:mediumrequires-triage
  apache/datafusion-comet#7245 · Filter by author andygrove opened on Oct 26, 2026

• Native memory requests treat an error from Spark as a refusal

  requires-triage
  apache/datafusion-comet#7244 · Filter by author dwsmith1983 opened on Oct 26, 2026

• feat: Give each native Text and CSV scan task only its own file group (use plan-data injection)

  bugperformance
  apache/datafusion-comet#7243 · Filter by author parthchandra opened on Oct 26, 2026
  

• Native Iceberg writer records NaN as a manifest lower/upper bound for all-NaN float and double columns on Parquet 60

  area:Icebergarea:writerbugpriority:medium
  apache/datafusion-comet#7242 · Filter by author andygrove opened on Oct 26, 2026
  1

  

• Move the version checks for Spark patch-release fixes into SparkFixes

  requires-triage
  apache/datafusion-comet#7241 · Filter by author snmvaughan opened on Oct 26, 2026
  1