Skip to content

[GLUTEN-11635][FOLLOW-UP] Respect partial fallback configs when checking node support#11988

Open
wecharyu wants to merge 1 commit intoapache:mainfrom
wecharyu:GLUTEN-11635-follow-up
Open

[GLUTEN-11635][FOLLOW-UP] Respect partial fallback configs when checking node support#11988
wecharyu wants to merge 1 commit intoapache:mainfrom
wecharyu:GLUTEN-11635-follow-up

Conversation

@wecharyu
Copy link
Copy Markdown
Contributor

@wecharyu wecharyu commented Apr 26, 2026

What changes are proposed in this pull request?

Minor follow up for #11637.

How was this patch tested?

Add UT.

Was this patch authored or co-authored using generative AI tooling?

No.

Related issue: #11635

@github-actions github-actions Bot added the VELOX label Apr 26, 2026
Copy link
Copy Markdown
Contributor

@zml1206 zml1206 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Copy link
Copy Markdown
Member

@philo-he philo-he left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One comment. Please check if it makes sense. Thank you.

plan.isInstanceOf[ProjectExec] ||
plan.isInstanceOf[GenerateExec]
def supportPartialFallback(plan: SparkPlan): Boolean = plan match {
case _: ProjectExec => GlutenConfig.get.enableColumnarPartialProject
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I noticed the following code already performs this check before PartialFallback.supportPartialFallback is called. Is this a duplicate?

if (!GlutenConfig.get.enableColumnarPartialProject) {

Copy link
Copy Markdown
Contributor

@zml1206 zml1206 Apr 27, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is to handle situations where the parent and child are different; one is ProjectExec, and the other is GenerateExec.

plan.isInstanceOf[GenerateExec]
def supportPartialFallback(plan: SparkPlan): Boolean = plan match {
case _: ProjectExec => GlutenConfig.get.enableColumnarPartialProject
case _: GenerateExec => GlutenConfig.get.enableColumnarPartialGenerate
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ditto.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants