Skip to content

[Bug] Saving dataframe in overwrite mode using Spark doesn't set primary key #7687

@mantyk11

Description

@mantyk11

Search before asking

  • I searched in the issues and found nothing similar.

Paimon version

3.4

Compute Engine

Spark

Minimal reproduce step

Saving dataframe with append mode is correctly setting the primary key in the schema:
Image

Schema:
Image

But when I try to save dataframe with overwrite mode then primary key is NOT set in the schema:
Image

Schema:
Image

What doesn't meet your expectations?

Primary key in is NOT set in paimon table schema

Anything else?

No response

Are you willing to submit a PR?

  • I'm willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions