Skip to content

feat(spark): support spark iceberg sql syntax, entities, and completion - #1

Closed
jin-sir wants to merge 1 commit into
mainfrom
feat/spark-iceberg-support
Closed

jin-sir wants to merge 1 commit into
mainfrom
feat/spark-iceberg-support

Conversation

@jin-sir

@jin-sir jin-sir commented Nov 10, 2026

Copy link
Copy Markdown
Owner

Summary

  • Support Iceberg DDL/DML extensions: partition evolution, write distribution/ordering, identifier fields, branch/tag, and CALL procedures.
  • Support multi-level table identifiers (catalog.db.analytics.table) across CREATE / ALTER / DROP.
  • Fix a base-Spark regression: unquoted dotted column declarations are rejected again, while nested Iceberg ADD COLUMN keeps entity and completion coverage.
  • Collect both target and source table entities for MERGE.
  • Add table suggestions for metadata-table prefixes and function suggestions for CALL.
  • Restore invalid-SQL diagnostics for nested ADD COLUMN.

Verification

  • Spark: 35 suites / 766 tests
  • Full repository: 227 suites / 6683 tests
  • check-types, build, and prettier-check all pass

Closes DTStack#463

🤖 Generated with Claude Code

@jin-sir

jin-sir commented Nov 10, 2026

Copy link
Copy Markdown
Owner Author

Superseded by upstream PR DTStack#505

@jin-sir jin-sir closed this Nov 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature Request]: Spark SQL Iceberg table support

1 participant