Skip to content

Add SQL platform support for ParquetSource - #793

Open
JunWang222 wants to merge 1 commit into
apache:mainfrom
JunWang222:feature/parquet-sql-independent-platforms-clean
Open

Add SQL platform support for ParquetSource#793
JunWang222 wants to merge 1 commit into
apache:mainfrom
JunWang222:feature/parquet-sql-independent-platforms-clean

Conversation

@JunWang222

Copy link
Copy Markdown
Contributor

Summary

This PR adds support for executing ParquetSource on SQL-backed platforms by resolving Parquet inputs to platform-visible SQL relations.

Supported platforms:

  • Trino
  • Presto
  • BigQuery

Changes

  • Add JDBC-based ParquetSource support for SQL platforms.
  • Add TrinoParquetSource, PrestoParquetSource, and BigQueryParquetSource.
  • Add platform mappings for ParquetSource.
  • Add Parquet source configuration keys for platform-specific relation mapping and optional relation creation.
  • Add BigQuery platform support needed for SQL operator execution.
  • Add integration coverage for Parquet joins and platform alternatives.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant