[SPARK-54876][SQL] The splitSemiColon function should correctly split SQL statements

[fusheng9399]

What changes were proposed in this pull request?

When I execute the following code：

val query = "CREATE OR REPLACE TEMPORARY VIEW A using parquet options (path = 'xxx'); insert into table B select * from A /* comment */";

val cli = new SparkSQLCLIDriver

val commands = cli.splitSemiColon(query)

The query would be split to one statement:

CREATE OR REPLACE TEMPORARY VIEW A using parquet options (path = 'xxx')

So in splitSemiColon, we should consider this case.

After this PR, the query will be split it into two statements:
The first:

CREATE OR REPLACE TEMPORARY VIEW A using parquet options (path = 'xxx')

The second:

insert into table B select * from A /* comment */

Why are the changes needed?

In splitSemiColon, we should support the above scenario.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Added UT.

Was this patch authored or co-authored using generative AI tooling?

No

[github-actions]

JIRA Issue Information

=== Bug SPARK-54876 ===
Summary: The splitSemiColon function should correctly split SQL statements
Assignee: None
Status: Open
Affected: ["4.0.1"]

---

This comment was automatically generated by GitHub Actions