GH-49526: [CI] Update Maven version from 3.8.7 to 3.9.9

[jbonofre]

Rationale for this change

This is related to apache/arrow-java#1030. Upgrading to Apache POM 37 on Arrow Java requires Maven 3.9.x as some Maven plugins require this API version.

What changes are included in this PR?

Bumps Maven from 3.8.7 to 3.9.9 in .env and all CI Dockerfiles that reference the Maven version:

• .env
• ci/docker/conda-integration.dockerfile
• ci/docker/conda-python-hdfs.dockerfile
• ci/docker/conda-python-jpype.dockerfile
• ci/docker/conda-python-spark.dockerfile

Are these changes tested?

Crossbow CI jobs were submitted for the affected configurations (HDFS, Spark).

Are there any user-facing changes?

No.

• GitHub Issue: [CI] Upgrade to Maven 3.9.9 #49526

[github-actions]

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

See also:

• Other pull requests
• Contribution Guidelines - Contributing Overview

[jbonofre]

This is related to apache/arrow-java#1030

If we want to update to Apache POM 37 on Arrow Java, we need Maven 3.9.x as some Maven plugins "require" this API version.

[kou]

Could you fill the PR description with our PR template?
https://raw.githubusercontent.com/apache/arrow/refs/heads/main/.github/pull_request_template.md

[jbonofre]

@kou yes, of course. Sorry about that, I was too eager 😄

[raulcd]

@github-actions crossbow submit test-conda-python-3.10-hdfs-* test-conda-python-spark

[github-actions]

Revision: 4ae65b4

Submitted crossbow builds: ursacomputing/crossbow @ actions-cd87482866

Task	Status
test-conda-python-3.10-hdfs-2.9.2
test-conda-python-3.10-hdfs-3.2.1
test-conda-python-3.11-spark-master

[jbonofre]

@kou I updated the PR description according to the template.

[raulcd]

LGTM

Two minor nits:

1. The HDFS job with 2.9.2 fails sporadically due to timeout installing a really old version of Hadoop. I've opened an issue to bump the hdfs integration versions here: #49524
2. I am happy to merge but this doesn't really fit our definition for MINOR and we should create an issue for issues like this, just posting for future reference I am fine merging as is.

[jbonofre]

@raulcd fair enough. Let me create an issue and update the commit.

[github-actions]

⚠️ GitHub issue #49526 has been automatically assigned in GitHub to PR creator.

[github-actions]

⚠️ GitHub issue #49526 has no components, please add labels for components.

[jbonofre]

@raulcd I created an issue and "attached" to this PR.

[raulcd]

Thanks!

[kou]

+1

[conbench-apache-arrow]

After merging your PR, Conbench analyzed the 3 benchmarking runs that have been run so far on merge-commit 9577ca4.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 4 possible false positives for unstable benchmarks that are known to sometimes produce them.