Skip to content

Migrate google + pagerduty providers to httpx2 - #72111

Draft
zach-overflow wants to merge 2 commits into
apache:mainfrom
DataDog:zo/initial-httpx2-support
Draft

Migrate google + pagerduty providers to httpx2#72111
zach-overflow wants to merge 2 commits into
apache:mainfrom
DataDog:zo/initial-httpx2-support

Conversation

@zach-overflow

Copy link
Copy Markdown
Contributor

What?

  • Modifies these provider package' dependency on httpxhttpx2:

    1. apache-airflow-providers-google
    2. apache-airflow-providers-pagerduty
  • Adds comments on remaining providers which have httpx references which cannot cleanly be removed until their deps are updated.

  • [todo] Adds a pre-commit check to prevent re-introducing httpx in any additional provider packages. Runs via ast-grep for super fast import checks.

Why?


Was generative AI tooling used to co-author this PR?
  • Yes (please specify the tool below)
  • Generated-by: Claude Code following the guidelines
  • Scope of AI use:
    • I provided Claude Code with the list of provider directories where there was httpx usage, and claude did the per-file import replacements
    • Troubleshooting the provider packages where httpx was a transitive dependency
    • Manually found the list of providers using httpx (via ast-grep + verified in IDE).
    • Manually cleaned up the AI comments noise as needed.
    • Personally wrote the PR description.

  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

The `httpx` package is unmaintained and Airflow is moving to the `httpx2`
fork. The anthropic SDK made that jump in 1.0.0, so the provider's tests were
building SDK errors from a package the client no longer uses; raising the floor
keeps the two in step and lifts the `<1.0.0` cap added while 1.x was unvalidated.

The ast-grep rule stops the migrated providers from regressing. It exempts
`airbyte`, `common/ai`, `weaviate` and `microsoft/azure`, whose third-party SDKs
are still built on `httpx` -- their objects cross that boundary, and the two
packages' classes are distinct, so switching them would break at runtime rather
than fail loudly.
@zach-overflow
zach-overflow force-pushed the zo/initial-httpx2-support branch from d59a68b to 9f5c64d Compare August 27, 2026 17:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant