Skip to content

[proposal] New resolver configuration#938

Merged
mergify[bot] merged 2 commits intopython-wheel-build:mainfrom
tiran:proposal-new-resolver-config
Apr 15, 2026
Merged

[proposal] New resolver configuration#938
mergify[bot] merged 2 commits intopython-wheel-build:mainfrom
tiran:proposal-new-resolver-config

Conversation

@tiran
Copy link
Copy Markdown
Collaborator

@tiran tiran commented Feb 27, 2026

Add design proposal for new resolver configuration.

See: #937

@tiran tiran requested a review from a team as a code owner February 27, 2026 11:06
@mergify mergify bot added the ci label Feb 27, 2026
@tiran tiran force-pushed the proposal-new-resolver-config branch 3 times, most recently from ceb5b48 to 071d46c Compare March 3, 2026 14:21
@dhellmann dhellmann requested a review from shifa-khan March 3, 2026 22:30
@dhellmann
Copy link
Copy Markdown
Member

@shifa-khan has been looking at one of the other tickets related to similar work.

@tiran
Copy link
Copy Markdown
Collaborator Author

tiran commented Mar 4, 2026

I have inspect our downstream repo. Most prepare_source and download_source hooks can be replaced by the new resolver and download configuration. More than half of the plugins will no longer be necessary.

  • aiter: gitlab-git
  • amdsmi: special case to pin package
  • aotriton: special case
  • bitsandbytes: github-download
  • deep_ep: gitlab-download
  • deep_gemm: gitlab-git
  • detectron2: gitlab-download
  • faiis-cpu: pypi-git
  • flashinfer_python: pypi-git
  • flashinfer_jit_cache: gitlab-git
  • kubeflow: gitlab-download
  • litellm: gitlab-download
  • llama_stack: gitlab-download
  • mlflow: gitlab-download
  • mlflow_skinny: gitlab-download
  • mlflow_tracing: gitlab-download
  • mlserver: gitlab-download
  • mlserver_lightgbm: gitlab-download
  • mlserver_sklearn: gitlab-download
  • mlserver_xgboost: gitlab-download
  • nixl: gitlab-download
  • nvidia_cudnn_frontend: gitlab-download
  • nvidia_riva-python: pypi-git
  • opencv-python: gitlab-git
  • pplx_kernels: gitlab-download
  • submodlib_py: gitlab-clone (upstream has tags, version map is no longer necessary)
  • tacozip: pypi-git
  • tensorflow: github-git
  • tensorflow_rocm: special case
  • tilelang: gitlab-git
  • torchao: gitlab-git
  • tpu_info: special case, version map
  • tritonclient: gitlab-download
  • vllm: gitlab-download / special case?
  • vllm_bart_plugin: gitlab-download
  • vllm_neuron: gitlab-git

@tiran tiran requested a review from rd4398 March 16, 2026 16:10
@tiran tiran force-pushed the proposal-new-resolver-config branch from 071d46c to 3356160 Compare March 16, 2026 16:11
Comment thread docs/proposals/new-resolver-config.md
Comment thread docs/proposals/new-resolver-config.md
@shifa-khan
Copy link
Copy Markdown
Contributor

downstream has few plugins call ensure_pkg_info() in prepare_source as boilerplate. Git clones never have PKG-INFO, but build tools (like setuptools-scm) need it before building. Could the git-based providers (gitlab-git, github-git, pypi-git) handle this automatically?

Copy link
Copy Markdown
Collaborator Author

@tiran tiran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

downstream has few plugins call ensure_pkg_info() in prepare_source as boilerplate. Git clones never have PKG-INFO, but build tools (like setuptools-scm) need it before building. Could the git-based providers (gitlab-git, github-git, pypi-git) handle this automatically?

Great point! Yes, this will be handled automatically in two ways:

  • Fromager already adds PKG-INFO to the final sdist. In some cases, the file is added too late for some PEP 517 hooks.
  • Fromager will add a .git_archival.txt file to clones. Lala is working on the feature in #961 / #962 . This works for all setuptools-scm cases.

I'll update the design with the PKG-INFO and .git_archival.txt details.

Comment thread docs/proposals/new-resolver-config.md
Comment thread docs/proposals/new-resolver-config.md
@tiran tiran force-pushed the proposal-new-resolver-config branch from 3356160 to 6559cd3 Compare March 20, 2026 11:00
@tiran
Copy link
Copy Markdown
Collaborator Author

tiran commented Mar 27, 2026

@Mergifyio rebase

@mergify
Copy link
Copy Markdown
Contributor

mergify bot commented Mar 27, 2026

rebase

✅ Branch has been successfully rebased

@tiran tiran force-pushed the proposal-new-resolver-config branch from 6559cd3 to 37d1bea Compare March 27, 2026 09:36
@coderabbitai
Copy link
Copy Markdown

coderabbitai bot commented Mar 27, 2026

Note

Reviews paused

It looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the reviews.auto_review.auto_pause_after_reviewed_commits setting.

Use the following commands to manage reviews:

  • @coderabbitai resume to resume automatic reviews.
  • @coderabbitai review to trigger a single review.

Use the checkboxes below for quick actions:

  • ▶️ Resume reviews
  • 🔍 Trigger review
📝 Walkthrough

Walkthrough

Adds a new proposal document, docs/proposals/new-resolver-config.md, and registers it in docs/proposals/index.rst. The new markdown defines a declarative top-level source configuration model for resolver/downloader behavior with provider profiles (pypi-sdist, pypi-prebuilt, pypi-download, pypi-git, versionmap-git, GitHub/GitLab tag handlers, hooks, not-available), matcher-factory contract, standardized git archival/clone rules, default fallbacks to legacy hooks/PyPI sdists, and migration/deprecation constraints preventing mixing new source with legacy keys.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

🚥 Pre-merge checks | ✅ 2
✅ Passed checks (2 passed)
Check name Status Explanation
Title check ✅ Passed The title '[proposal] New resolver configuration' directly and clearly describes the main change: adding a design proposal for new resolver configuration.
Description check ✅ Passed The description 'Add design proposal for new resolver configuration' is clearly related to the changeset, which adds two files documenting the resolver configuration proposal.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Copy link
Copy Markdown

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 3

🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.

Inline comments:
In `@docs/proposals/new-resolver-config.md`:
- Line 9: Replace the incorrect verb in the sentence "This enhancement document
proposal a new approach to configure the package" by changing "proposal" to
"proposes" so the sentence reads "This enhancement document proposes a new
approach to configure the package"; update the single sentence in the
docs/proposals/new-resolver-config.md content where that exact phrase appears.
- Line 187: Replace the lowercase platform name "github" with the capitalized
"GitHub" in the phrase referring to the `release_artifact` parameter of the
`github` or `gitlab` provider so the documentation consistently uses the
official name; update the occurrence that mentions "github" (in the context of
`release_artifact` and provider descriptions) to "GitHub" while leaving code
identifiers/backticks intact if they must remain lowercase.
- Line 169: The comment contains a duplicated word "must" in the text "tag must
must v1.2+midstream.1.cpu"; edit that comment to remove the duplicate so it
reads "tag must v1.2+midstream.1.cpu" (preserve the rest of the comment and the
Version("1.2+midstream.1") example).
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: 26a9cf54-1ff6-456b-89d4-e20a9f61d2f0

📥 Commits

Reviewing files that changed from the base of the PR and between 9b399c8 and 37d1bea.

📒 Files selected for processing (3)
  • docs/index.rst
  • docs/proposals/index.rst
  • docs/proposals/new-resolver-config.md

Comment thread docs/proposals/new-resolver-config.md Outdated
Comment thread docs/proposals/new-resolver-config.md Outdated
Comment thread docs/proposals/new-resolver-config.md
Comment thread docs/proposals/new-resolver-config.md Outdated
Comment thread docs/proposals/new-resolver-config.md
Comment thread docs/proposals/new-resolver-config.md
Comment thread docs/proposals/new-resolver-config.md
Comment thread docs/proposals/new-resolver-config.md
@LalatenduMohanty
Copy link
Copy Markdown
Member

@tiran The proposal looks good. We should merge it asap.

@tiran tiran force-pushed the proposal-new-resolver-config branch 2 times, most recently from b32d482 to 45fd388 Compare April 7, 2026 13:09
Copy link
Copy Markdown

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.

Inline comments:
In `@docs/proposals/new-resolver-config.md`:
- Around line 49-50: The doc currently contradicts itself by saying "Provide SSH
transport for git" is out of scope while elsewhere stating git profiles clone
over `https` or `ssh`; update both occurrences (the "Provide SSH transport for
git" sentence and the phrase "git profiles clone over `https` or `ssh`") to be
consistent: either explicitly state SSH is out of scope everywhere (e.g.,
replace "`ssh`" with "`https`" and add a note that SSH support is future work)
or explicitly include SSH as supported and remove the out-of-scope sentence;
ensure the same wording appears at both the earlier mention and the later lines
currently referencing `https` or `ssh`.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: a3439f13-0234-4da4-b356-bffb61612fd1

📥 Commits

Reviewing files that changed from the base of the PR and between b32d482 and 45fd388.

📒 Files selected for processing (3)
  • docs/index.rst
  • docs/proposals/index.rst
  • docs/proposals/new-resolver-config.md
✅ Files skipped from review due to trivial changes (2)
  • docs/index.rst
  • docs/proposals/index.rst

Comment thread docs/proposals/new-resolver-config.md
@tiran tiran force-pushed the proposal-new-resolver-config branch from 45fd388 to 8d12612 Compare April 8, 2026 14:02
Copy link
Copy Markdown

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

♻️ Duplicate comments (1)
docs/proposals/new-resolver-config.md (1)

49-50: ⚠️ Potential issue | 🟠 Major

Resolve the SSH support contradiction in the proposal

The doc says SSH is out of scope, but later says git profiles clone over https or ssh. Please keep one consistent behavior statement.

Proposed doc fix
-- The `gitlab-tag-git` and `github-tag-git` profiles use the
-  `GitLabTagProvider` or `GitHubTagProvider` to resolve versions. The
-  profiles git clone a project over `https` or `ssh` protocol.
+- The `gitlab-tag-git` and `github-tag-git` profiles use the
+  `GitLabTagProvider` or `GitHubTagProvider` to resolve versions. The
+  profiles git clone a project over `https` protocol.

As per coding guidelines, "**/*.md: Only comment on factual errors or broken links."

Also applies to: 138-140

🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.

In `@docs/proposals/new-resolver-config.md` around lines 49 - 50, The proposal
currently contradicts itself about SSH support: one sentence says "Provide SSH
transport for git" (SSH out of scope) while another states "git profiles clone
over `https` or `ssh`"; pick a single consistent stance and update all
occurrences to match it (either remove mention of SSH everywhere and state
clones use HTTPS only, or explicitly include SSH support and clarify
scope/limitations). Search for the exact phrases "Provide SSH transport for git"
and "git profiles clone over `https` or `ssh`" (also the similar block at the
later occurrence) and edit them so the document consistently describes the
chosen behavior, including any notes about planned future work if SSH is
deferred.
🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.

Duplicate comments:
In `@docs/proposals/new-resolver-config.md`:
- Around line 49-50: The proposal currently contradicts itself about SSH
support: one sentence says "Provide SSH transport for git" (SSH out of scope)
while another states "git profiles clone over `https` or `ssh`"; pick a single
consistent stance and update all occurrences to match it (either remove mention
of SSH everywhere and state clones use HTTPS only, or explicitly include SSH
support and clarify scope/limitations). Search for the exact phrases "Provide
SSH transport for git" and "git profiles clone over `https` or `ssh`" (also the
similar block at the later occurrence) and edit them so the document
consistently describes the chosen behavior, including any notes about planned
future work if SSH is deferred.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: 4a23137c-f8fd-4964-9a9a-a72959dfec59

📥 Commits

Reviewing files that changed from the base of the PR and between 45fd388 and 8d12612.

📒 Files selected for processing (2)
  • docs/proposals/index.rst
  • docs/proposals/new-resolver-config.md
✅ Files skipped from review due to trivial changes (1)
  • docs/proposals/index.rst

@tiran tiran force-pushed the proposal-new-resolver-config branch from 8d12612 to 02859ee Compare April 13, 2026 08:33
Copy link
Copy Markdown

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

♻️ Duplicate comments (1)
docs/proposals/new-resolver-config.md (1)

138-140: ⚠️ Potential issue | 🟠 Major

Resolve SSH support contradiction in git-tag profiles

This section states git clones may use ssh, but Line 49–50 explicitly says SSH transport is out of scope. Please align both sections to one behavior.

Suggested fix
-- The `gitlab-tag-git` and `github-tag-git` profiles use the
-  `GitLabTagProvider` or `GitHubTagProvider` to resolve versions. The
-  profiles git clone a project over `https` or `ssh` protocol.
+- The `gitlab-tag-git` and `github-tag-git` profiles use the
+  `GitLabTagProvider` or `GitHubTagProvider` to resolve versions. The
+  profiles git clone a project over `https` protocol.

As per coding guidelines "**/*.md: Only comment on factual errors or broken links."

🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.

In `@docs/proposals/new-resolver-config.md` around lines 138 - 140, The doc
currently contradicts itself about SSH support for git-tag-git profiles: pick a
single behavior (either "SSH transport is supported" or "SSH transport is out of
scope") and make the text consistent; update the mentions of the git-tag-git
profiles and the provider descriptions (GitLabTagProvider and GitHubTagProvider)
so they all state the same transport policy, remove or change the phrase that
says "git clone ... over `https` or `ssh`" to match the chosen policy, and
update the other sentence that currently declares SSH out of scope to reflect
that same decision.
🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.

Inline comments:
In `@docs/proposals/new-resolver-config.md`:
- Around line 146-147: Update the documentation to use the correct hook name:
replace the incorrect symbol "resolver_provider" with the actual dispatched hook
"get_resolver_provider" wherever it appears in the hooks profile text (including
the occurrences noted around the `hooks` profile and the `download_source`
hooks). Ensure the sentence reads that the `hooks` profile calls the
`get_resolver_provider` and `download_source` hooks, and verify the three
occurrences mentioned (around lines referenced) are all changed to
`get_resolver_provider`.
- Around line 160-161: The text incorrectly requires "profile: hooks" for a
source setting while the document uses "provider" as the discriminator; update
the sentence so it requires at least one `source` setting (top-level or variant)
to use `provider: hooks` instead of `profile: hooks`, and ensure any surrounding
examples or mentions that reference `profile: hooks` are changed to use the
`provider` discriminator consistently with the schema described (look for
occurrences of "source" setting, the phrase "profile: hooks", and the "provider"
discriminator).

---

Duplicate comments:
In `@docs/proposals/new-resolver-config.md`:
- Around line 138-140: The doc currently contradicts itself about SSH support
for git-tag-git profiles: pick a single behavior (either "SSH transport is
supported" or "SSH transport is out of scope") and make the text consistent;
update the mentions of the git-tag-git profiles and the provider descriptions
(GitLabTagProvider and GitHubTagProvider) so they all state the same transport
policy, remove or change the phrase that says "git clone ... over `https` or
`ssh`" to match the chosen policy, and update the other sentence that currently
declares SSH out of scope to reflect that same decision.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: 4ca9ff78-2638-438f-9761-8658f76f0652

📥 Commits

Reviewing files that changed from the base of the PR and between 8d12612 and 02859ee.

📒 Files selected for processing (2)
  • docs/proposals/index.rst
  • docs/proposals/new-resolver-config.md
✅ Files skipped from review due to trivial changes (1)
  • docs/proposals/index.rst

Comment thread docs/proposals/new-resolver-config.md Outdated
Comment thread docs/proposals/new-resolver-config.md Outdated
@tiran tiran force-pushed the proposal-new-resolver-config branch from 02859ee to aeac1f7 Compare April 13, 2026 14:25
Comment thread docs/proposals/new-resolver-config.md
Comment thread docs/proposals/new-resolver-config.md
@mergify
Copy link
Copy Markdown
Contributor

mergify bot commented Apr 14, 2026

Deprecation notice: This pull request comes from a fork and was rebased using bot_account impersonation. This capability will be removed on July 1, 2026. After this date, the rebase action will no longer be able to rebase fork pull requests with this configuration. Please switch to the update action/command to ensure compatibility going forward.

@tiran tiran force-pushed the proposal-new-resolver-config branch from aeac1f7 to 87f74e6 Compare April 14, 2026 18:18
Comment thread docs/proposals/new-resolver-config.md Outdated
Add design proposal for new resolver configuration.

See: python-wheel-build#937
Signed-off-by: Christian Heimes <cheimes@redhat.com>
@tiran tiran force-pushed the proposal-new-resolver-config branch from 87f74e6 to 23b038f Compare April 15, 2026 14:33
@mergify mergify bot merged commit 297ed76 into python-wheel-build:main Apr 15, 2026
39 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants