Skip to content

Qualcomm AI Engine Direct - Add templated AdamW optimizer to training extension - #22916

Open
quic-xiyushi wants to merge 1 commit into
pytorch:mainfrom
CodeLinaro:dev1/xiyushi/adamw_optimizer
Open

quic-xiyushi wants to merge 1 commit into
pytorch:mainfrom
CodeLinaro:dev1/xiyushi/adamw_optimizer

Conversation

@quic-xiyushi

Copy link
Copy Markdown

Based on #18848 and #22857.

Summary

  • Carries forward the AdamW optimizer work from #18848, design and implemented by @BryanBradfo.
  • Incorporates the allocation-safety and test-coverage improvements from #22857, implemented by @psiddh in response to reviewer feedback on the original AdamW implementation.
  • Consolidates the prior work into a single PR and addresses additional reviewer feedback from previous review rounds.
  • Adds Float and Half AdamW support.
  • Adds dtype, shape, layout, contiguity, and CPU validation before parameter updates.

Test plan

buck2 test //extension/training/optimizer/test:adamw_test passes all 9 tests.

@pytorch-bot

pytorch-bot Bot commented Sep 17, 2026

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/22916

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure

As of commit 72be37f with merge base d32fa30 (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla

meta-cla Bot commented Sep 17, 2026

Copy link
Copy Markdown

Hi @quic-xiyushi!

Thank you for your pull request and welcome to our community.

Action Required

In order to merge any pull request (code, docs, etc.), we require contributors to sign our Contributor License Agreement, and we don't seem to have one on file for you.

Process

In order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA.

Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with CLA signed. The tagging process may take up to 1 hour after signing. Please give it that time before contacting us about it.

If you have received this in error or have any questions, please contact us at cla@meta.com. Thanks!

@quic-xiyushi

Copy link
Copy Markdown
Author

@pytorchbot label "release notes: qualcomm"

@pytorch-bot pytorch-bot Bot added the release notes: qualcomm Changes to the Qualcomm backend delegate label Sep 17, 2026
… extension (based on pytorch#18848 and pytorch#22857)

- Carries over the AdamW optimizer changes from pytorch#18848
- Incorporates the allocation-safety and test-coverage fixes from pytorch#22857
- Add Float and Half AdamW support with dtype, shape, layout, and CPU validation
@quic-xiyushi
quic-xiyushi force-pushed the dev1/xiyushi/adamw_optimizer branch from e83c2cd to 72be37f Compare September 17, 2026 21:24
@qti-horodnic

Copy link
Copy Markdown
Contributor

Hi @psiddh, this is the pr I mentioned that would be raised on our side. I think Harsh has to add @quic-xiyushi to the contributors list for the Meta CLA to pass, right?

@psiddh
psiddh self-requested a review September 17, 2026 22:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

release notes: qualcomm Changes to the Qualcomm backend delegate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants