Add How to Benchmark a Single KleidiAI Micro-kernel in ExecuTorch #2517
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
geesun
force-pushed
the
kai-performance
branch
2 times, most recently
from
19acc01 to
674d462
Compare
geesun
changed the title
geesun
force-pushed
the
kai-performance
branch
4 times, most recently
from
0080950 to
9e4902d
Compare
geesun
force-pushed
the
kai-performance
branch
from
9e4902d to
37df2f3
Compare
Contributor
|
merging into main for tech review |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add an article for How to Benchmark a Single KleidiAI Micro-kernel in ExecuTorch
It includes the following:
Cross-compile ExecuTorch for the ARM64 platform, enabling XNNPACK and KleidiAI with SME2 support.
Create ExecuTorch models that can be accelerated by SME2 through KleidiAI.
Use the executor_runner tool to generate ETDump profiling data.
Analyze the contents of ETRecord and ETDump using the ExecuTorch Inspector API.
I have reviewed Create a Learning Path
Please do not include any confidential information in your contribution. This includes confidential microarchitecture details and unannounced product information.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the Creative Commons Attribution 4.0 International License.