[JakeStevens]

Summary:

Add run_whisper to encode a raw fp32 log-mel window, project cross K/V once, prefill the forced prefix into the static KV cache, and greedily decode while advancing cache_position. Cross K/V input staging persists across executions. The default token budget is 32, matching the exporter, and is capped by remaining decoder context. A full-capacity prefix stays unchanged, and decoding stops without computing an unused token at the budget limit. --expected compares the complete ID sequence with eager vectors and returns exit 3 on mismatch.

EXECUTORCH_BUILD_NATIVE_AUDIO_RUNNER builds and installs the runner with Native Vulkan. Audio and vision runners share gflags resolution and runner_utils; either option enables the examples directory. The README documents matching export/run token budgets, and the Vulkan TODO records future zero-copy chaining and attention-weight storage work.

Token files and EOS lists reject partially numeric or invalid IDs with exit 1; comma-only EOS lists are rejected. Reference IDs are validated before executing the model. Integer parsing accepts surrounding whitespace and CRLF input.

Authored with Claude Code; updated with Codex.

Differential Revision: D125296073

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/23904

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 4 New Failures, 1 Unrelated Failure, 2 Unclassified Failures

As of commit 789b93c with merge base a057bb4 ():

NEW FAILURES - The following jobs have failed:

• pull / unittest / linux / linux-job (gh)
  backends/native/test/test_hf_whisper.py::WhisperNativeExportTest::test_ggml_runner_matches_eager
• pull / unittest / macos / macos-job (gh)
  backends/native/test/test_hf_whisper.py::WhisperNativeExportTest::test_ggml_runner_matches_eager
• pull / unittest-editable / linux / linux-job (gh)
  backends/native/test/test_hf_whisper.py::WhisperNativeExportTest::test_ggml_runner_matches_eager
• pull / unittest-editable / macos / macos-job (gh)
  backends/native/test/test_hf_whisper.py::WhisperNativeExportTest::test_ggml_runner_matches_eager

UNCLASSIFIED FAILURES - DrCI could not classify the following jobs because the workflow did not run on the merge base. The failures may be pre-existing on trunk or introduced by this PR:

• Core AI / backend-tester (models, coreai_w8a8) / test-coreai_w8a8-models (gh) (this job did not run on the merge base, so DrCI cannot tell whether the failure is pre-existing)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
• Core AI / backend-tester (operators, coreai_w8a8) / test-coreai_w8a8-operators (gh) (this job did not run on the merge base, so DrCI cannot tell whether the failure is pre-existing)
  AssertionError: 24 tests failed; at most 23 allowed

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / nxp-mcuxpresso-test / linux-job (gh) (trunk failure)
  undefined reference to SYS_INFO_PrintAll'`

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[meta-codesync]

@JakeStevens has exported this pull request. If you are a Meta employee, you can view the originating Diff in D125296073.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[digantdesai]

Review automatically exported from Phabricator review in Meta.