You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
ios-sim-navigation. This skill is basically a reference of WDA, which Claude Code can use to interact with iOS simulators.
ai-test-runner. This skill describes a workflow for running end-to-end tests on iOS simulators using the ios-sim-navigation skill.
You can use ios-sim-navigation to verify your code changes. For example, you can add this to your prompt:
After completing the code changes, use the general-purpose agent with the ios-sim-navigation skill to verify the changes on the iPhone 17 Simulator.
You can try the ai-test-runner locally using a prompt like this:
Run the test case at Tests/AgentTests/ui-tests/create-blank-page.md on the iPhone 17 simulator. Here are the test site credentials: [url], [username], [application-password].
I have translated some UI tests into test cases in Tests/AgentTests/ui-tests. If you want, you can ask Claude Code to run the full test suite, which takes 40+ minutes. You can also ask Claude Code to run on two simulators simultaneously, which halves the runtime.
Hey Tony, is the plan to merge the PR or is it only for evaluation purposes? I've tried running it but quickly realized that it requires https://github.com/facebookarchive/WebDriverAgent, which I don't currently have installed. Would you mind sharing the setup steps required to get these skills to work please?
What was your experience running ai-test-runner? Can you share how the output looks like from your test runs?
@kean I think we can merge this PR. I'll ask the apps infra team to see if it's possible to run the tests on CI, which I'll leave them to explore now that a locally runnable pipeline is implemented in this PR.
Have you tried the example prompts in the PR description? Do they work for you? Yes, WebDriveAgent is needed. But the skill should take care of that (cloning, running, etc), you should not need to do anything other than click "yes".
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This PR adds two skills:
ios-sim-navigation. This skill is basically a reference of WDA, which Claude Code can use to interact with iOS simulators.ai-test-runner. This skill describes a workflow for running end-to-end tests on iOS simulators using theios-sim-navigationskill.You can use
ios-sim-navigationto verify your code changes. For example, you can add this to your prompt:You can try the
ai-test-runnerlocally using a prompt like this:I have translated some UI tests into test cases in
Tests/AgentTests/ui-tests. If you want, you can ask Claude Code to run the full test suite, which takes 40+ minutes. You can also ask Claude Code to run on two simulators simultaneously, which halves the runtime.