Skip to content

[Feature] Deploy MicroDuck skill policies - #4392

Open
vmoens wants to merge 3 commits into
codex/low-level-controllerfrom
codex/microduck-controller-integration
Open

vmoens wants to merge 3 commits into
codex/low-level-controllerfrom
codex/microduck-controller-integration

Conversation

@vmoens

@vmoens vmoens commented Sep 16, 2026

Copy link
Copy Markdown
Collaborator

Summary

Adds the MicroDuck-specific integration on top of the generic controller in #4329.

  • MicroDuckController maps discrete or parameterized skill decisions to task ids, commands, gait clocks, and low-level actions.
  • microduck_skill_env aggregates physical steps and preserves fall summaries for the high-level policy.
  • reset_key is public and forwarded to the controller, so environments can use a custom per-agent respawn signal.
  • MicroDuckEnv now exposes the real physical fallen signal in its observation spec and outputs.

Review context

This focused PR addresses the two MicroDuck-specific comments from the existing #4329 review while keeping #4329 generic.

Tests

  • Native MuJoCo MicroDuck selection: 18 passed, 1 CUDA-only test skipped.
  • Controller tests cover discrete and parameterized commands and behavioral reset_key forwarding.

@pytorch-bot

pytorch-bot Bot commented Sep 16, 2026

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/4392

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit be95118 with merge base 2d258fe (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Sep 16, 2026
@github-actions github-actions Bot added Documentation Improvements or additions to documentation Environments Adds or modifies an environment wrapper Feature New feature labels Sep 16, 2026
@vmoens vmoens added the ci/optdeps Run the full tests-optdeps suite on this PR label Sep 16, 2026
@vmoens
vmoens requested a review from theap06 September 16, 2026 14:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci/optdeps Run the full tests-optdeps suite on this PR CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Environments Adds or modifies an environment wrapper Feature New feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant