Skip to content

[BugFix] Evaluate MicroDuck head pose from the supplied state - #4393

Open
vmoens wants to merge 2 commits into
mainfrom
codex/microduck-head-state
Open

vmoens wants to merge 2 commits into
mainfrom
codex/microduck-head-state

Conversation

@vmoens

@vmoens vmoens commented Sep 16, 2026

Copy link
Copy Markdown
Collaborator

Summary

Fixes MicroDuck reward inspection for simulator snapshots that are not the backend current state.

Previously reward_features(state, action) derived the torso direction from state but the head gaze from the live backend site transform. A tilted snapshot could therefore receive the head pose of a different state.

Backend site rotation queries now optionally run forward kinematics for a supplied qpos without mutating live state. The normal reward hot path continues to use already-current derived data.

Tests

  • Added a regression that evaluates a tilted snapshot while the live backend remains level and verifies both values independently.
  • Native MuJoCo MicroDuck selection: 15 passed, 1 CUDA-only test skipped.

@pytorch-bot

pytorch-bot Bot commented Sep 16, 2026

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/4393

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit f80e340 with merge base 2d258fe (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Sep 16, 2026
@github-actions github-actions Bot added BugFix Environments Adds or modifies an environment wrapper and removed BugFix labels Sep 16, 2026
@vmoens vmoens added the ci/optdeps Run the full tests-optdeps suite on this PR label Sep 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

BugFix ci/optdeps Run the full tests-optdeps suite on this PR CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Environments Adds or modifies an environment wrapper

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant