Skip to content

Pull requests: pytorch/rl

New pull request New
133 Open 3,329 Closed
133 Open 3,329 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Feature] MujocoModelEnv with GitHub and Menagerie model sources CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Environments Adds or modifies an environment wrapper Examples Feature New feature
#4401 opened Sep 16, 2026 by theap06 Collaborator • Draft
1
[Refactor] Consolidate stats() in BaseCollector and add WandB monitoring example CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Examples Integrations/torch_geometric Integrations Refactoring Refactoring of an existing feature
#4400 opened Sep 16, 2026 by coder-jayp Contributor Loading…
5 of 7 tasks
1
[Doc] Add the MicroDuck skills tutorial CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation tutorials/
#4399 opened Sep 16, 2026 by vmoens Collaborator • Draft
1
[Doc] Rewrite the MicroDuck environment tutorial CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation tutorials/
#4398 opened Sep 16, 2026 by vmoens Collaborator Loading…
1
[Feature] Train MicroDuck skills and navigation ci/optdeps Run the full tests-optdeps suite on this PR CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Environments Adds or modifies an environment wrapper Examples Feature New feature
#4397 opened Sep 16, 2026 by vmoens Collaborator • Draft
1
[Feature] Report MicroDuck trajectory evaluation metrics ci/optdeps Run the full tests-optdeps suite on this PR CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Environments Adds or modifies an environment wrapper Examples Feature New feature
#4396 opened Sep 16, 2026 by vmoens Collaborator Loading…
1
[Feature] Restore forward and in-place MicroDuck hopping ci/optdeps Run the full tests-optdeps suite on this PR CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Environments Adds or modifies an environment wrapper Examples Feature New feature
#4395 opened Sep 16, 2026 by vmoens Collaborator Loading…
1
[Feature] Load pretrained MicroDuck policies ci/optdeps Run the full tests-optdeps suite on this PR CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature Integrations/torch_geometric Integrations Modules
#4394 opened Sep 16, 2026 by vmoens Collaborator Loading…
1
[BugFix] Evaluate MicroDuck head pose from the supplied state BugFix ci/optdeps Run the full tests-optdeps suite on this PR CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Environments Adds or modifies an environment wrapper
#4393 opened Sep 16, 2026 by vmoens Collaborator Loading…
1
[Feature] Deploy MicroDuck skill policies ci/optdeps Run the full tests-optdeps suite on this PR CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Environments Adds or modifies an environment wrapper Feature New feature
#4392 opened Sep 16, 2026 by vmoens Collaborator Loading…
1
[Feature] Build PPO training from an environment and networks CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature Trainers
#4391 opened Sep 16, 2026 by vmoens Collaborator Loading…
1
[BugFix] Log statistics for categorical values BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Trainers
#4390 opened Sep 16, 2026 by vmoens Collaborator Loading…
1
[BugFix] Preserve worker and trajectory dimensions BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Trainers
#4389 opened Sep 16, 2026 by vmoens Collaborator Loading…
1
[BugFix] Preserve sampler state across repeated checkpoints BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. ReplayBuffers
#4388 opened Sep 16, 2026 by vmoens Collaborator Loading…
1
[Feature] Read storages and replay buffers through torch.utils.data Benchmarks rl/benchmark changes CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Data/openx Data Data-related PR, will launch data-related jobs Documentation Improvements or additions to documentation Examples Feature New feature Integrations/torch_geometric Integrations llm/ LLM-related PR, triggers LLM CI tests Modules ReplayBuffers
#4387 opened Sep 16, 2026 by theap06 Collaborator Loading…
8 tasks done
6
[Feature] MenagerieEnv: any MuJoCo Menagerie robot by name ci/optdeps Run the full tests-optdeps suite on this PR CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Environments Adds or modifies an environment wrapper Examples Feature New feature
#4386 opened Sep 16, 2026 by theap06 Collaborator • Draft
1
[Feature] MicroDuck proprioceptive and visual prior recipes Benchmarks rl/benchmark changes ci/optdeps Run the full tests-optdeps suite on this PR CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Environments Adds or modifies an environment wrapper Examples Feature New feature
#4379 opened Sep 14, 2026 by vmoens Collaborator • Draft
1
[Refactor] MicroDuck prior PPOTrainer and PPO-EWMA recipes ci/optdeps Run the full tests-optdeps suite on this PR CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Environments Adds or modifies an environment wrapper Examples Refactoring Refactoring of an existing feature Trainers
#4378 opened Sep 14, 2026 by vmoens Collaborator • Draft
1
[BugFix] Avoid unnecessary SAC and CQL collector spec queries BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Trainers
#4377 opened Sep 14, 2026 by aswanth-07 Contributor Loading…
4 of 6 tasks
1
1
[Feature] MicroDuck skills and PPOTrainer integration with the games zoo Benchmarks rl/benchmark changes ci/optdeps Run the full tests-optdeps suite on this PR CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Environments/libero Environments/mjlab Environments Adds or modifies an environment wrapper Examples Feature New feature Objectives Trainers Transforms tutorials/
#4375 opened Sep 14, 2026 by vmoens Collaborator • 4/4 Loading…
1
[Refactor] Extract discrete action-value selection into shared helper CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Objectives Refactoring Refactoring of an existing feature
#4367 opened Sep 13, 2026 by coder-jayp Contributor Loading…
3 of 6 tasks
14
[BugFix] Fix star-import of torchrl.modules.distributions BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. distributions Integrations/torch_geometric Integrations Modules
#4365 opened Sep 13, 2026 by Anai-Guo Loading…
2 tasks done
5
[BugFix] Fix GRPOLoss padding config and DAPO instantiation BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Integrations/torch_geometric Integrations llm/ LLM-related PR, triggers LLM CI tests Objectives
#4363 opened Sep 12, 2026 by coder-jayp Contributor Loading…
3 of 10 tasks
3
[Doc] Document the GRPOLoss masking strategy contract and add deterministic tests CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation llm/ LLM-related PR, triggers LLM CI tests Objectives
#4340 opened Sep 12, 2026 by n-dlms Loading…
5 of 9 tasks
8
[Algorithm] GTrXL PPO with compact window replay and transformer tutorial Benchmarks rl/benchmark changes CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Integrations/torch_geometric Integrations Modules new algo New algorithm request or PR sota-implementations/ tutorials/
#4335 opened Sep 11, 2026 by vmoens Collaborator • 4/4 • Draft
1
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.