Skip to content

Pull requests: pytorch/rl

New pull request New
105 Open 3,012 Closed
105 Open 3,012 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Doc] Cache executed sphinx-gallery output between doc builds CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation
#3983 opened Jul 9, 2026 by vmoens Collaborator Loading…
1
[CI] Move benchmarks to the nightly run, label opt-in on PRs CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#3982 opened Jul 9, 2026 by vmoens Collaborator Loading…
1
[CI] Demote the Windows suite to nightly CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#3981 opened Jul 9, 2026 by vmoens Collaborator Loading…
2
[CI] Shard the SOTA smoke tests into two parallel jobs CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#3980 opened Jul 9, 2026 by vmoens Collaborator Loading…
2
[CI] Contain hard hangs in the optdeps job CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#3979 opened Jul 9, 2026 by vmoens Collaborator Loading…
2
[CI] Shard the olddeps job CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#3978 opened Jul 9, 2026 by vmoens Collaborator Loading…
2
[CI] Run the CPU quarantine shards on the oldest and newest Python only CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#3977 opened Jul 9, 2026 by vmoens Collaborator Loading…
2
[CI] Fan out the tests-cpu serial quarantine into parallel jobs CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#3976 opened Jul 9, 2026 by vmoens Collaborator Loading…
2
[CI] Fix always-true pull_request guard in docs workflow CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#3975 opened Jul 9, 2026 by vmoens Collaborator Loading…
2
[Feature] Unify TorchRL checkpointing CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Documentation Improvements or additions to documentation Feature New feature Integrations/torch_geometric Integrations Objectives Record sota-implementations/ Trainers tutorials/
#3967 opened Jul 9, 2026 by vmoens Collaborator Loading…
2
[Quality] Fix ufmt formatting in test_compose_and_env.py CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. quality code quality Transforms
#3965 opened Jul 9, 2026 by vmoens Collaborator Loading…
2
[Quality] Fix ufmt formatting of test_compose_and_env imports CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. quality code quality Transforms
#3964 opened Jul 9, 2026 by vmoens Collaborator Loading…
2
[Feature] Unify transport selection for inference services CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Documentation Improvements or additions to documentation Feature New feature Integrations/torch_geometric Integrations Modules Services
#3958 opened Jul 8, 2026 by vmoens Collaborator Loading…
3
[LLM] WS4 Post-Training Observability: Implement PostTrainingLogger CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation llm/ LLM-related PR, triggers LLM CI tests Objectives Record sota-implementations/
#3950 opened Jul 7, 2026 by coder-jayp Contributor Loading…
8 tasks done
1
2
[Feature] Add Learner primitive (LocalLearner, FSDP2Learner) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature Trainers
#3926 opened Jul 2, 2026 by theap06 Contributor Loading…
1
[Algorithm] Add RLHF reward-model training recipe CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation llm/ LLM-related PR, triggers LLM CI tests new algo New algorithm request or PR Objectives sota-implementations/
#3923 opened Jun 30, 2026 by theap06 Contributor Loading…
4
[Feature] Add RewardModelLoss objective for RLHF reward-model training CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature llm/ LLM-related PR, triggers LLM CI tests Objectives
#3922 opened Jun 30, 2026 by theap06 Contributor Loading…
2
[Feature] On-policy KL distillation loss for LLMs CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature llm/ LLM-related PR, triggers LLM CI tests Objectives
#3921 opened Jun 30, 2026 by theap06 Contributor Loading…
2
[Feature] Tensorclass support for IQLLoss CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Feature New feature Objectives
#3864 opened Jun 13, 2026 by aehebald Loading…
4 of 6 tasks
4
[Refactor] Re-export History from tensordict.llm CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Integrations/torch_geometric Integrations llm/ LLM-related PR, triggers LLM CI tests Modules Refactoring Refactoring of an existing feature
#3862 opened Jun 12, 2026 by vmoens Collaborator • Draft
1
[Performance] Shared-memory command signaling for ParallelEnv and ring-buffer transport for MultiAsyncCollector Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Integrations/torch_geometric Integrations Performance Performance issue or suggestion for improvement Trainers
#3854 opened Jun 11, 2026 by vmoens Collaborator Loading…
2
Bump jinja2 from 3.1.4 to 3.1.6 in /docs CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Dependencies Pull requests that update a dependency file Documentation Improvements or additions to documentation python Pull requests that update python code
#3851 opened Jun 11, 2026 by dependabot Bot Loading…
2
[BugFix] Set "next" obs to current if native_autoreset BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Environments/gym Environments Adds or modifies an environment wrapper Transforms
#3786 opened May 21, 2026 by lin-erica Contributor Loading…
3 of 10 tasks
1
[Feature] Collector final_obs: store true boundary next-obs for shifted-GAE CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Feature New feature Integrations/torch_geometric Integrations Objectives ReplayBuffers
#3758 opened May 15, 2026 by vmoens Collaborator Loading…
2
[Performance] Add compile integration for Triton RNN kernels Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Integrations/torch_geometric Integrations Modules Performance Performance issue or suggestion for improvement
#3740 opened May 12, 2026 by vmoens Collaborator Loading…
1
ProTip! Follow long discussions with comments:>50.