Skip to content

Pull requests: deepspeedai/DeepSpeed

New pull request New
130 Open 3,587 Closed
130 Open 3,587 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add engine.coalesce_grad_reduction() for ZeRO 1/2/3 multi-backward
#7992 opened May 5, 2026 by roycho96 Contributor Loading…
fix gemma4 num attention head bugs (from #7975)
#7990 opened May 2, 2026 by delock Collaborator Loading…
4
Fix eigenvalue monitor logging
#7987 opened Apr 28, 2026 by heurry Contributor Loading…
1
7
Add Qwen 3.5 preset to AutoTP
#7978 opened Apr 16, 2026 by tohtana Collaborator • Draft
1
1
fix gemma4 num attention head bugs
#7975 opened Apr 15, 2026 by mingxiang1006 Loading…
14
[Blog] Muon Optimizer Support in DeepSpeed
#7962 opened Apr 8, 2026 by delock Collaborator Loading…
10
Fix/warnings stacklevel mvapich runner
#7949 opened Apr 2, 2026 by nathon-lee Contributor • Draft
2
Refactor/torch autocast encapsulate global state
#7946 opened Apr 2, 2026 by nathon-lee Contributor Loading…
2
feat(zero2): add CPU offload support for Muon optimizer
#7939 opened Mar 31, 2026 by delock Collaborator • Draft
7
Add AutoEP
#7938 opened Mar 31, 2026 by tohtana Collaborator • Draft
12
Fix ZeRO-3 optimizer initialization validation (#7844)
#7929 opened Mar 28, 2026 by amadhan882 Loading…
1
9
[Feature] Enable AutoEP Compatibility with ZeRO-3
#7928 opened Mar 28, 2026 by nathon-lee Contributor Loading…
11
Add torch_xla TPU support for ZeRO-1/2
#7917 opened Mar 21, 2026 by PKUWZP Collaborator Loading…
18
fix: add setup_context for torch.func compatibility
#7916 opened Mar 21, 2026 by roycho96 Contributor Loading…
1
26
doc: Remove suggestion to build extensions in parallel
#7899 opened Mar 12, 2026 by Flamefire Contributor Loading…
1
5
[Bugfix] Validate fp16.loss_scale is finite in DeepSpeedFP16Config
#7892 opened Mar 8, 2026 by s-zx Loading…
1
8
Fix Stage 0 + Ulysses crash: make bwc_tensor_model_parallel_rank() resilient to MP API absence
#7888 opened Mar 6, 2026 by nathon-lee Contributor Loading…
3
fix(zero): Ensure full gradient reduction for Muon optimizer with reduce_scatter
#7878 opened Feb 27, 2026 by nathon-lee Contributor Loading…
1
2
fix: correct DistributedAttention output shape and pad uneven sequence lengths (#7842)
#7868 opened Feb 22, 2026 by harshang03 • Draft
1
1
fix: keep fp32-pinned parameters out of the bf16 cast path in ZeRO-3 (#7747)
#7867 opened Feb 22, 2026 by harshang03 • Draft
1
Revert "fix: remove premature MPI environment variable check in OpenMPIRunner"
#7864 opened Feb 21, 2026 by mikloorbi-sys • Draft
1
Fix global .cuh ignore and enforce tracked CUDA headers
#7858 opened Feb 18, 2026 by harshang03 • Draft
1
Fix ZeRO legacy grad-hook crash when next_functions is missing
#7857 opened Feb 17, 2026 by harshang03 • Draft
1
Reject non-finite fp16 loss_scale across config and ZeRO paths
#7856 opened Feb 17, 2026 by harshang03 • Draft
1
Fix zero/division safety gaps in utility and inference paths
#7855 opened Feb 17, 2026 by harshang03 • Draft
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.