Monolithic fused head-loss kernel (torch.compile) (#507)#549

Open

jlamypoirier wants to merge 30 commits into

mainfrom

jlp_monolithic_head_loss

Commits on Jun 26, 2026

Monolithic head-loss kernel: scaffolding + cross-entropy (#507)

jlamypoirier
and
claude
committed
Monolithic head-loss kernel: add z-loss (#507)

jlamypoirier
and
claude
committed
Monolithic head-loss kernel: add from-distribution KL losses (#507)

jlamypoirier
and
claude
committed

Commits on Jun 27, 2026

Monolithic head-loss kernel: wire distillation + fix dropped temperature (#507)

jlamypoirier
and
claude
committed
Monolithic head-loss kernel: GRPO objective + new_logprobs (#507)

jlamypoirier
and
claude
committed

Commits on Jun 29, 2026

Commits on Jun 30, 2026

Commits on Jul 2, 2026

Commits on Jul 3, 2026

Commits on Jul 7, 2026

Fuse GSPO into the monolithic compiled loss (#507) (#552)

jlamypoirier
and
claude
authored

Commits on Jul 8, 2026

Fuse the GSPO segment seam into compiled blocks (#507) (#554)

jlamypoirier
and
claude
authored

Commits on Jul 10, 2026