Skip to content

perf(optim): implement Gram Newton-Schulz for Muon#301

Open
KakaruHayate wants to merge 1 commit into
openvpi:muon_lynxnet2from
KakaruHayate:gram_ns
Open

perf(optim): implement Gram Newton-Schulz for Muon#301
KakaruHayate wants to merge 1 commit into
openvpi:muon_lynxnet2from
KakaruHayate:gram_ns

perf: optimize Muon with GramNS and fix fp16 spectral norm stability

8d6a177
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs