Skip to content

Fix muon moe dimension numbers - #4843

Open
parsley9877 wants to merge 2 commits into
mainfrom
fix-muon-moe-dimension-numbers
Open

Fix muon moe dimension numbers#4843
parsley9877 wants to merge 2 commits into
mainfrom
fix-muon-moe-dimension-numbers

Support Qwen3, GPT-OSS MoE blocks in Muon

d70e2e0
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Aug 12, 2026 in 7s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

d70e2e0 Author: @parsley9877 <83480666+parsley9877​@users.noreply.github.com>

(Only the first commit for a unique contributor is listed.)