ggml-cuda: MoE MMQ tile sizing + D=256 flash-attn tuning on RDNA3.5#35
Open
roberteg16 wants to merge 3 commits into
Open
ggml-cuda: MoE MMQ tile sizing + D=256 flash-attn tuning on RDNA3.5#35roberteg16 wants to merge 3 commits into
roberteg16 wants to merge 3 commits into