ggml-cuda: one-time K-padded f16 dequantization for prefill GEMMs#37
Draft
roberteg16 wants to merge 1 commit into
Draft
ggml-cuda: one-time K-padded f16 dequantization for prefill GEMMs#37roberteg16 wants to merge 1 commit into
roberteg16 wants to merge 1 commit into