Commit 68a4e2e

authored and

bzgoogle

committed

Implement the SparseMatmul for DeepSeek

Signed-off-by: bzgoogle <beinuoz@google.com> Signed-off-by: bzgoogle <beinuoz_google_com@t1v-n-3f245f84-w-0.us-central1-c.c.tpu-prod-env-one-vm.internal>

1 parent e88f387 commit 68a4e2eCopy full SHA for 68a4e2e

1 file changed

+594

-0

lines changed

tpu_commons/models/jax/common/moe
- deepseek_moe.py

1 file changed

+594

-0

lines changed

Comments

(0)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Commit 68a4e2e

1 file changed

1 file changed

File tree

1 file changed

1 file changed

0 commit comments