This GitHub repo is awesome—clean code, great implementations, and super useful! Kudos for the fantastic work!
Would you be interested in implementing quantized second-order optimizers (e.g., 4-bit Shampoo) for TensorFlow? https://arxiv.org/abs/2405.18144 & https://arxiv.org/abs/2412.10663 & https://github.com/Sike-Wang/low-bit-Shampoo
This GitHub repo is awesome—clean code, great implementations, and super useful! Kudos for the fantastic work!
Would you be interested in implementing quantized second-order optimizers (e.g., 4-bit Shampoo) for TensorFlow? https://arxiv.org/abs/2405.18144 & https://arxiv.org/abs/2412.10663 & https://github.com/Sike-Wang/low-bit-Shampoo