view article Article makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch May 7, 2024 • 115
view article Article Distributed Training with JAX and Flax NNX: A Practical Guide to Sharding Mar 26, 2025 • 11