view article Article makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch May 7, 2024 • 111
view article Article Distributed Training with JAX and Flax NNX: A Practical Guide to Sharding Mar 26 • 9