Yumon Pet: The Lowest-Loss Checkpoint Wasn't the Best One
Yumon Pet trains a small decoder-only transformer from scratch in Rust, using burn for the model and cubecl's Wgpu runtime for the flash-attention kernel. The repo has been through a dozen training runs at different…
WGPUYUMON