The speedrun format is a gift to practitioners: a fixed dataset, a fixed target metric, a public leaderboard, and a runnable repo. It is how you separate tweaks that move the loss curve from folklore. We are reproducing it ourselves — see the tracker for what holds up.
SIGNAL · SIGNALS
The modded-nanogpt speedrun and the Muon optimizer
A rare fully-public optimization target with a reproducible harness — exactly the kind of artifact we like. The Muon optimizer it popularized is the most interesting practical idea to come out of it.
1 MINBY Frontier Checkpoint Editorial
- Source
- KellerJordan/modded-nanogpt ↗repo · notable