Veri
Architecture
Terry
Benchmarks
Runs
Zoo
Goals
Blog
Contact
☰
Architecture
Terry
Benchmarks
Runs
Zoo
Goals
Blog
Contact
Watch it learn to speak.
↻ replay
×1
—
loading runs…
Loss fell to ~2.0 and flatlined while outputs stayed word salad. The metric was lying, attention had a bug. Fixed it and loss reset to ~7.5. Everything right of the line is real training, 7.5 to 5.1 and falling.