Watch it learn to speak.

×1
—
loading runs…
Loss fell to ~2.0 and flatlined while outputs stayed word salad. The metric was lying, attention had a bug. Fixed it and loss reset to ~7.5. Everything right of the line is real training, 7.5 to 5.1 and falling.