Tiny models, browser-trained, ranked.

This is the learning track — small byte-level GPTs you can train from scratch in a browser tab and run instantly. It is not the factory's specialist evals (those live under specialists and experiments). Each row is a .tinygpt checkpoint — hit try → to load it in the playground. Ranked by TinyStories perplexity (a 50-story holdout; lower is better); sort-6, reverse-16, and FineWeb tabs below.

JSON CSV

TinyStories PPL. Held-out perplexity over 50 stories from a slice of the TinyStories corpus that wasn't seen during gallery training. Score = exp(mean per-byte cross-entropy). Browser-trainable models with ~1–10M params can credibly compete (Eldan & Li 2023 showed 1M-param models cross the coherence threshold on this distribution).

#	Model	Params	Score	Train
Loading…

Train one in your browser tab. Pick a corpus, hit Start, wait minutes-not-days. When the model converges, hit "Download model" — you get a .tinygpt file. The gallery cards above are all browser-trained 9.6M-param models; a sort-6 / reverse-16 model can be 100× smaller and beat them. Submission flow ships next — for now, open a PR adding your model to data/gallery/ and we'll score it.

Train one →