Hi everyone! For the last few months I've been building something slightly unreasonable: a real GPT-style language model that runs entirely on Factorio 2.0 combinators.

What it is

A character-level transformer: 6.4M parameters, 8 layers, 8 attention heads, 256-character context
~105,000 entities ...