Mar 11, 2026

What a Neural Network Sees in Sumerian

We trained a 6.8M parameter GPT on 66K Sumerian sentences and probed its attention weights. The results confirm some philological claims, challenge others, and reveal semantic associations invisible to traditional methods.