Keyon Vafa @keyonV · 11 Jul 2025

We also apply these probes to lattice problems (think gridworld). Inductive biases are great when the number of states is small. But they deteriorate quickly. Recurrent and state-space models like Mamba consistently have better inductive biases than transformers. https://t.co/by2eTrEW8G

Open on X →