Figure — seven models, two tests
The circuit spreads out as models get deeper
writing side · prev-token heads
reading side · induction heads
filled = joint ablation degrades the induction head ·
ring = single-head ablation also does. Circle = GPT-2, square = Pythia, diamond = Llama. Hover or tap a point.