Posts tagged "sparse-autoencoders"

The Residual Stream: From AlexNet to DeepSeek-V4

September 13, 2026 •29 min read

*A complete research dossier — the one idea, $\text{output} = \text{input} + F(\text{input})$, traced from computer vision in 2015 to the multi-lane residual streams of today's frontier models.* 📺

Towards Monosemanticity: Pulling Clean Features Out of a Messy Neuron

June 15, 2026 •3 min read

![A sparse autoencoder re-expresses tangled activations as clean, single-meaning features](tm-method.png) Inside a neural network, a single neuron fires for many unrelated things at once — it's **po

Reading the Mind of Claude: Millions of Features Inside a Frontier AI

June 14, 2026 •3 min read

![A map of the model's concepts — features organized into neighborhoods](sm-atlas.png) In 2023, Anthropic learned to pull clean, single-meaning **features** out of a tiny one-layer model. The obviou

Mechanistic Interpretability & Sparse Autoencoders: Giving AI an X-Ray

June 5, 2026 •5 min read

window.MathJax = { tex: { inlineMath: [['$','$'], ['\$','\$']], displayMath: [['$$','$$'], ['\\[','\\]']] }, svg: { fontCache: 'global' } }; ![Dense vs. sparse activations — the SAE