Posts tagged "transformers"
2 posts
The Residual Stream: From AlexNet to DeepSeek-V4
*A complete research dossier — the one idea, $\text{output} = \text{input} + F(\text{input})$, traced from computer vision in 2015 to the multi-lane residual streams of today's frontier models.* 📺
An Image Is Worth 16x16 Words: How Vision Transformers Work
window.MathJax = { tex: { inlineMath: [['$','$'], ['\\(','\\)']], displayMath: [['$$','$$'], ['\\[','\\]']] }, svg: { fontCache: 'global' } }; ![The Vision Transformer architecture: p