The workspace signature: decodable everywhere, visually separated only late

Per hidden-state layer of Llama-3.1-8B on a 4-topic set. The gap — high decodability, near-zero visual separation through the first half — is the entangled, superposed "workspace." Hover for values.

Class decodability — kNN acc (full 4096-d state) Visual separation — silhouette (2-D UMAP)

Source: metrics.json · 20-Newsgroups (space / baseball / graphics / mideast), 400 texts · kNN 5-fold on standardized 4096-d states; silhouette on the 2-D UMAP. Plot L0 = embeddings, Lk = output of decoder layer k−1.