Research· AI-written
Sparse autoencoders reveal fine-grained human-interpretable specialization in MoE experts
By applying sparse autoencoders to Mixture-of-Experts layer outputs, researchers show that individual experts exhibit fine-grained, human-interpretable specialization far below coarse domain labels.
Nov 6, 2026 · 3 min read