A hypothesis of depth-indexed state regimes in pre-RMSNorm language models.
machine-learning deep-learning transformers neural-networks deep-learning-papers interpretability ai-research activation-analysis deep-learning-projects llm llms mechanistic-interpretability rmsnorm transformers-architecture residual-stream interpretability-research interpretability-experiments residual-streams scheduled-transformer
-
Updated
Sep 22, 2026 - HTML