[2605.31558] Positional versus Symbolic Attention Heads: Learning Dynamics, RoPE Geometry, and Length Generalization
![[2605.31558] Positional versus Symbolic Attention Heads: Learning Dynamics, RoPE Geometry, and Length Generalization](/static/img/curated/afbytes-us.png)
AI disclosure
Summary
Abstract page for arXiv paper 2605.31558: Positional versus Symbolic Attention Heads: Learning Dynamics, RoPE Geometry, and Length Generalization