Rhys Gould, Euan Ong, George Ogden, Arthur Conmy

Paper

Successor Heads: Recurring, Interpretable Attention Heads In The Wild

OpenReview

Successor Heads: Recurring, Interpretable Attention Heads In The Wild