papersTODAY 04:00 UTC
Study Extends Retrieval-Head Analysis to Multilingual Language Models
Researchers extend prior work on retrieval heads — attention heads that pull information out of context — from English to multilingual models. They identify retrieval heads and a separate class of retrieval-transition heads, and report that behavior differs across languages. The work is a revised arXiv preprint in computation and language.