We are pleased to announce that our paper has been accepted to EMNLP 2026.
-
Raito Kiya,
Satoki Ohashi,
Kosuke Sato,
Go Kamoda,
Ryosuke Takahashi,
Yuji Yamamoto,
Daiki Shiono,
Keisuke Sakaguchi,
&
Goro Kobayashi
(2026).
It’s Not RoPE That Creates Sinks: The Role of Self-Concentration and Value-Non-Mixing in Attention.
In The 2026 Conference on Empirical Methods in Natural Language Processing (EMNLP 2026).
-> Publications