Simple Local Attentions Remain Competitive for Long-Context Tasks

Published in NAACL 2022, 2022

code

Read the paper