Attention Alone Improves Machine Translation and Training Efficiency
The Transformer replaces recurrence and convolution with multi-head self-attention, reaching 28.4 BLEU on WMT 2014 English-German with shorter training.
Jul 12, 20264 min1706.03762 Code available