Synthesizer: Rethinking Self-Attention in Transformer Models (Paper Explained)
Do we really need dot-product attention? The attention mechanism is a central part of modern Transformers, mainly due to the ...