Today’s advanced language models are based on transformer architecture. In this text, the attention mechanism of transformers is explained.