attention

Please direct your attention to the following words.

She attended her sickbed; her watchful attentions triumphed over the malignity of the distemper.

The company will now come to attention.

The attention mechanism is an important part of these models and plays a very crucial role. Before Transformer models, the attention mechanism was proposed as a helper for improving conventional DL models such as RNNs.