attentions

Noun

attention (countable and uncountable, plural attentions)

1. (uncountable) Mental focus.
   • Please direct your attention to the following words.

   Synonyms:

   heed, notice

2. (countable) An action or remark expressing concern for or interest in someone or something, especially romantic interest.
   • She attended her sickbed; her watchful attentions triumphed over the malignity of the distemper.1816 June – 1817 April/May (date written), [Mary Shelley], chapter 3, in Frankenstein; or, The Modern Prometheus. […], volume (please specify |volume=I to III), London: […] [Macdonald and Son] for...
3. (uncountable) A state of alertness in the standing position.
   • The company will now come to attention.
4. (uncountable, machine learning) A kind of prioritisation technique in neural networks that assigns soft weights between tokens from two (or more) input sequences in order to compute the required output.
   • The attention mechanism is an important part of these models and plays a very crucial role. Before Transformer models, the attention mechanism was proposed as a helper for improving conventional DL models such as RNNs.2021, Savas Yildirim, Meysam Asgari-Chenaghlu, Mastering Transformers […] , Packt Publishing Ltd, →ISBN, page 26

See all 6 meanings of attention