Word.ws English Dictionary

cross-attention

cross-attention noun: a form of attention (machine learning method) where two different input sequences are compared, i.e. the keys and queries differ.

Noun

cross-attention (uncountable)

  1. (machine learning) A form of attention (machine learning method) where two different input sequences are compared, i.e. the keys and queries differ.
    • The cross attention layer inside each transformer decoder block is in fact a multi-head cross attention layer […]2024, Benoit Liquet, Sarat Moka, Yoni Nazarathy, Mathematical Engineering of Deep Learning, CRC Press, page 286
    Antonyms:
    self-attention

Antonyms of cross-attention

Forms of cross-attention

alternative formcross attention

Origin of cross-attention

From cross- + attention.

Questions about cross-attention

What does cross-attention mean?
Cross-attention means a form of attention (machine learning method) where two different input sequences are compared, i.e. the keys and queries differ.
What part of speech is cross-attention?
Cross-attention is a noun.

Words near cross-attention in the dictionary

  1. cross-appeal
  2. cross-appealed
  3. cross-appealing
  4. cross-appeals
  5. cross-armed
  6. cross-attention
  7. cross-back
  8. cross-backs
  9. cross-banded
  10. cross-batteries
  11. cross-battery

Source and license

Adapted from Wiktionary: cross-attention (page history and authors). Text available under the Creative Commons Attribution-ShareAlike 4.0 license. Word.ws reformatted the entry and added links. Wiktionary data of 2026-09-02.

Last updated:

Cite this entry: “cross-attention.” Word.ws, https://word.ws/cross-attention. Based on Wiktionary, CC BY-SA 4.0.