Word.ws English Dictionary

joint entropy

joint entropy noun: the Shannon entropy of a "script" whose "characters" are elements of the Cartesian product of the sets of characters of the component scripts.

Noun

joint entropy (countable and uncountable, plural joint entropies)

  1. The Shannon entropy of a "script" whose "characters" are elements of the Cartesian product of the sets of characters of the component scripts.
    • If random variables X and Y are mutually independent, then their joint entropy H(X,Y) is just the sum H(X)#43;H(Y) of its component entropies. If they are not mutually independent, then their joint entropy will be H(X)#43;H(Y)-I(X#59;Y) where I(X#59;Y) is the mutual information of X and Y.

Forms of joint entropy

pluraljoint entropies

Questions about joint entropy

What does joint entropy mean?
Joint entropy means the Shannon entropy of a "script" whose "characters" are elements of the Cartesian product of the sets of characters of the component scripts.
What part of speech is joint entropy?
Joint entropy is a noun.
What is the plural of joint entropy?
The plural of joint entropy is joint entropies.

Words near joint entropy in the dictionary

  1. joint communiques
  2. joint communiqué
  3. joint communiqués
  4. joint custody
  5. joint entropies
  6. joint entropy
  7. joint families
  8. joint family
  9. joint fir
  10. joint firs
  11. joint grass

Source and license

Adapted from Wiktionary: joint entropy (page history and authors). Text available under the Creative Commons Attribution-ShareAlike 4.0 license. Word.ws reformatted the entry and added links. Wiktionary data of 2026-09-02.

Last updated:

Cite this entry: “joint entropy.” Word.ws, https://word.ws/joint_entropy. Based on Wiktionary, CC BY-SA 4.0.