Word.ws English Dictionary

information entropy

information entropy noun: a measure of the uncertainty associated with a random variable; a measure of the average information content one is missing when one does not know the value of the random variable (usually in units such as bits); the amount of information (measured in, say, bits) contained per average instance of a character in a stream of characters.

Noun

information entropy (uncountable)

  1. A measure of the uncertainty associated with a random variable; a measure of the average information content one is missing when one does not know the value of the random variable (usually in units such as bits); the amount of information (measured in, say, bits) contained per average instance of a character in a stream of characters.
    Synonyms:
    Shannon entropy

Synonyms of information entropy

Questions about information entropy

What does information entropy mean?
Information entropy means a measure of the uncertainty associated with a random variable; a measure of the average information content one is missing when one does not know the value of the random variable (usually in units such as bits); the amount of information (measured in, say, bits) contained per average instance of a character in a stream of characters.
What part of speech is information entropy?
Information entropy is a noun.

Words near information entropy in the dictionary

  1. information desk
  2. information desks
  3. information drive
  4. information engine
  5. information engines
  6. information entropy
  7. information fatigue
  8. information fatigue syndrome
  9. information float
  10. information floats
  11. information hazard

Source and license

Adapted from Wiktionary: information entropy (page history and authors). Text available under the Creative Commons Attribution-ShareAlike 4.0 license. Word.ws reformatted the entry and added links. Wiktionary data of 2026-09-02.

Last updated:

Cite this entry: “information entropy.” Word.ws, https://word.ws/information_entropy. Based on Wiktionary, CC BY-SA 4.0.