QuoteProject
Information: the negative reciprocal value of probability.
Claude Shannon
ShareWTF𝕏

Interpretation

What this quote means

This quote emphasizes the relationship between information and probability in a mathematical context.

Claude Shannon's quote succinctly describes how information can be quantified in relation to probability. By viewing information as the negative reciprocal of probability, it highlights the idea that as an event becomes more likely, the amount of new information it provides decreases, thus bridging concepts of uncertainty, knowledge, and communication in the fields of information theory and statistics.

Themes

InformationProbabilityCommunicationKnowledgeUncertainty

In practice

Example use cases

In a lecture on information theory, discussing the foundational ideas of Claude Shannon.

Similar quotes

Medical science has proven time and again that when the resources are provided, great progress in the treatment, cure, and prevention of disease can occur.
Michael J. FoxRead
But our ways of learning about the world are strongly influenced by the social preconceptions and biased modes of thinking that each scientist must apply to any problem. The stereotype of a fully rational and objective scientific method, with individual scientists as logical (and interchangeable) robots, is self-serving mythology.
Stephen Jay GouldRead
In science it often happens that scientists say, 'You know that's a really good argument; my position is mistaken,' and then they would actually change their minds and you never hear that old view from them again. They really do it. It doesn't happen as often as it should, because scientists are human and change is sometimes painful. But it happens every day. I cannot recall the last time something like that happened in politics or religion.
Carl SaganRead
We used to think that you could pay attention to five to nine things at a time. We now know that's not true. That's a crazy overestimate. The conscious mind can attend to about three things at once. Trying to juggle any more than that, and you're going to lose some brainpower.
Daniel LevitinRead
A theory should not attempt to explain all the facts, because some of the facts are wrong
Francis CrickRead
It used to be thought that our genes were historically immutable and that it was not possible to imagine a conversation between culture and genetics.
Nicholas A. ChristakisRead

A little wisdom, now and then

Subscribe for the occasional hand-picked quote. No noise.