QuoteProject
Information: the negative reciprocal value of probability.
Claude Shannon
ShareWTF𝕏

Interpretation

What this quote means

This quote emphasizes the relationship between information and probability in a mathematical context.

Claude Shannon's quote succinctly describes how information can be quantified in relation to probability. By viewing information as the negative reciprocal of probability, it highlights the idea that as an event becomes more likely, the amount of new information it provides decreases, thus bridging concepts of uncertainty, knowledge, and communication in the fields of information theory and statistics.

Themes

InformationProbabilityCommunicationKnowledgeUncertainty

In practice

Example use cases

In a lecture on information theory, discussing the foundational ideas of Claude Shannon.

Similar quotes

I can never satisfy myself until I can make a mechanical model of a thing. If I can make a mechanical model, I can understand it. As long as I cannot make a mechanical model all the way through I cannot understand.
Lord KelvinRead
All matter comes from a primary substance, the luminiferous ether
Nikola TeslaRead
Science is not formal logic-it needs the free play of the mind in as great a degree as any other creative art. It is true that this is a gift which can hardly be taught, but its growth can be encouraged in those who already posses it.
Max BornRead
When scientifically investigating the natural world, the only thing worse than a blind believer is a seeing denier.
Neil Degrasse TysonRead
Please join me in applauding the ESA - European Space Agency’s historic efforts with the Rosetta Mission and landing a spacecraft on rotating comet. It may seem like a work of fiction, but it is very real, very impressive, and will help us to further uncover the mysteries surrounding the formation of the solar system. They made a beautiful short film using an imaginary landscape to illustrate today’s historic feat.
Stephen HawkingRead
Talk to people... everything good I've done has come from conversations with people. Science is a very social phenomenon.
John C. MatherRead

A little wisdom, now and then

Subscribe for the occasional hand-picked quote. No noise.