DeepRead
Cover of Elements of Information Theory

About the book

Elements of Information Theory is a graduate-level textbook on the mathematical theory of information, built on probability and statistics. It covers entropy, relative entropy and mutual information, then applies them to data compression, communication over noisy channels, rate distortion, and networks of sources and channels. The second edition (2006) also treats Kolmogorov complexity, gambling and portfolio theory, and the Kelly criterion. Its central claim is that a few information measures, chiefly entropy and mutual information, capture the fundamental limits of compressing data and transmitting it reliably. The book develops these quantities from basic definitions and proves coding theorems showing that the limits can be approached or reached. It also presents information as a quantity with operational meaning beyond communication, including its role in statistical inference and in the growth rate of investment wealth.

Written by Claude from what it knows of this book.

What Hacker News says 71% recommend · 0% critical

02.5520092015202020262016 peak · 5
This bookAverage book in Probability, causality and information theory

In the commenters’ own words

What Open Library readers say 5.00 from 1 rating

  1. 51
  2. 40
  3. 30
  4. 20
  5. 10
  • 10 want to read
  • 0 reading
  • 2 have read

Only 1 rating: treat the average as a hint.

Open Library’s page for the book

What critics say, via Wikipedia

No Wikipedia article about this book yet, so no critics to quote.

Reddit communities — coming later

The threads it came up in

Details

First published
2006
ISBN
9780471241959
Editions known
2 at Open Library
Open Library
OL11674990W

Information theory

Explore in the mosaic

Read next: its neighbours on the mosaic