DeepRead
Cover of The minimum description length principle

The minimum description length principle

Peter D. Grünwald · 2007

Machine learning, statistics and probability › Probability, causality and information theory

#6,152 most recommended

About the book

The book covers the minimum description length (MDL) principle, a method of statistical inference and model selection that rests on information theory and data compression. It moves from the basics of coding and information-theoretic concepts to universal codes and the stochastic complexity of statistical models. It sits at the intersection of statistics, machine learning, and information theory. Learning from data is a matter of compression: the best explanation of a set of observations is the one that lets them be encoded most briefly, counting the cost of describing the model as well as the data given the model. The book develops refined forms of this idea, such as normalized maximum likelihood and stochastic complexity, to avoid overfitting without relying on subjective priors. It compares MDL with Bayesian and other frequentist approaches, and argues that it gives a unified, prior-free criterion for model selection and prediction.

Written by Claude from what it knows of this book.

What Hacker News says 33% recommend · 33% critical

01220082015202020262008 peak · 1
This bookAverage book in Probability, causality and information theory

In the commenters’ own words

What Open Library readers say 4.00 from 1 rating

  1. 50
  2. 41
  3. 30
  4. 20
  5. 10
  • 1 want to read
  • 0 reading
  • 0 have read

Only 1 rating: treat the average as a hint.

Open Library’s page for the book

What critics say, via Wikipedia

No Wikipedia article about this book yet, so no critics to quote.

Reddit communities — coming later

The threads it came up in

Details

First published
2007
ISBN
9780262072816
Editions known
8 at Open Library
Open Library
OL9285354W

Information theoryMinimum description length (Information theory)

Explore in the mosaic

Read next: its neighbours on the mosaic