DeepRead
Cover of Markov Decision Processes

Markov Decision Processes

Martin L. Puterman · 1994

Machine learning, statistics and probability › Bayesian and probabilistic modeling

#11,062 most recommended

About the book

Markov decision processes, a framework for sequential decision-making under uncertainty in which outcomes are partly random and depend on the current state and the action chosen. The book covers the theory, computation and applications of these models, with its main focus on infinite-horizon discrete-time models with discrete state spaces. It also treats arbitrary state spaces, finite-horizon models and continuous-time models with discrete states. The book organises the subject around optimality criteria and presents its results in theorem-proof form, using a common framework built on the optimality (Bellman) equation. Its central aim is a unified and rigorous treatment of theory, algorithms and applications, drawn together from a literature that was then scattered. It illustrates results and algorithms repeatedly with a two-state model, and it covers recent work on average-reward countable-state models, constrained models, risk-sensitive criteria, modified policy iteration and sensitive optimality.

Written by Claude from what it knows of this book.

What Hacker News says 67% recommend · 0% critical

01220112015202020252011 peak · 1
This bookAverage book in Bayesian and probabilistic modeling

In the commenters’ own words

What Open Library readers say

No Open Library reader has rated it yet.

  • 10 want to read
  • 0 reading
  • 0 have read

Open Library’s page for the book

What critics say, via Wikipedia

No Wikipedia article about this book yet, so no critics to quote.

Reddit communities — coming later

Details

First published
1994
ISBN
9780471727828
Editions known
12 at Open Library
Open Library
OL3904991W

31.70 probabilityDiskreter Markov-ProzessDynamic programmingDynamische OptimierungDynamische programmeringEntscheidungstheorieLinear ProgrammingMarkov ChainsMarkov processesMarkov-beslissingsproblemenMarkov-processenMarkovscher ProzessPrise de décision (Statistique)Processus de Markov

Explore in the mosaic

Read next: its neighbours on the mosaic