DeepRead
Cover of Stochastic optimal control

Stochastic optimal control

Dimitri P. Bertsekas · 1978

Machine learning, statistics and probability › Bayesian and probabilistic modeling

#11,593 most recommended

About the book

A monograph on discrete-time stochastic optimal control, in which a controller chooses actions over a sequence of stages while random disturbances affect the evolving state. It covers finite-horizon problems and infinite-horizon discounted and undiscounted cost problems, with dynamic programming as the main solution method. Dynamic programming and the Bellman optimality equation can be established rigorously for stochastic problems with general state, control, and disturbance spaces, not only finite or countable ones. The book relies on measure-theoretic tools such as Borel spaces, universally measurable policies, and analytic sets to justify these results. It then shows under suitable compactness or semicontinuity conditions that optimal policies exist and can be approached through value iteration and policy iteration.

Written by Claude from what it knows of this book.

What Hacker News says 0% recommend · 0% critical

012201120122014201620182018 peak · 2
This bookAverage book in Bayesian and probabilistic modeling

In the commenters’ own words

What Open Library readers say

No Open Library reader has rated it yet.

Open Library’s page for the book

What critics say, via Wikipedia

No Wikipedia article about this book yet, so no critics to quote.

Reddit communities — coming later

Details

First published
1978
ISBN
9780120932603
Editions known
4 at Open Library
Open Library
OL2021802W

Dynamic programmingMathematical optimizationMeasure theoryStochastic processes

Explore in the mosaic

Read next: its neighbours on the mosaic