
Stochastic optimal control
Dimitri P. Bertsekas · 1978
Machine learning, statistics and probability › Bayesian and probabilistic modeling
#11,593 most recommended
Hacker News
4
mentions by 2 people · top 54% of 15,732 books
Open Library
—
No ratings yet
Wikipedia
—
No article yet
About the book
A monograph on discrete-time stochastic optimal control, in which a controller chooses actions over a sequence of stages while random disturbances affect the evolving state. It covers finite-horizon problems and infinite-horizon discounted and undiscounted cost problems, with dynamic programming as the main solution method. Dynamic programming and the Bellman optimality equation can be established rigorously for stochastic problems with general state, control, and disturbance spaces, not only finite or countable ones. The book relies on measure-theoretic tools such as Borel spaces, universally measurable policies, and analytic sets to justify these results. It then shows under suitable compactness or semicontinuity conditions that optimal policies exist and can be approached through value iteration and policy iteration.
Written by Claude from what it knows of this book.
What Hacker News says 0% recommend · 0% critical
In the commenters’ own words
Calculus? Freshman college calculus, never took it. Just read a book and started the class on sophomore calculus. Teaching calculus? Been there; done that, as…
If you want something written as well as Halmos, then start writing, and good luck! "Historical accident": Well, sure, in part nearly all the pure math…
What Open Library readers say
No Open Library reader has rated it yet.
What critics say, via Wikipedia
No Wikipedia article about this book yet, so no critics to quote.
Reddit communities — coming later
Details
- First published
- 1978
- ISBN
- 9780120932603
- Editions known
- 4 at Open Library
- Open Library
- OL2021802W
Dynamic programmingMathematical optimizationMeasure theoryStochastic processes
Read next: its neighbours on the mosaic
Foundations of optimal control theoryE. B. Lee · 1967 · recommended by 1 person · similar by subject and what people say about it
Controlled Markov processesE. B. Dynkin · 1979 · recommended by 1 person · similar by subject and what people say about it
The art and theory of dynamic programmingStuart E. Dreyfus · 1977 · recommended by 1 person · similar by subject and what people say about it
ProbabilityLeo Breiman · 1968 · recommended by 5 people · loosely similar by subject
Neuro-dynamic programmingDimitri P. Bertsekas · 1996 · recommended by 3 people · similar by subject and what people say about it
Dynamic programming and optimal controlDimitri P. Bertsekas · 1995 · recommended by 2 people · similar by subject and what people say about it
Reinforcement Learning and Optimal ControlDimitri Bertsekas · 2019 · recommended by 1 person · similar by subject and what people say about it
Deterministic and Stochastic Optimal ControlWendell H. Fleming · 1975 · recommended by 1 person · similar by subject and what people say about it
Introduction to ProbabilityDimitri P. Bertsekas · 2002 · recommended by 7 people · similar by subject and what people say about it
Nonlinear ProgrammingDimitri P. Bertsekas · 1995 · recommended by 1 person · similar by subject and what people say about it
Approximate dynamic programmingWarren B. Powell · 2011 · recommended by 1 person · similar by subject and what people say about it
Mathematical Theory of Optimal ProcessesPontryagin Ls · 1962 · recommended by 0 people · loosely similar by subject
Linear network optimizationDimitri P. Bertsekas · 1991 · recommended by 1 person · similar by subject and what people say about it
Optimal Control TheoryDonald E. Kirk · 1970 · recommended by 1 person · similar by subject and what people say about it
Adventures in stochastic processesSidney I. Resnick · 1992 · recommended by 1 person · similar by subject and what people say about it
Introduction to Linear OptimizationDimitris Bertsimas · 1997 · recommended by 3 people · similar by subject and what people say about it
Stochastic ProcessesRobert G. Gallager · 2013 · recommended by 2 people · similar by subject and what people say about it
Probability and ComputingMichael Mitzenmacher · 2005 · recommended by 4 people · similar by subject and what people say about it
Stochastic Calculus for Finance IiSteven Shreve · 2010 · recommended by 2 people · similar by subject and what people say about it
Stochastic ProcessesJoseph L. Doob · 1953 · recommended by 1 person · similar by subject and what people say about it
Combinatorial optimizationChristos H. Papadimitriou · 1981 · recommended by 1 person · similar by subject and what people say about it
Introduction to probability theoryPaul Gerhard Hoel · 1971 · recommended by 7 people · similar by subject and what people say about it
Markov Decision ProcessesMartin L. Puterman · 1994 · recommended by 2 people · similar by subject and what people say about it
Statistics of random processesRobert Shevilevich Lipt︠s︡er · 1977 · recommended by 1 person · similar by subject and what people say about it