
Reinforcement Learning and Optimal Control
Dimitri Bertsekas · 2019
Machine learning, statistics and probability › Applied machine learning and computer vision
#13,556 most recommended
Hacker News
2
mentions by 2 people · top 79% of 15,732 books
Open Library
—
No ratings yet
Wikipedia
—
No article yet
About the book
A graduate-level textbook on sequential decision-making under uncertainty, covering dynamic programming for deterministic and stochastic problems, finite and infinite horizon formulations, and the Bellman equation as their common foundation. It treats reinforcement learning as approximate dynamic programming and connects it to optimal control and model predictive control. Its central thesis is that many reinforcement learning methods can be unified as approximation in value space: a cost function is approximated offline, often by training a neural network or other architecture on simulated data, and then used in online lookahead minimization to select controls. It argues that rollout and policy iteration can improve on the approximation, giving near-optimal performance with bounded error. The book also presents this framework as the basis for successes such as TD-Gammon and AlphaZero-style game play, and as a bridge between control theory and modern learning-based methods.
Written by Claude from what it knows of this book.
What Hacker News says 50% recommend · 0% critical
In the commenters’ own words
OK, here ya go. This list is, for now, just a raw dump of titles and authors. When I have some more time, I'll turn this into a proper blog post with more…
Interesting, I didn't know about cybernetics. For the ones interested there is a book that discusses both: 'Reinforcement Learning and Optimal Control', by…
What Open Library readers say
No Open Library reader has rated it yet.
What critics say, via Wikipedia
No Wikipedia article about this book yet, so no critics to quote.
Reddit communities — coming later
Details
- First published
- 2019
- ISBN
- 9781886529397
- Editions known
- 2 at Open Library
- Open Library
- OL29241210W
Artificial intelligenceDynamic programmingMathematical optimizationNeural networks (Computer science)Reinforcement learningScience
Read next: its neighbours on the mosaic
Neuro-dynamic programmingDimitri P. Bertsekas · 1996 · recommended by 3 people · similar by subject and what people say about it
Dynamic programming and optimal controlDimitri P. Bertsekas · 1995 · recommended by 2 people · similar by subject and what people say about it
Stochastic optimal controlDimitri P. Bertsekas · 1978 · recommended by 0 people · similar by subject and what people say about it
Nonlinear ProgrammingDimitri P. Bertsekas · 1995 · recommended by 1 person · similar by subject and what people say about it
Reinforcement LearningRichard S. Sutton · 1992 · recommended by 18 people · similar by subject and what people say about it
Optimal Control TheoryDonald E. Kirk · 1970 · recommended by 1 person · similar by subject and what people say about it
Adaptive controlKarl J. Åström · 1989 · recommended by 1 person · similar by subject and what people say about it
Foundations of optimal control theoryE. B. Lee · 1967 · recommended by 1 person · similar by subject and what people say about it
Algorithms for Modern HardwareSergey Slotin · 2022 · recommended by 15 people · loosely similar by subject
Linear network optimizationDimitri P. Bertsekas · 1991 · recommended by 1 person · similar by subject and what people say about it
Deterministic and Stochastic Optimal ControlWendell H. Fleming · 1975 · recommended by 1 person · similar by subject and what people say about it
Introduction to ProbabilityDimitri P. Bertsekas · 2002 · recommended by 7 people · similar by subject and what people say about it
Modern control systemsRichard C. Dorf · 1967 · recommended by 2 people · similar by subject and what people say about it
Controlled Markov processesE. B. Dynkin · 1979 · recommended by 1 person · similar by subject and what people say about it
Deep LearningIan Goodfellow · 2016 · recommended by 44 people · similar by subject and what people say about it
Introduction to Linear OptimizationDimitris Bertsimas · 1997 · recommended by 3 people · similar by subject and what people say about it
Probabilistic roboticsSebastian Thrun · 2005 · recommended by 26 people · similar by subject and what people say about it
Building large knowledge-based systemsDouglas B. Lenat · 1989 · recommended by 0 people · loosely similar by subject
Optimal state estimationDan Simon · 2006 · recommended by 2 people · similar by subject and what people say about it
Principles of Neural DesignPeter Sterling · 2015 · recommended by 6 people · loosely similar by subject
Grokking Deep Reinforcement LearningMiguel Morales · 2020 · recommended by 1 person · similar by subject and what people say about it
Bayesian reasoning and machine learningDavid Barber · 2011 · recommended by 15 people · similar by subject and what people say about it
Why Machines LearnAnil Ananthaswamy · 2024 · recommended by 1 person · similar by subject and what people say about it
Inside computer understandingChristopher K. Riesbeck · 1980 · recommended by 0 people · loosely similar by subject