
Dynamic programming and optimal control
Dimitri P. Bertsekas · 1995
Machine learning, statistics and probability › Bayesian and probabilistic modeling
#13,965 most recommended
Hacker News
2
mentions by 2 people · top 79% of 15,732 books
Open Library
—
No ratings yet
5 want to read
Wikipedia
—
No article yet
About the book
Dynamic programming and optimal control for sequential decision-making, where a decision maker chooses actions over time to minimize a cost or maximize a reward under uncertainty and constraints. It covers finite-horizon and infinite-horizon discrete-time problems, stochastic models, and the algorithms used to solve them, aimed at graduate students and researchers in control, operations research, and related fields. The book presents dynamic programming as a single general principle, the principle of optimality and the Bellman equation, that underlies optimal control across deterministic, stochastic, and infinite-horizon settings. It develops the theory rigorously and argues that exact solution methods, such as value and policy iteration, are practical only for small problems, so approximation methods become necessary for realistic applications. It treats approximation as a central topic, not a footnote.
Written by Claude from what it knows of this book.
What Hacker News says 100% recommend · 0% critical
In the commenters’ own words
The theory of multi-armed bandits arises from the study of Markov decision processes (MDP). This field is also closely studied in and related to Stochastic…
Bertsekas' earlier books (Dynamic Programming and Optimal Control + Neurodynamic Programming w/ Tsitsiklis) are great references and collect many insights &…
What Open Library readers say
No Open Library reader has rated it yet.
- 5 want to read
- 0 reading
- 0 have read
What critics say, via Wikipedia
No Wikipedia article about this book yet, so no critics to quote.
Reddit communities — coming later
Details
- First published
- 1995
- ISBN
- 9781886529113
- Editions known
- 8 at Open Library
- Open Library
- OL2021789W
Control theoryDynamic programmingSoftware
Read next: its neighbours on the mosaic
Markov Decision ProcessesMartin L. Puterman · 1994 · recommended by 2 people · similar by subject and what people say about it
Approximate dynamic programmingWarren B. Powell · 2011 · recommended by 1 person · similar by subject and what people say about it
Neuro-dynamic programmingDimitri P. Bertsekas · 1996 · recommended by 3 people · similar by subject and what people say about it
Nonlinear ProgrammingDimitri P. Bertsekas · 1995 · recommended by 1 person · similar by subject and what people say about it
Reinforcement Learning and Optimal ControlDimitri Bertsekas · 2019 · recommended by 1 person · similar by subject and what people say about it
Stochastic optimal controlDimitri P. Bertsekas · 1978 · recommended by 0 people · similar by subject and what people say about it
The art and theory of dynamic programmingStuart E. Dreyfus · 1977 · recommended by 1 person · similar by subject and what people say about it
Controlled Markov processesE. B. Dynkin · 1979 · recommended by 1 person · similar by subject and what people say about it
Linear network optimizationDimitri P. Bertsekas · 1991 · recommended by 1 person · similar by subject and what people say about it
Optimal Control TheoryDonald E. Kirk · 1970 · recommended by 1 person · similar by subject and what people say about it
Introduction to ProbabilityDimitri P. Bertsekas · 2002 · recommended by 7 people · similar by subject and what people say about it
The Computer and the BrainJohn Von Neumann · 1958 · recommended by 9 people · loosely similar by subject
Game TheoryDrew Fudenberg · 1991 · recommended by 3 people · similar by subject and what people say about it
Practical Probabilistic ProgrammingAvi Pfeffer · 2016 · recommended by 4 people · similar by subject and what people say about it
Combinatorial optimizationChristos H. Papadimitriou · 1981 · recommended by 1 person · similar by subject and what people say about it
Modern control systemsRichard C. Dorf · 1967 · recommended by 2 people · similar by subject and what people say about it
Deterministic and Stochastic Optimal ControlWendell H. Fleming · 1975 · recommended by 1 person · similar by subject and what people say about it
Combinatorial OptimizationAlexander Schrijver · 2003 · recommended by 1 person · similar by subject and what people say about it
Probability and ComputingMichael Mitzenmacher · 2005 · recommended by 4 people · similar by subject and what people say about it
Introduction to Linear OptimizationDimitris Bertsimas · 1997 · recommended by 3 people · similar by subject and what people say about it
Probabilistic roboticsSebastian Thrun · 2005 · recommended by 26 people · similar by subject and what people say about it
Behavioral mathematics for game AIDave Mark · 2009 · recommended by 2 people · similar by subject and what people say about it
Probabilistic Graphical ModelsDaphne Koller · 2009 · recommended by 16 people · similar by subject and what people say about it
Process dynamics, modeling, and controlBabatunde A. Ogunnaike · 1994 · recommended by 2 people · similar by subject and what people say about it