
Approximate dynamic programming
Warren B. Powell · 2011
Mathematics and physics › Numerical and matrix computation
#12,677 most recommended
Hacker News
2
mentions by 2 people · top 79% of 15,732 books
Open Library
—
No ratings yet
1 want to read
Wikipedia
—
No article yet
About the book
The book covers sequential decision problems under uncertainty, where choices made now affect future states and rewards, and how to solve them when the state space is too large for exact dynamic programming. It is aimed at researchers and practitioners in operations research and related fields, with applications such as logistics, transportation, resource allocation, and energy. Its central claim is that many large sequential decision problems can be handled by approximating the value function or the decision policy, using simulation, statistical learning, and optimization together, instead of solving Bellman's equation exactly. It argues that the curses of dimensionality (large state, outcome, and action spaces) are the main obstacle and that a careful modeling framework, including the post-decision state, makes approximation tractable. It also argues that problem modeling and policy design should be treated as distinct steps, so practitioners can choose among several policy classes rather than assuming one method fits all.
Written by Claude from what it knows of this book.
What Hacker News says 50% recommend · 0% critical
In the commenters’ own words
UCB bandit algorithms are quite simple to understand, and the generalisation of them by the UCT algorithm to tree search spaces seems like a pretty clean…
The theory of multi-armed bandits arises from the study of Markov decision processes (MDP). This field is also closely studied in and related to Stochastic…
What Open Library readers say
No Open Library reader has rated it yet.
- 1 want to read
- 0 reading
- 0 have read
What critics say, via Wikipedia
No Wikipedia article about this book yet, so no critics to quote.
Reddit communities — coming later
Details
- First published
- 2011
- ISBN
- 9780470604458
- Editions known
- 2 at Open Library
- Open Library
- OL16212035W
Dynamic programming
Read next: its neighbours on the mosaic
Dynamic programming and optimal controlDimitri P. Bertsekas · 1995 · recommended by 2 people · similar by subject and what people say about it
Markov Decision ProcessesMartin L. Puterman · 1994 · recommended by 2 people · similar by subject and what people say about it
The art and theory of dynamic programmingStuart E. Dreyfus · 1977 · recommended by 1 person · similar by subject and what people say about it
Neuro-dynamic programmingDimitri P. Bertsekas · 1996 · recommended by 3 people · similar by subject and what people say about it
Stochastic optimal controlDimitri P. Bertsekas · 1978 · recommended by 0 people · similar by subject and what people say about it
Nonlinear ProgrammingDimitri P. Bertsekas · 1995 · recommended by 1 person · similar by subject and what people say about it
Probability and ComputingMichael Mitzenmacher · 2005 · recommended by 4 people · similar by subject and what people say about it
Practical Probabilistic ProgrammingAvi Pfeffer · 2016 · recommended by 4 people · similar by subject and what people say about it
Controlled Markov processesE. B. Dynkin · 1979 · recommended by 1 person · similar by subject and what people say about it
Algorithms for OptimizationMykel J. Kochenderfer · 2019 · recommended by 5 people · similar by subject and what people say about it
Linear network optimizationDimitri P. Bertsekas · 1991 · recommended by 1 person · similar by subject and what people say about it
Combinatorial optimizationChristos H. Papadimitriou · 1981 · recommended by 1 person · similar by subject and what people say about it
Machine learningKevin P. Murphy · 2012 · recommended by 15 people · similar by subject and what people say about it
Doing Bayesian Data AnalysisJohn K. Kruschke · 2010 · recommended by 22 people · similar by subject and what people say about it
Program ConstructionRoland C. Backhouse · 2003 · recommended by 3 people · similar by subject and what people say about it
Combinatorial OptimizationAlexander Schrijver · 2003 · recommended by 1 person · similar by subject and what people say about it
Algorithmic problem solvingRoland C. Backhouse · 2011 · recommended by 3 people · loosely similar by subject
Probabilistic Graphical ModelsDaphne Koller · 2009 · recommended by 16 people · loosely similar by subject
Reinforcement Learning and Optimal ControlDimitri Bertsekas · 2019 · recommended by 1 person · loosely similar by subject
Power programming with MathematicaDavid B. Wagner · 1996 · recommended by 2 people · loosely similar by subject
A field guide to genetic programmingRiccardo Poli · 2008 · recommended by 6 people · loosely similar by subject
Think ComplexityAllen B. Downey · 2012 · recommended by 11 people · loosely similar by subject
Algorithm designJon Kleinberg · 1922 · recommended by 30 people · loosely similar by subject
Bayesian methods for hackersCameron Davidson-Pilon · 2015 · recommended by 24 people · loosely similar by subject