
Neuro-dynamic programming
Dimitri P. Bertsekas · 1996
Machine learning, statistics and probability › Bayesian and probabilistic modeling
#8,171 most recommended
Hacker News
4
mentions by 4 people · top 54% of 15,732 books
Open Library
—
No ratings yet
Wikipedia
—
No article yet
About the book
This book covers neuro-dynamic programming, a set of methods for solving large-scale sequential decision problems, mainly Markov decision processes, when exact dynamic programming is infeasible. It spans the mathematical foundations of dynamic programming, simulation-based learning algorithms, and the use of approximation architectures such as neural networks to represent cost functions and policies. The central claim is that exact dynamic programming fails for large state spaces because of the curse of dimensionality, so approximate methods must replace the exact value function. The authors argue that combining dynamic programming with simulation and function approximation can produce practical methods, and they supply convergence analysis for several of them, including temporal-difference learning, Q-learning, and approximate policy iteration. They also present case studies to show that these methods work on hard problems.
Written by Claude from what it knows of this book.
What Hacker News says 75% recommend · 0% critical
In the commenters’ own words
OK, here ya go. This list is, for now, just a raw dump of titles and authors. When I have some more time, I'll turn this into a proper blog post with more…
I wrote a supplementary blog post to Brad's ( http://pindancing.blogspot.com/2010/01/learning-about-machin... ) with the list of books I found useful (no…
What Open Library readers say
No Open Library reader has rated it yet.
What critics say, via Wikipedia
No Wikipedia article about this book yet, so no critics to quote.
Reddit communities — coming later
Details
- First published
- 1996
- ISBN
- 9781886529106
- Editions known
- 2 at Open Library
- Open Library
- OL2021798W
Dynamic programmingGeneralMathematical optimizationMathematicsNeural networks (Computer science)
Read next: its neighbours on the mosaic
Reinforcement Learning and Optimal ControlDimitri Bertsekas · 2019 · recommended by 1 person · similar by subject and what people say about it
Neural networks for pattern recognitionChristopher M. Bishop · 1995 · recommended by 3 people · loosely similar by subject
Dynamic programming and optimal controlDimitri P. Bertsekas · 1995 · recommended by 2 people · similar by subject and what people say about it
Nonlinear ProgrammingDimitri P. Bertsekas · 1995 · recommended by 1 person · similar by subject and what people say about it
Stochastic optimal controlDimitri P. Bertsekas · 1978 · recommended by 0 people · similar by subject and what people say about it
Naive Set TheoryPaul R. Halmos · 1960 · recommended by 29 people · loosely similar by subject
Introduction to ProbabilityDimitri P. Bertsekas · 2002 · recommended by 7 people · similar by subject and what people say about it
The art and theory of dynamic programmingStuart E. Dreyfus · 1977 · recommended by 1 person · similar by subject and what people say about it
Probabilistic Graphical ModelsDaphne Koller · 2009 · recommended by 16 people · similar by subject and what people say about it
Approximate dynamic programmingWarren B. Powell · 2011 · recommended by 1 person · similar by subject and what people say about it
Introductory techniques for 3-D computer visionEmanuele Trucco · 1998 · recommended by 2 people · loosely similar by subject
Linear network optimizationDimitri P. Bertsekas · 1991 · recommended by 1 person · similar by subject and what people say about it
Introduction to Linear OptimizationDimitris Bertsimas · 1997 · recommended by 3 people · similar by subject and what people say about it
CalculusGilbert Strang · 1991 · recommended by 7 people · loosely similar by subject
Practical Probabilistic ProgrammingAvi Pfeffer · 2016 · recommended by 4 people · similar by subject and what people say about it
Simply SchemeBrian Harvey · 1994 · recommended by 19 people · loosely similar by subject
Modern Compiler DesignDavid Galles · 2004 · recommended by 1 person · loosely similar by subject
A logical approach to discrete mathGries, David. · 1993 · recommended by 6 people · loosely similar by subject
Game TheoryDrew Fudenberg · 1991 · recommended by 3 people · similar by subject and what people say about it
Numerical OptimizationJorge Nocedal · 2006 · recommended by 6 people · similar by subject and what people say about it
Algorithms for OptimizationMykel J. Kochenderfer · 2019 · recommended by 5 people · similar by subject and what people say about it
Bayesian reasoning and machine learningDavid Barber · 2011 · recommended by 15 people · similar by subject and what people say about it
Neural network designMartin T. Hagan · 1996 · recommended by 6 people · loosely similar by subject
A field guide to genetic programmingRiccardo Poli · 2008 · recommended by 6 people · similar by subject and what people say about it