DeepRead
Cover of Numerical Optimization

Numerical Optimization

Jorge Nocedal, Stephen Wright · 2006

Mathematics and physics › Numerical and matrix computation

#4,537 most recommended

About the book

A graduate-level textbook on numerical methods for continuous nonlinear optimization, covering both unconstrained and constrained problems. It treats the algorithms together with their convergence theory, linear algebra, and practical implementation, and includes nonlinear least squares and systems of nonlinear equations. The central claim is that a small set of ideas, namely line search and trust-region globalization, Newton and quasi-Newton approximations such as BFGS, and active-set or interior-point handling of constraints, underlies most practical nonlinear optimization software. The book holds that choosing and tuning these methods requires understanding the trade-off between fast local convergence and global robustness, and the per-iteration cost of the linear algebra involved. It presents the algorithms with that analysis and implementation detail rather than as a catalogue of formulas.

Written by Claude from what it knows of this book.

What Hacker News says 75% recommend · 13% critical

024201620182020202220252025 peak · 4
This bookAverage book in Numerical and matrix computation

In the commenters’ own words

  • > In addition to Alex’s relaxation-based solver, we tried several gradient descent-based solvers, which resulted in better convergence. The first was the…

    shoo · 2025 · in Ink and Switch Constraint System (2023)

  • Though I have complaints with it, Numerical Optimization by Nocedal and Wright is probably the best reference for modern optimization techniques. My complaint…

    kxyvr · 2020 · in Why “Gradient” Descent?

What Open Library readers say

No Open Library reader has rated it yet.

  • 3 want to read
  • 0 reading
  • 0 have read

Open Library’s page for the book

What critics say, via Wikipedia

No Wikipedia article about this book yet, so no critics to quote.

Reddit communities — coming later

Details

First published
2006
ISBN
9780387400655
Editions known
6 at Open Library
Open Library
OL16972382W

Calculus of Variations and Optimal ControlOptimizationComputational Mathematics and Numerical AnalysisComputer scienceControl Systems TheoryMathematical optimizationMathematicsNumerieke methodenOperations Research/Decision TheoryOptimaliserenSystem theory

Explore in the mosaic

Read next: its neighbours on the mosaic