
Programming Massively Parallel Processors
David Kirk, Wen-Mei W. Hwu · 2010
Programming and computer science › Operating systems and networking
#2,906 most recommended
Hacker News
15
mentions by 15 people · top 21% of 15,732 books
Open Library
—
No ratings yet
2 want to read
Wikipedia
—
No article yet
About the book
A textbook on writing parallel programs for graphics processing units, using NVIDIA's CUDA model as the main vehicle. It covers the GPU execution model, thread organization, the memory hierarchy, and the algorithmic patterns that map well to massively parallel hardware, such as reduction, scan, histogram, and stencil computations. Writing fast parallel code requires understanding the hardware, not just the syntax of a parallel language. The authors contend that performance is governed mainly by memory access patterns, data locality, and how work is divided among threads, so programmers must reason about these explicitly. They present parallel decomposition as a problem-solving discipline that applies beyond any single platform, and they use worked examples to show how a naive kernel can be restructured for much higher throughput.
Written by Claude from what it knows of this book.
What Hacker News says 53% recommend · 0% critical
In the commenters’ own words
Here's what I used while doing an undergrad independent study a couple years ago (except for the books; at the time, books on the subject didn't exist yet)…
You have to pay attention to a few components. So - fullsize case where a big 3-fan, 13" card won't run into the hard drive or DVD drive cables, if you choose…
What Open Library readers say
No Open Library reader has rated it yet.
- 2 want to read
- 1 reading
- 0 have read
What critics say, via Wikipedia
No Wikipedia article about this book yet, so no critics to quote.
Reddit communities — coming later
The threads it came up in
Details
- First published
- 2010
- ISBN
- 9780323912310
- Editions known
- 6 at Open Library
- Open Library
- OL25666151W
Computer architectureMultiprocessorsParallel processing (electronic computers)Parallel programming (computer science)
Read next: its neighbours on the mosaic
The art of multiprocessor programmingMaurice Herlihy · 2008 · recommended by 27 people · similar by subject and what people say about it
Computer architectureJohn L. Hennessy · 1989 · recommended by 59 people · similar by subject and what people say about it
Parallel And Concurrent Programming In HaskellSimon Marlow · 2013 · recommended by 24 people · similar by subject and what people say about it
Introduction to parallel computingVipin Kumar · 1994 · recommended by 0 people · similar by subject and what people say about it
Computer systemsRandal Bryant · 2002 · recommended by 67 people · similar by subject and what people say about it
The paralation modelGary Sabot · 1988 · recommended by 1 person · similar by subject and what people say about it
Parallel distributed processingDavid E. Rumelhart · 1986 · recommended by 5 people · similar by subject and what people say about it
Algorithms for Modern HardwareSergey Slotin · 2022 · recommended by 15 people · similar by subject and what people say about it
Distributed SystemsAndrew S. Tanenbaum · 2001 · recommended by 14 people · similar by subject and what people say about it
Advanced compiler design and implementationSteven S. Muchnick · 1997 · recommended by 13 people · similar by subject and what people say about it
Advanced Computer ArchitectureKai Hwang · 1992 · recommended by 1 person · similar by subject and what people say about it
Computation structuresStephen A. Ward · 1990 · recommended by 8 people · similar by subject and what people say about it
Algorithms and data structuresNiklaus Wirth · 1986 · recommended by 8 people · similar by subject and what people say about it
Engineering a compilerKeith D. Cooper · 2004 · recommended by 39 people · similar by subject and what people say about it
Modern processor designJohn Paul Shen · 2005 · recommended by 6 people · similar by subject and what people say about it
Building parallel, embedded, and real-time applications with AdaJohn W. McCormick · 2011 · recommended by 3 people · similar by subject and what people say about it
Algorithms and parallel computingFayez Gebali · 2011 · recommended by 0 people · similar by subject and what people say about it
Communicating sequential processesC. A. R. Hoare · 1985 · recommended by 25 people · similar by subject and what people say about it
Programming in HaskellGraham Hutton · 2007 · recommended by 34 people · similar by subject and what people say about it
C Concurrency in ActionAnthony Williams · 2012 · recommended by 14 people · similar by subject and what people say about it
Write Great CodeRandall Hyde · 2004 · recommended by 16 people · similar by subject and what people say about it
Introduction to AlgorithmsThomas H. Cormen · 1990 · recommended by 274 people · similar by subject and what people say about it
Large-scale C[plus plus] software designJohn Lakos · 1996 · recommended by 6 people · similar by subject and what people say about it
The Elements of Computing SystemsNoam Nisan · 2005 · recommended by 204 people · similar by subject and what people say about it