
Data-intensive text processing with MapReduce
Jimmy Lin · 2010
Programming and computer science › Databases and distributed data
#5,790 most recommended
Hacker News
8
mentions by 6 people · top 35% of 15,732 books
Open Library
—
No ratings yet
Wikipedia
—
No article yet
About the book
A practical guide to designing text-processing algorithms for the MapReduce programming model, written with Chris Dyer and aimed at large corpora such as web crawls. It covers the core patterns of building indexes, computing co-occurrence statistics, and running graph and iterative algorithms on a cluster, along with the integer compression methods used for inverted indexes. The central claim is that text processing at web scale is best organised around the data rather than the single machine: work is moved to where the data sits and spread across commodity clusters, with the MapReduce framework handling distribution and fault tolerance. The book argues that performance depends heavily on algorithm design within that model, so it develops techniques such as local aggregation, the pairs and stripes approaches to co-occurrence, and order inversion. It also notes where the model fits poorly, notably iterative algorithms like EM, which require repeated full passes over the data.
Written by Claude from what it knows of this book.
What Hacker News says 83% recommend · 0% critical
In the commenters’ own words
One approach to getting a list of topics is to look at the degree requirements for a couple of universities. I'm wrapping up a similar project, and here's…
Managing Gigabytes (Witten) Information Retrieval (Manning) Text Compression (Bell) Natural Language Processing (Manning) Natural Language Understanding…
What Open Library readers say
No Open Library reader has rated it yet.
What critics say, via Wikipedia
No Wikipedia article about this book yet, so no critics to quote.
Reddit communities — coming later
The threads it came up in
Details
- First published
- 2010
- ISBN
- 9781608453429
- Editions known
- 4 at Open Library
- Open Library
- OL19840069W
Cloud computingDatabase managementDistributed processingElectronic data processingElectronic data processing, distributed processingParallel processing (Electronic computers)Parallel processing (electronic computers)Web services
Read next: its neighbours on the mosaic
Jewels of stringologyMaxime Crochemore · 2002 · recommended by 2 people · loosely similar by subject
Big DataNathan Marz · 2015 · recommended by 7 people · similar by subject and what people say about it
Managing gigabytesIan H. Witten · 1999 · recommended by 26 people · loosely similar by subject
Data miningJiawei Han · 2000 · recommended by 4 people · similar by subject and what people say about it
Mining of massive datasetsAnand Rajaraman · 2012 · recommended by 17 people · similar by subject and what people say about it
HadoopTom White · 2009 · recommended by 2 people · similar by subject and what people say about it
Readings in database systemsMichael Stonebraker · 1998 · recommended by 11 people · similar by subject and what people say about it
Designing Data-Intensive ApplicationsMartin Kleppmann · 2017 · recommended by 457 people · similar by subject and what people say about it
Taming TextGrant Ingersoll · 2012 · recommended by 6 people · similar by subject and what people say about it
Transaction processingGray, Jim · 1993 · recommended by 13 people · similar by subject and what people say about it
UNIX relational database managementRod Manis · 1988 · recommended by 2 people · similar by subject and what people say about it
Relevant SearchDoug Turnbull · 2016 · recommended by 2 people · loosely similar by subject
Database systemsHector Garcia-Molina · 2001 · recommended by 11 people · similar by subject and what people say about it
Data miningI. H. Witten · 1999 · recommended by 9 people · similar by subject and what people say about it
The data warehouse toolkitRalph Kimball · 1996 · recommended by 23 people · similar by subject and what people say about it
Matrix computationsGene H. Golub · 1983 · recommended by 19 people · loosely similar by subject
Database System ConceptsKorth · 2005 · recommended by 4 people · similar by subject and what people say about it
Syntactic structuresNoam Chomsky · 1957 · recommended by 2 people · loosely similar by subject
Visualizing DataBen Fry · 2008 · recommended by 7 people · loosely similar by subject
Seven Databases in Seven WeeksEric Redmond · 2012 · recommended by 8 people · loosely similar by subject
Introduction to parallel computingVipin Kumar · 1994 · recommended by 0 people · loosely similar by subject
Big DataViktor Mayer-Schönberger · 2013 · recommended by 3 people · loosely similar by subject
Super CrunchersIan Ayres · 2007 · recommended by 9 people · loosely similar by subject
The data model resource bookLen Silverston · 1997 · recommended by 8 people · loosely similar by subject