DeepRead
Cover of Data-intensive text processing with MapReduce

Data-intensive text processing with MapReduce

Jimmy Lin · 2010

Programming and computer science › Databases and distributed data

#5,790 most recommended

About the book

A practical guide to designing text-processing algorithms for the MapReduce programming model, written with Chris Dyer and aimed at large corpora such as web crawls. It covers the core patterns of building indexes, computing co-occurrence statistics, and running graph and iterative algorithms on a cluster, along with the integer compression methods used for inverted indexes. The central claim is that text processing at web scale is best organised around the data rather than the single machine: work is moved to where the data sits and spread across commodity clusters, with the MapReduce framework handling distribution and fault tolerance. The book argues that performance depends heavily on algorithm design within that model, so it develops techniques such as local aggregation, the pairs and stripes approaches to co-occurrence, and order inversion. It also notes where the model fits poorly, notably iterative algorithms like EM, which require repeated full passes over the data.

Written by Claude from what it knows of this book.

What Hacker News says 83% recommend · 0% critical

012200920102012201420152010 peak · 2
This bookAverage book in Databases and distributed data

In the commenters’ own words

What Open Library readers say

No Open Library reader has rated it yet.

Open Library’s page for the book

What critics say, via Wikipedia

No Wikipedia article about this book yet, so no critics to quote.

Reddit communities — coming later

The threads it came up in

Details

First published
2010
ISBN
9781608453429
Editions known
4 at Open Library
Open Library
OL19840069W

Cloud computingDatabase managementDistributed processingElectronic data processingElectronic data processing, distributed processingParallel processing (Electronic computers)Parallel processing (electronic computers)Web services

Explore in the mosaic

Read next: its neighbours on the mosaic

  • Jewels of stringology
    Maxime Crochemore · 2002 · recommended by 2 people · loosely similar by subject
  • Big Data
    Nathan Marz · 2015 · recommended by 7 people · similar by subject and what people say about it
  • Managing gigabytes
    Ian H. Witten · 1999 · recommended by 26 people · loosely similar by subject
  • Data mining
    Jiawei Han · 2000 · recommended by 4 people · similar by subject and what people say about it
  • Mining of massive datasets
    Anand Rajaraman · 2012 · recommended by 17 people · similar by subject and what people say about it
  • Hadoop
    Tom White · 2009 · recommended by 2 people · similar by subject and what people say about it
  • Readings in database systems
    Michael Stonebraker · 1998 · recommended by 11 people · similar by subject and what people say about it
  • Designing Data-Intensive Applications
    Martin Kleppmann · 2017 · recommended by 457 people · similar by subject and what people say about it
  • Taming Text
    Grant Ingersoll · 2012 · recommended by 6 people · similar by subject and what people say about it
  • Transaction processing
    Gray, Jim · 1993 · recommended by 13 people · similar by subject and what people say about it
  • UNIX relational database management
    Rod Manis · 1988 · recommended by 2 people · similar by subject and what people say about it
  • Relevant Search
    Doug Turnbull · 2016 · recommended by 2 people · loosely similar by subject
  • Database systems
    Hector Garcia-Molina · 2001 · recommended by 11 people · similar by subject and what people say about it
  • Data mining
    I. H. Witten · 1999 · recommended by 9 people · similar by subject and what people say about it
  • The data warehouse toolkit
    Ralph Kimball · 1996 · recommended by 23 people · similar by subject and what people say about it
  • Matrix computations
    Gene H. Golub · 1983 · recommended by 19 people · loosely similar by subject
  • Database System Concepts
    Korth · 2005 · recommended by 4 people · similar by subject and what people say about it
  • Syntactic structures
    Noam Chomsky · 1957 · recommended by 2 people · loosely similar by subject
  • Visualizing Data
    Ben Fry · 2008 · recommended by 7 people · loosely similar by subject
  • Seven Databases in Seven Weeks
    Eric Redmond · 2012 · recommended by 8 people · loosely similar by subject
  • Introduction to parallel computing
    Vipin Kumar · 1994 · recommended by 0 people · loosely similar by subject
  • Big Data
    Viktor Mayer-Schönberger · 2013 · recommended by 3 people · loosely similar by subject
  • Super Crunchers
    Ian Ayres · 2007 · recommended by 9 people · loosely similar by subject
  • The data model resource book
    Len Silverston · 1997 · recommended by 8 people · loosely similar by subject