i Data-Intensive Text Processing with MapReduce

← Back to document page

IData-Intensive Text Processingwith MapReduceJimmy Lin and Chris DyerUniversity of Maryland, College ParkManuscript prepared April 11, 2010This is the pre-production manuscript of a book in the Morgan & Claypool SynthesisLectures on Human Language Technologies. Anticipated publication date is . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ii1Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . in the Clouds . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ideas . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Is This Different?.

with MapReduce in 2008 [46]. In April 2009, a blog post1 was written about eBay’s two enormous data warehouses: one with 2 petabytes of user data, and the other with 6.5 petabytes of user data spanning 170 trillion records and growing by 150 billion new records per day. Shortly thereafter, Facebook revealed2 similarly impressive numbers,

  Ebay