MapReduce Implementation and Reading Note

This is the notes of MapReduce Paper(2004) and MIT 6.824 Distributed System Lab 1A. Intro Background: Over the past five years, the authors and many others at Google have implemented hundreds of special-purpose computations that process large amounts of raw data, such as crawled documents, web request logs, etc., to compute various kinds of derived data, such as inverted indices, various representations of the graph structure of web documents, summaries of the number of pages crawled per host, the set of most frequent queries in a given day, etc....

April 1, 2023 · 8 min · Fenglyu