www.it-ebooks.info www.it-ebooks.info Hadoop: The Definitive Guide Tom White www.it-ebooks.info For Eliane, Emilia, and Lottie www.it-ebooks.info www.it-ebooks.info Foreword Doug Cutting, April 2009 Shed in the Yard, California Hadoop got its start in Nutch. A few of us were attempting to build an open source web search engine and having trouble managing computations running on even a handful of computers. Once Google published its GFS and MapReduce papers, the route became clear. They’d devised systems to solve precisely the problems we were having with Nutch. So we started, two of us, half-time, to try to re-create these systems as a part of Nutch. We managed to get Nutch limping along on 20 machines, but it soon became clear that to handle the Web’s massive scale, we’d need to run it on thousands of machines, and moreover, that the job was bigger than two half-time developers could handle. Around that time, Yahoo! got interested, and quickly put together a team th
to/ we/ a / it/of /machines/’d / on/ th/kafka/ to/ we/ a / it/of /machines/’d / on/ th/kafka/
