Hadoop: The Definitive Guide: The Definitive Guide

Front Cover
"O'Reilly Media, Inc.", May 29, 2009 - Computers - 528 pages
4 Reviews

Hadoop: The Definitive Guide helps you harness the power of your data. Ideal for processing large datasets, the Apache Hadoop framework is an open source implementation of the MapReduce algorithm on which Google built its empire. This comprehensive resource demonstrates how to use Hadoop to build reliable, scalable, distributed systems: programmers will find details for analyzing large datasets, and administrators will learn how to set up and run Hadoop clusters.

Complete with case studies that illustrate how Hadoop solves specific problems, this book helps you:

  • Use the Hadoop Distributed File System (HDFS) for storing large datasets, and run distributed computations over those datasets using MapReduce
  • Become familiar with Hadoop's data and I/O building blocks for compression, data integrity, serialization, and persistence
  • Discover common pitfalls and advanced features for writing real-world MapReduce programs
  • Design, build, and administer a dedicated Hadoop cluster, or run Hadoop in the cloud
  • Use Pig, a high-level query language for large-scale data processing
  • Take advantage of HBase, Hadoop's database for structured and semi-structured data
  • Learn ZooKeeper, a toolkit of coordination primitives for building distributed systems

If you have lots of data -- whether it's gigabytes or petabytes -- Hadoop is the perfect solution. Hadoop: The Definitive Guide is the most thorough book available on the subject.

"Now you have the opportunity to learn about Hadoop from a master-not only of the technology, but also of common sense and plain talk."-- Doug Cutting, Hadoop Founder, Yahoo!


What people are saying - Write a review

Standard book for hadoop

User Review  - Parag Awadhiya - Overstock.com

This book is written by one of the authors of hadoop. Most of the concepts are explained very well with indepth insights. Highly recommended for any who wants to learn hadoop. Read full review

LibraryThing Review

User Review  - gbsallery - LibraryThing

A comprehensive review of the Hadoop ecosystem, with plenty of hands-on advice. Some of the content for the various sub-projects (Sqoop, Hive etc) is somewhat repetitive and lacks depth, but these are ancillary to the book's core purpose of explaining what Hadoop is about, which it achieves. Read full review


Chapter 1 Meet Hadoop
Chapter 2 MapReduce
Chapter 3 The Hadoop Distributed Filesystem
Chapter 4 Hadoop IO
Chapter 5 Developing a MapReduce Application
Chapter 6 How MapReduce Works
Chapter 7 MapReduce Types and Formats
Chapter 8 MapReduce Features
Chapter 11 Pig
Chapter 12 HBase
Chapter 13 ZooKeeper
Chapter 14 Case Studies
Appendix A Installing Apache Hadoop
Appendix B Clouderas Distribution for Hadoop
Appendix C Preparing the NCDC Weather Data

Chapter 9 Setting Up a Hadoop Cluster
Chapter 10 Administering Hadoop

Other editions - View all

Common terms and phrases

Bibliographic information