Hadoop: The Definitive Guide: The Definitive Guide

Front Cover
"O'Reilly Media, Inc.", May 29, 2009 - Computers - 528 pages
4 Reviews

Hadoop: The Definitive Guide helps you harness the power of your data. Ideal for processing large datasets, the Apache Hadoop framework is an open source implementation of the MapReduce algorithm on which Google built its empire. This comprehensive resource demonstrates how to use Hadoop to build reliable, scalable, distributed systems: programmers will find details for analyzing large datasets, and administrators will learn how to set up and run Hadoop clusters.

Complete with case studies that illustrate how Hadoop solves specific problems, this book helps you:

  • Use the Hadoop Distributed File System (HDFS) for storing large datasets, and run distributed computations over those datasets using MapReduce
  • Become familiar with Hadoop's data and I/O building blocks for compression, data integrity, serialization, and persistence
  • Discover common pitfalls and advanced features for writing real-world MapReduce programs
  • Design, build, and administer a dedicated Hadoop cluster, or run Hadoop in the cloud
  • Use Pig, a high-level query language for large-scale data processing
  • Take advantage of HBase, Hadoop's database for structured and semi-structured data
  • Learn ZooKeeper, a toolkit of coordination primitives for building distributed systems

If you have lots of data -- whether it's gigabytes or petabytes -- Hadoop is the perfect solution. Hadoop: The Definitive Guide is the most thorough book available on the subject.

"Now you have the opportunity to learn about Hadoop from a master-not only of the technology, but also of common sense and plain talk."-- Doug Cutting, Hadoop Founder, Yahoo!

 

What people are saying - Write a review

Standard book for hadoop

User Review  - Parag Awadhiya - Overstock.com

This book is written by one of the authors of hadoop. Most of the concepts are explained very well with indepth insights. Highly recommended for any who wants to learn hadoop. Read full review

LibraryThing Review

User Review  - gbsallery - LibraryThing

A comprehensive review of the Hadoop ecosystem, with plenty of hands-on advice. Some of the content for the various sub-projects (Sqoop, Hive etc) is somewhat repetitive and lacks depth, but these are ancillary to the book's core purpose of explaining what Hadoop is about, which it achieves. Read full review

Contents

Chapter 1 Meet Hadoop
1
Chapter 2 MapReduce
15
Chapter 3 The Hadoop Distributed Filesystem
41
Chapter 4 Hadoop IO
75
Chapter 5 Developing a MapReduce Application
115
Chapter 6 How MapReduce Works
153
Chapter 7 MapReduce Types and Formats
175
Chapter 8 MapReduce Features
211
Chapter 11 Pig
301
Chapter 12 HBase
343
Chapter 13 ZooKeeper
369
Chapter 14 Case Studies
405
Appendix A Installing Apache Hadoop
465
Appendix B Clouderas Distribution for Hadoop
471
Appendix C Preparing the NCDC Weather Data
475
Index
479

Chapter 9 Setting Up a Hadoop Cluster
245
Chapter 10 Administering Hadoop
273

Other editions - View all

Common terms and phrases

Bibliographic information