Big Data Bibliography
Recording data and later analyzing it isn't just for the entrepreneurial spirit, since it does result in some amazing discoveries. In business and government, organizations leveraging data-based decisions are more successful than those relying on decades of trial-and-error. To make these data based decisions, the data needs to be collected, processed and distilled in a manner humans can understand. It is the IT department that is responsible for connecting these data pipes and separating the signal from the noise. Those involved in data wrangling would have easier jobs if the processing power of a single machine could keep up with the size of the data they needed to process. The fact is it hasn't, and over the past decade a new field of big data has emerged. This big data field is focused on reliably processing massive amounts of data. Processing large amounts of data has been done in the past, but what is new this time around is that it's being done on commodity hardware and open-source software tools.