Mastering HPCC Systems: Fundamentals of ETL Processing

Front Cover
Richard Taylor, Jan 16, 2024 - Computers - 164 pages

HPCC Systems is an Open Source Big Data supercomputing platform that is an alternative to the Hadoop and Spark worlds. The Mastering HPCC Systems series introduces the HPCC Systems platform to anyone interested in evaluating it for use on their own big data projects. It also expands the ECL programming knowledge of anyone already working with the platform.

This Fundamentals of ETL Processing volume provides an introduction to the ECL language through hands-on working through the standard data ingest process common to all Big Data projects. It starts with acquiring data and importing it into the HPCC Systems platform. It then takes you through data exploration, cleaning, and standardization processes. It ends by using that transformed data to create a data product ready for delivery to end-users.

 

Selected pages

Contents

Common terms and phrases

Click contain create crosstab CSV file Data Hygiene Data Profiling data types DataPatterns DATASET declaration decimal DECIMAL5_2 default define definition disk doid doLocationID ECL code ECL IDE ECL Watch EXPORT Layout fare_amount field fieldtype File_Yellow filename folder format FUNCTIONMACRO GrpCnt hands-on portion HPCC Systems INDEX IndexFilename input INTEGER IsNumeric iteration Landing Zone Logical File Details MAX(ds metadata MODULE EXPORT MODULE structure nested child dataset NoDay node NoHour number of seconds operation OutRec outstr OVERWRITE parameter passenger_count PatCnt payment_type portion we’ve learned ProdData produce PROJECT ProjRec ProjXF puDOW puHour puid REAL4 record set RECORD STRING RECORD structure result records RetDS RETURN ROXIE query single spray Standard Library functions Std.Date.Time_t STRING10 SuperFile symbol Systems platform TaxiDataSvc Template Language Thor Time_t tolls_amount tpep_pickup_datetime TRANSFORM function trip trip_distance TripTime TxtMaxLen UNSIGNED UNSIGNED1 UNSIGNED2 pulocationid ValTbl valuecount valuerange values vendorid workflow service workunit

About the author (2024)

Richard Taylor has spent his corporate years writing, editing, and publishing books on computer programming languages, covering the range from PC application development to big data, massively parallel processing supercomputers.

Bibliographic information

TitleMastering HPCC Systems: Fundamentals of ETL Processing
AuthorRichard Taylor
PublisherRichard Taylor, 2024
Length164 pages
Subjects ›  › 

Computers / Programming / General
Computers / Programming / Open Source
Computers / Programming / Parallel
  
Export CitationBiBTeX EndNote RefMan