High Performance Parallel I/O

Front Cover
Prabhat, Quincey Koziol
CRC Press, Oct 23, 2014 - Computers - 434 pages

Gain Critical Insight into the Parallel I/O Ecosystem

Parallel I/O is an integral component of modern high performance computing (HPC), especially in storing and processing very large datasets to facilitate scientific discovery. Revealing the state of the art in this field, High Performance Parallel I/O draws on insights from leading practitioners, researchers, software architects, developers, and scientists who shed light on the parallel I/O ecosystem.

The first part of the book explains how large-scale HPC facilities scope, configure, and operate systems, with an emphasis on choices of I/O hardware, middleware, and applications. The book then traverses up the I/O software stack. The second part covers the file system layer and the third part discusses middleware (such as MPIIO and PLFS) and user-facing libraries (such as Parallel-NetCDF, HDF5, ADIOS, and GLEAN).

Delving into real-world scientific applications that use the parallel I/O infrastructure, the fourth part presents case studies from particle-in-cell, stochastic, finite volume, and direct numerical simulations. The fifth part gives an overview of various profiling and benchmarking tools used by practitioners. The final part of the book addresses the implications of current trends in HPC on parallel I/O in the exascale world.


What people are saying - Write a review

User Review - Flag as inappropriate

I requested this book from my PhD advisor and he bought it for me.
This is the only book in my PhD that made me exciting. I studied this book for about 3 months. I found many new things in this
book to complement my existing knowledge database.
This book presents the large picture of parallel I/O in the high performance computing.
It starts with the problems, challenges and then discusses the traditional and state-of-art research efforts. You can not only use this book as a reference book for starting your research, but also as a collection of the most interesting ideas to motivate your future research.
I highly recommend this book to anyone who is doing research in parallel I/O, filesystem and storage.
-Jialin Liu

Other editions - View all

Common terms and phrases

About the author (2014)

Prabhat leads the NERSC Data and Analytics Services Group at Lawrence Berkeley National Laboratory. His main research interests include Big Data analytics, scientific data management, parallel I/O, HPC, and scientific visualization. He is also interested in atmospheric science and climate change.

Quincey Koziol is the director of core software development and HPC at The HDF Group, where he leads the HDF5 software project. His research interests include HPC, scientific data storage, and software engineering and management.

Bibliographic information