## Parallel Programming in C with MPI and OpenMPThe era of practical parallel programming has arrived, marked by the popularity of the MPI and OpenMP software standards and the emergence of commodity clusters as the hardware platform of choice for an increasing number of organizations. This exciting new book, Parallel Programming in C with MPI and OpenMP addresses the needs of students and professionals who want to learn how to design, analyze, implement, and benchmark parallel programs in C using MPI and/or OpenMP. It introduces a rock-solid design methodology with coverage of the most important MPI functions and OpenMP directives. It also demonstrates, through a wide range of examples, how to develop parallel programs that will execute efficiently on today’s parallel platforms. |

### What people are saying - Write a review

We haven't found any reviews in the usual places.

### Contents

Motivation and History l | 1 |

Parallel Architectures | 27 |

7 | 58 |

Copyright | |

31 other sections not shown

### Common terms and phrases

agglomeration all-gather allocation Amdahl's Law appears in Figure assigned Benchmark block decomposition block-striped decomposition broadcast buffer cache called chapter column columnwise commodity cluster communication complexity containing dictionary distributed document dtype endfor equation example Floyd's algorithm Gaussian elimination graph Hence hypercube implementation initial input integers isoefficiency iteration lagged Fibonacci linear linear congruential loop malloc manager matrix multiplication matrix-vector multiplication memory message-passing method Monte Carlo Monte Carlo method MPI functions MPI_Comm comm MPI_COMM_WORLD MPI_Datatype MPI_Recv multicomputer multiplication algorithm multiprocessor needed number of elements number of processors OpenMP operations output parallel algorithm parallel computer parallel program parameter perform pivot pragma prime primitive tasks printf problem process grid processor array profile vectors quicksort random number rank receive represent result rowwise block-striped samples scalability sequence sequential algorithm Sieve Sieve of Eratosthenes single solution solve step task/channel threads tree variable void worker