Parallel and Distributed Computing: A Survey of Models, Paradigms and Approaches
An all-inclusive survey of the fundamentals of parallel and distributed computing. The use of parallel and distributed computing has increased dramatically over the past few years, giving rise to a variety of projects, implementations, and buzzwords surrounding the subject. Although the areas of parallel and distributed computing have traditionally evolved separately, these models have overlapping goals and characteristics. Parallel and Distributed Computing surveys the models and paradigms in this converging area of parallel and distributed computing and considers the diverse approaches within a common text. Covering a comprehensive set of models and paradigms, the material also skims lightly over more specific details and serves as both an introduction and a survey. Novice readers will be able to quickly grasp a balanced overview with the review of central concepts, problems, and ideas, while the more experienced researcher will appreciate the specific comparisons between models, the coherency of the parallel and distributed computing field, and the discussion of less well-known proposals. Other topics covered include:
* Data parallelism
* Shared-memory programming
* Message passing
* Client/server computing
* Code mobility
* Coordination, object-oriented, high-level, and abstract models
* And much more
Parallel and Distributed Computing is a perfect tool for students and can be used as a foundation for parallel and distributed computing courses. Application developers will find this book helpful to get an overview before choosing a particular programming style to study in depth, and researchers and programmers will appreciate the wealth of information concerning the various areas of parallel and distributed computing.
25 pages matching parallel programming in this book
Results 1-3 of 25
What people are saying - Write a review
We haven't found any reviews in the usual places.
10 other sections not shown
abstract models actor actor model algorithm design applications approach architectures cache called Cilk client/server computing clusters code mobility code on demand collective operations communication compiler concept constructs coordination models CORBA costs data distribution data parallelism deployed described distributed computing distributed systems distributed-memory dynamic evaluation example execution exploit Fortran functional programming grid hardware hierarchy implementation instance interface languages latency libraries loop machine mechanism memory message passing middleware migration mobile agents modules multiple multithreading Myrinet network models nodes object-oriented OpenMP operating system paradigm parallel and distributed parallel computing parallel programming parallel region parameters particular performance portability PRAM processes processors programming models protocols remote request scheduling scheme Sect sender sequential shared shared-memory model shared-memory programming SIMD skeleton models SMPs sockets specific SPMD superstep synchronization task parallelism technologies thread models tion transparency tuple space tuple-based typically variables whereas