In designing programs one may find that he needs to solve problems that are memory intensive, or simply that one needs to solve problems with greater speed than is possible on a serial computer. In these cases one can turn to parallel programming and parallel computers to satisfy these needs. One of the basic methods of programming for parallel computing is the use of message passing libraries. These libraries manage transfer of data between instances of a parallel program running on multiple processors in a parallel computer architecture. The main features will be presented along with examples of code on how to use them.
Parallel Computing, Messagge Passing Interface, MPI
A. Grama, A. Gupta, G. Karyps, V. Kumar. (2003)
Introduction to Parallel Computing. Pearson / Addison Wesley, Harlow, UK. Second edition. ISBN 0-201-64865-2.