This document provides an overview of parallel programming using MPI (Message Passing Interface). It discusses key MPI concepts like communicators, messages, and documentation resources. It also presents two simple examples - a "Hello World" program to have each processor print a message and a basic send and receive program to demonstrate communication between processors. The overview aims to introduce programmers to the basic MPI calls for initialization, determining processor properties, and synchronous send and receive operations.
This document provides an overview of parallel programming using MPI (Message Passing Interface). It discusses key MPI concepts like communicators, messages, and documentation resources. It also presents two simple examples - a "Hello World" program to have each processor print a message and a basic send and receive program to demonstrate communication between processors. The overview aims to introduce programmers to the basic MPI calls for initialization, determining processor properties, and synchronous send and receive operations.
This document provides an overview of parallel programming using MPI (Message Passing Interface). It discusses key MPI concepts like communicators, messages, and documentation resources. It also presents two simple examples - a "Hello World" program to have each processor print a message and a basic send and receive program to demonstrate communication between processors. The overview aims to introduce programmers to the basic MPI calls for initialization, determining processor properties, and synchronous send and receive operations.
This document provides an overview of parallel programming using MPI (Message Passing Interface). It discusses key MPI concepts like communicators, messages, and documentation resources. It also presents two simple examples - a "Hello World" program to have each processor print a message and a basic send and receive program to demonstrate communication between processors. The overview aims to introduce programmers to the basic MPI calls for initialization, determining processor properties, and synchronous send and receive operations.
Download as PPT, PDF, TXT or read online from Scribd
Download as ppt, pdf, or txt
You are on page 1/ 19
Parallel Programming
Using Basic MPI
Presented by Timothy H. Kaiser, Ph.D. San Diego Supercomputer Center
Talk Overview
Background on MPI Documentation Hello world in MPI Basic communications Simple send and receive program
Background on MPI MPI - Message Passing Interface Library standard defined by a committee of vendors, implementers, and parallel programmers Used to create parallel programs based on message passing 100% portable: one standard, many implementations Available on almost all parallel machines in C and Fortran Over 100 advanced routines but 6 basic 3
Documentation MPI home page (contains the library
standard): www.mcs.anl.gov/mpi
Books
"MPI: The Complete Reference" by Snir, Otto,
Huss-Lederman, Walker, and Dongarra, MIT Press (also in Postscript and html) "Using MPI" by Gropp, Lusk and Skjellum, MIT Press
Tutorials many online, just do a search
MPI Implementations Most parallel supercomputer vendors provide optimized implementations Others: www.lam-mpi.org www-unix.mcs.anl.gov/mpi/mpich GLOBUS: www.globus.org/mpi/
Key Concepts of MPI
Used to create parallel programs based on message passing Normally the same program is running on several different processors Processors communicate using message passing Typical methodology: startjobonnprocessors doi=1toj eachprocessordoessomecalculation passmessagesbetweenprocessor enddo endjob 6
Messages Simplest message: an array of data of one type. Predefined types correspond to commonly used types in a given language MPI_REAL (Fortran), MPI_FLOAT (C) MPI_DOUBLE_PRECISION (Fortran), MPI_DOUBLE (C) MPI_INTEGER (Fortran), MPI_INT (C)
User can define more complex types and
send packages. 7
Communicators Communicator A collection of processors working on some part of a parallel job Used as a parameter for most MPI calls MPI_COMM_WORLD includes all of the processors in your job Processors within a communicator are assigned numbers (ranks) 0 to n-1 Can create subsets of MPI_COMM_WORLD
Include files The MPI include file C: mpi.h Fortran: mpif.h (a f90 module is a good place for this) Defines many constants used within MPI programs In C defines the interfaces for the functions Compilers know where to find the include files
Write a parallel hello world program Initialize MPI Have each processor print out Hello, World and its processor number (rank) Quit MPI
12
Basic Communication Data values are transferred from one processor to another One processor sends the data Another receives the data Synchronous Call does not return until the message is sent or received Asynchronous Call indicates a start of send or receive, and another call is made to determine if finished
13
Synchronous Send C MPI_Send(&buffer,count,datatype,destination, tag,communicator);
Write a parallel program to send & receive data Initialize MPI Have processor 0 send an integer to processor 1 Have processor 1 receive an integer from processor 0 Both processors print the data Quit MPI
18
Summary
MPI is used to create parallel programs based on
message passing Usually the same program is run on multiple processors The 6 basic calls in MPI are:
