Transcription of Introduction to Parallel Programming with MPI and OpenMP
{{id}} {{{paragraph}}}
Introduction to Parallel Programming with MPI and OpenMPCharles AugustineOctober 29, 2018 Goals of Workshop Have basic understanding of Parallel Programming MPI OpenMP Run a few examples of C/C++ code on Princeton HPC systems. Be aware of some of the common problems and pitfalls Be knowledgeable enough to learn more (advanced topics) on your ownParallel Programming AnalogySource: No free lunch - can t just turn on Parallel Parallel Programming requires work Code modification always Algorithm modification often New sneaky bugs you bet Speedup limited by many factorsRealistic Expectations Ex. Your program takes 20 days to run 95% can be parallelized 5% cannot (serial) What is the fastest this code can run? As many CPU s as you want!
1 day! Amdahl’s Law • As you consider parallel programming understanding the ... • MPI_COMM_WORLD is set during Init(…) • Other communicators can be created if needed ... • 100 x 14 x 48 = 672,000 core -hours • Situation 2: 3,000 …
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document:
{{id}} {{{paragraph}}}