Transcription of Introduction to Parallel Programming with MPI and OpenMP
{{id}} {{{paragraph}}}
Introduction to Parallel Programming with MPI and OpenMPCharles AugustineOctober 29, 2018 Goals of Workshop Have basic understanding of Parallel Programming MPI OpenMP Run a few examples of C/C++ code on Princeton HPC systems. Be aware of some of the common problems and pitfalls Be knowledgeable enough to learn more (advanced topics) on your ownParallel Programming AnalogySource: No free lunch - can t just turn on Parallel Parallel Programming requires work Code modification always Algorithm modification often New sneaky bugs you bet Speedup limited by many factorsRealistic Expectations Ex. Your program takes 20 days to run 95% can be parallelized 5% cannot (serial) What is the fastest this code can run?
• Interpreted languages with multithreading • Python, R, matlab (have OpenMP & MPI underneath) • CUDA, OpenACC (GPUs) • Pthreads, Intel Cilk Plus (multithreading) • OpenCL, Chapel, Co -array Fortran, Unified Parallel C (UPC) CPU
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document:
{{id}} {{{paragraph}}}