INTRODUCTION TO PARALLEL COMPUTING

← Back to document page

INTRODUCTION TO PARALLEL COMPUTING Plamen Krastev Office: 38 Oxford, Room 117 Email: FAS Research COMPUTING Harvard University To introduce you to the basic concepts and ideas in PARALLEL COMPUTING To familiarize you with the major programming models in PARALLEL COMPUTING To provide you with with guidance for designing efficient PARALLEL programs OBJECTIVES: 2 OUTLINE: INTRODUCTION to PARALLEL COMPUTING / High Performance COMPUTING (HPC) Concepts and terminology PARALLEL programming models Parallelizing your programs PARALLEL examples 3 What is High Performance COMPUTING ? Pravetz 82 and 8M, Bulgarian Apple clones Image credit: flickr 4 What is High Performance COMPUTING ? 4 Pravetz 82 and 8M, Bulgarian Apple clones Image credit: flickr What is High Performance COMPUTING ? Odyssey supercomputer is the major computational resource of FAS RC: 2,140 nodes / 60,000 cores 14 petabytes of storage 5 What is High Performance COMPUTING ?

(Graphics Processing Unit) programming GPUs perform computationally intensive kernels using local, on-node data Communications between processes on different nodes occurs over the network using MPI 21

  Computing, Introduction, Unit, Processing, Parallel, Graphics, Introduction to parallel computing, Graphics processing unit