Parallel and Distributed Computing Overview Professors Johnnie Baker

Parallel and Distributed Computing Overview Professors Johnnie Baker and Robert Walker

Instructors • Professor Johnnie W. Baker – Primary Lecturer • Professor Robert Walker – Particularly Architecture Lectures • Guest Lecturers from Parallel Processing Group – Lecture in areas of expertise – Occasionally cover classes when I am away

Textbook and References • Textbook – – Parallel Programming in C with MPI and Open. MP Michael Quinn, author Published by Mc. Graw Hill in 2004 Used in both PDC and PDA • References for Supplementary Reading – Other textbooks and reference books – Conference and journal papers – Assigned reading will either be handed out or posted on course website

Two Complementary Courses • Parallel & Distributed Computing (Fall) – – Architectures Languages Parallel Programming Algorithm Examples for some architectures • Parallel & Distributed Algorithms (Spring) – Important Models of Computation – Designing Efficient Algorithms for Various Models • PDC and PDA can be taken in either order – Preference is for PDC to be taken first

Specific Topics • Fundamental concepts in parallel computation. • Synchronous Computation – – – SIMD, Vector, Pipeline Computing Associative and Multi-Associative Computing ASC Language and Programming Multi. C Language and Programming Fortran 90 and HPF Languages • Asynchronous (MIMD) Shared Memory Computation – Open. MP language – Symmetric Multiprocessors or SMPs • Asynchronous (MIMD) Distributed Memory Computation – Communications – MPI Language and Programming • Architectures – Interconnection Networks (synchronous and asynchronous) – Specific Computer Examples for above computation paradigms • MIMD-SIMD Comparisons in Real-Time Applications

Assignments and Grading • Homework assignments – Problems assigned for most chapters – Probably 5 -7 different assignments – Some assignments will involve programming • Course Grade – Based on homework, midterm, and final – Approximate weights (assuming grader) • Homework 40% • Midterm Exam 30% • Final Exam 30%