Parallel and Distributed Computing Overview and Syllabus Professor

Parallel and Distributed Computing Overview and Syllabus Professor Johnnie Baker Guest Lecturer: Robert Walker

Instructors • Professor Johnnie W. Baker – Primary Lecturer • Professor Robert Walker – Guest lectures on specific architectures – Guest lecture on his groups VLSI work on parallel architectures • Possible guest lecturers from parallel processing group – Possible lecture in area of expertise – Also, may cover class, if I have to be absent.

Prerequisites • Designed to be accessible to all graduate students in computer science • Students who are not CS graduate students may also be qualified to take course

Textbook and References • Textbook – Parallel Programming in C with MPI and Open. MP – Michael Quinn, author – Published by Mc. Graw Hill in 2004 • References for Supplementary Reading – Classroom Slides will also include additional information from a wide range of sources – Any additional required reference material will be handed out or posted on course website

Some Features of Course • Includes coverage of fundamental concepts of parallel computation, rather than focusing only on latest trends. – Often quickly outdated due to rapid technological changes • Also covers the currently popular cluster architectures, shared memory processors, and the MP language. – This is the focus of the Quinn Textbook

Course Features (cont. ) • Covers the common techniques for parallel computation by looking at three key features for each technique: – Typical architectural features – Typical programming languages used – Typical algorithm design techniques used.

Some Specific Topics • Fundamental concepts applicable to all parallel computation. • Asynchronous (MIMD) distributed memory computation – Message passing communications – Programming using the MPI Language – Architectural features – Examples of typical algorithms

Specific Topics (cont. ) • Asynchronous (MIMD) shared memory computation – Symmetric Multiprocessors or SMPs – Perhaps brief Open. MP language overview • Synchronous Computation – SIMD, vector, pipeline computing – Associative and Multi-Associative Computing – Introduction to associative programming using ASC language – Programming on Clear. Speed system with Cn – Algorithm examples

Specific Topics (cont. ) • Interconnection Networks – Specific computer networks including 2 D mesh, hypercube, etc. – Synchronous and asynchronous network considerations • Comparing MIMD & SIMD Computation using a Real-Time Application – ATC (Air Traffic Control)

Some Benefits of Course • While the focus is on parallel computation, most information is applicable to distributed computing. • There is a wide choice of thesis and dissertation topics in this area • Several professors in department work in this area or make major use of parallel computation in their research • Students working on a thesis or dissertation in another area may benefit from being able to use parallel computation in their work.

Benefits (cont. ) • Most large computational problems require a parallel or distributed system to satisfy the speed and memory requirements • Parallel computation currently has major advantages over both distributed computation and grid computation for computational intensive problems. – Programs are normally much simpler – Architectures are much cheaper – Efficient use of Grid computing as a “massive compute engine” is fairly futuristic.

Two Complementary Courses • Parallel & Distributed Computing (present course) – – Architectures Languages Parallel Programming Algorithm Examples for some architectures • Parallel & Distributed Algorithms (Probably next Fall) – Important Parallel Models – Designing Efficient Algorithms for Various Models – Expect to be next offered in Spring 2009 • PDC and PDA can be taken in either order – My preference is for PDC to be taken first

“Parallel Real-Time Systems” Course • Will be offered this Spring as an online course • Co-taught with Professor Drew at Ohio University • Plan to have projects on implementing part of a basic ATC system on a Clear. Speed parallel computer. • The PDC class should provide useful background information for this course.

Assignments and Grading • Homework assignments – Problems assigned for most chapters – Probably 4 -6 different assignments – Some assignments will involve programming • Course Grade – Based on homework, midterm, and final – Approximate weights • Homework 40% • Midterm Exam 30% • Final Exam 30%

Course Website • Website will be established quickly at http: //www. cs. kent. edu/~jbaker/PDC-F 08/ • Previous course site is available for reference this semester at http: //www. cs. kent. edu/~jbaker/PDC-F 07/ • Class slides, assignments, and many references will be posted on this website. – Previous lecture slides from PDC-F 07 may be useful. Slide sets will be revised, but usually not extensively. • Also, an online reference textbook (by Akl) and a pointer to a second online reference textbook (by Foster) will be available at this site. – Currently available at PDC-F 07 site – Akl’s book must be kept password protected. (Ask me for password, if wish to access electronic version. )

Current Assignment • Read Chapter 1 in textbook in advance of my coverage of it.

Accessibility Statement University Policy 3342 -3 -01. 3 requires that students with disabilities be provided reasonable accommodations to ensure their equal access to course content. If you have a documented disability and require accommodations, please contact the instructor at the beginning of the semester to make arrangements for necessary classroom adjustments. Please note, you must first verify your eligibility for these through Student Accessibility Services (contact 330672 -3391 or visit www. kent. edu/sas for more information on registration procedures).

A&S Cheating & Plagiarism Statement • The College of Arts & Sciences “Cheating & Plagiarism” policy applies to this class. A statement of this policy is available at http: //www. kent. edu/policyreg/chap 3/3 -01 -8. cfm • A PDF version formatted for printing is at the site http: //www. kent. edu/policyreg/chap 3/upload/334 2. 3. 01. 8. pdf • A link to this statement will be posted on the website for this course.

Registration Requirement • The official registration deadline for this course is September 7, 2008. University policy requires all students to be officially registered in each class they are attending. Students who are not officially registered for a course by published deadlines should not be attending classes and will not receive credit or a grade for the course. Each student must confirm enrollment by checking his/her class schedule (using Student Tools in Flash. Fast) prior to the deadline indicated. Registration errors must be corrected prior to the deadline.

Slides will be Posted This set of slides will be posted at http: //www. cs. kent. edu/~jbaker/PDC-F 08/