Parallel and Distributed Computation (CS621, Spring 2016)

Please note that you must have an M.S. degree in CS or have taken two 500 level CS courses at the University of Kentucky before you can register for this course.

Semester: Spring, 2016.
Class: 11:00 - 11:50am, MWF.
Classroom: FPAT 253.

Instructor: Jun Zhang,, Tel:257-3892.
Office: 321 Marksbury Building.
Office Hours: MW: 9:00am - 10:00am, and by appointment.

Reference Text Books:
Introduction to Parallel Computing: Design and Analysis of Algorithms
by Vipin Kuman, Ananth Grama, Anshul Gupta, and George Karypis, 2nd Ed., 2003. (required, BOOK 1)

Using MPI: Portable Parallel Programming with the Message-Passing Interface
by William Gropp, Ewing Lusk, and Anthony Skjellum, 2nd Ed., 1999. (BOOK 2)

CS621 syllabus.pdf, for Spring 2016; (subject to change)

Some rules rule.pdf, you should know before taking this course.

Here is An MPI Tutorial, describing simple MPI routines

Here is another online tutorial on Message Passing Interface (MPI);

Here is how to install a copy of MPI library for your PC machines: Using MPI at Home.

This is the official MPI webpage with MPICH2.

Beginner's Guide for UK IBM Systems, a manual to explain how to use the supercomputers at the University of Kentucky.

Class Slides (Fall 2012)

Important Changes from previous teaching: We will no longer use the supercomputers at the UK Computing Center for the assignments. Students must have their own machines (PC or whatever machines) to run a version of MPI to simulate parallel and distributed computations.
Assignments (Spring 2016)

For some information on building PC and workstation clusters, please see Microway, Inc.

The following is the course materials that I used in previous year's teaching. It may give you an idea of what will be covered in the this course. However, there is NO GUARANTEE that this year's course content and requirements will be exactly the same as that offered in 1998.
Parallel Computer: The supercomputer that will be used in this class for practicing parallel programming is the HP Superdome at the University of Kentucky High Performance Computing Center.

Message Passing Interface: We plan to use the emerging standard Message Passing Interface (MPI) on the Power Challenge. Although this is not a very efficient way to do parallel computing on Power Challenge, our goal is to learn programming skill with MPI. Here is the official MPI site.

Here is a description of the course. I am working on a postscript file of the course description. It is called You should also read the general policies on homework and grading, here is the downloadable


Homework Projects


Supercomputing Technology News

Here is a list of parallel scientific computing courses offered at several universities:

On-line study materials on parallel computing:

Last modified on Monday, January 12, 2016.