Parallel and Distributed Computation (CS621, Spring 2016)
Please note that you must have an M.S. degree in CS or have
taken two 500 level CS courses at the
University of Kentucky before you can register for this course.
Semester: Spring, 2016.
Class: 11:00 - 11:50am, MWF.
Classroom: FPAT 253.
Instructor: Jun Zhang, E-mail:email@example.com, Tel:257-3892.
Office: 321 Marksbury Building.
Office Hours: MW: 9:00am - 10:00am, and by appointment.
Reference Text Books:
Introduction to Parallel Computing: Design and Analysis of Algorithms
by Vipin Kuman, Ananth Grama, Anshul Gupta, and George Karypis,
2nd Ed., 2003.
(required, BOOK 1)
Using MPI: Portable Parallel Programming with the Message-Passing Interface
by William Gropp, Ewing Lusk, and Anthony Skjellum, 2nd Ed., 1999. (BOOK 2)
CS621 syllabus.pdf, for Spring 2016;
(subject to change)
Some rules rule.pdf, you should know
before taking this course.
An MPI Tutorial, describing simple
Here is another online tutorial on Message Passing Interface (MPI);
Here is how to install a copy of MPI library for your PC machines:
Using MPI at Home.
This is the official MPI webpage with
Beginner's Guide for UK IBM Systems, a manual to explain how to use the supercomputers at the University of Kentucky.
Class Slides (Fall 2012)
Important Changes from previous teaching: We will no longer use the
supercomputers at the UK Computing Center for the assignments. Students must
have their own machines (PC or whatever machines) to run a version of MPI
to simulate parallel and distributed computations.
Assignments (Spring 2016)
First assignment: Read through Chapter 1 of both BOOK 1 and BOOK 2.
Project 1, assigned on 2/3, due on 2/17, 2016.
Homework 1, assigned on 2/19, due 2/26, 2016.
Homework 2, assigned on 2/29, due 3/7, 2016
Project 2, and Prefix Sum Algorithm,
assigned on 3/21, due on 4/4, 2016.
Project 3, assigned on 4/6,
due on 4/20, 2016;
The 2001 Midterm Exam Problems,
ps file, and
The 1999 Midterm Exam Problems,
ps file, and
pdf file, and
These past exams are
only provided for reference purpose. There is no guarantee that
this year's midterm exam will be similar to those ones;
For some information on building PC and workstation clusters, please see
The following is the course materials that I used in previous
year's teaching. It may give you an idea of what will be
covered in the this course. However, there is NO GUARANTEE
that this year's course content and requirements will be
exactly the same as that offered in 1998.
Parallel Computer: The supercomputer that will be used in this
class for practicing parallel programming is the HP Superdome
at the University of Kentucky
High Performance Computing Center.
Message Passing Interface: We plan to use the emerging standard
Message Passing Interface (MPI) on
the Power Challenge. Although this is not a very efficient way to
do parallel computing on Power Challenge, our goal is to learn
programming skill with MPI. Here is the official
Here is a description of the course.
I am working on a postscript file of the course description. It is called
syllabus.ps. You should also read the
general policies on homework and grading,
here is the downloadable rule.ps.
- Set up your HP Supercomputer Account.
If you decided to take this course, please e-mail
me with information on your name
and student ID number.
To know how to run MPI on the the HP supercomputer, see
You need to download Project0.tar.
These are sample makefile and C and Fortran codes.
Supercomputing Technology News
IEEE Computer Society's
ParaScope, a list of parallel computing sites.
On February, 1998, IBM announced the world's first
1000 MHZ chip, three times faster than
Intel's fastest chip. Don't worry about that, your parallel computers
could be even faster.
In May, 1998, Los Alamos built a mail-order
supercomputer and it is among the word's fastest. Take a look at
the new supercomputer, named
The TOP500 List of Supercomputer Sites .
MPI Software Technology, Inc.: a commercial MPI software company.
Beowulf Project at CESDIS.
Take a look at the
Earth Simulator in Japan, the fastest supercomputer on Earth.
Here is a list of parallel scientific computing courses offered at several
On-line study materials on parallel computing:
Last modified on Monday, January 12, 2016.