BBM 442: Parallel Processing - Fall 2017

Instructor: Dr. Adnan Ozsoy

Email: adnan.ozsoy@hacettepe.edu.tr

Office: 114
Course Schedule: Friday, 13.30-16:15 
Class: D9

 

Course Description

Introduction to parallelism and parallel programming, network topologies for parallel computers, GPUs, parallel computer architecture (SIMD, Shared Memory MIMD and Distributed Memory MIMD), synchronization mechanisms, parallel programming models, analysis and design of parallel algorithms, development of parallel algorithms for different architectures, performance and complexity of parallel algorithms. Case studies: Selected parallel algorithms. 

 

Reference Books

An Introduction to Parallel Programming, 1st Edition by Peter Pacheco

Introduction to Parallel Computing (2nd Edition), by Ananth GramaGeorge KarypisVipin KumarAnshul Gupta 

Programming Massively Parallel Processors: A Hands-on Approach”, David B. Kirk and Wen-mei W. Hwu  Morgan Kaufman, ISBN-10: 0123814723, ISBN-13: 978-0123814722.

“CUDA by Example: An Introduction to General-Purpose GPU Programming”, H. Bidgoli, Addison Wesley, ISBN-10: 0131387685, ISBN-13: 978-0131387683.

Introduction to Parallel Computing, Blaise Barney, Lawrence Livermore National Laboratory -  https://computing.llnl.gov/tutorials/parallel_comp/

Grading

Midterm - (%30)
Final - (%40)
Projects – (%30)

 

Announcements

http://piazza.com/hacettepe.edu.tr/fall2017/bbm442

 

Week

1

Sep-29

Introduction to Parallel Programming

2

Oct-06

Parallel Programming Architectures and Software

3

Oct-13

Shared Memory Systems (OpenMP)

4

Oct-20

Shared Memory Systems (OpenMP)

5

Oct-27

Shared Memory Systems (Pthreads)

6

Nov-03

Shared Memory Systems (Pthreads)

7

Nov-10

Distributed Memory Systems (MPI)

8

Nov-17

Distributed Memory Systems (MPI)

9

Nov-24

MIDTERM

10

Dec-01

GPGPU (CUDA)

11

Dec-08

GPGPU (CUDA)

12

Dec-15

Advanced Topics

13

Dec-22

Advanced Topics

14

Dec-29

Advanced Topics

 

Course material:

Slides mainly from the first reference book: http://booksite.elsevier.com/9780123742605/