High Performance Computing Systems (CMSC714)

Lecture Slides

Lecture Date Topic Slides Paper 1 Assignments Paper 2 Assignments Additional Reading
1 January 26 Introduction to Parallel Computing
2 January 28 Terminology
3 February 2 Message Passing and MPI Dongarra 1996 Thakur 2007
4 February 4 Advanced MPI Thakur 2005 Saif 2004
5 February 9 OpenMP` Dagum 1998 de Supinski 2018
6 February 11 Profiling Programs Graham 1982 BB;  PN, AP Adhianto 2010 OC;  JS, SS Tallent 2009
7 February 16 Charm++ Kale et al. AK;  XW, JX Kale et al. GL;  RX, YX
February 18 Messaging Libraries (Snow Day!) Kumar 2012 Shamis 2015
8 February 23 Perf. Analysis and Visualization Kale 2004 ML;  MZ, LM Bhatele 2019 XM;  BM, DN
9 February 25 Node Architectures and GPUs Haring 2012 LM;  BB, OC Lee 2010 BM;  AK, GL
10 March 2 Shared Memory Architectures Woodacre et al. DN;  ML, XM Nieplocha 2006 AP;  JS, SS
11 March 4 Torus machines Chen 2011 PN;  XW, JX Alverson 2010 JS;  RX, YX
12 March 9 Fat-tree and dragonfly Leiserson 1985 SS;  MZ, LM Kim 2008 XW;  BM, DN
13 March 11 Isoefficiency and Perf. Modeling Culler 1996 JX;  BB, OC Grama 1993 RX;  AK, GL
March 16
Spring Break
March 18
Spring Break
14 March 23 Auto-tuning Balaprakash 2018 YX;  ML, XM Kamil 2010 MZ;  PN, AP
15 March 25 Parallel Sorting Blelloch 1991 BB;  PN, AP Satish 2009 OC;  JS, SS
16 March 30 Parallel Matrix Multiply Gupta 1993 AK;  XW, JX Agarwal 1995 GL;  RX, YX Demmel 1996
17 April 1 OS Noise and Interference Petrini 2003 ML;  MZ, LM Bhatele 2013 XM;  BM, DN
18 April 6 Job Scheduling Henderson 1995 LM;  BB, OC Zhang 2000 BM;  AK, GL
19 April 8 Topology Aware Mapping Bhanot 2005 DN;  ML, XM Bhatele 2011 AP;  JS, SS
20 April 13 Parallel I/O Carns 2000 PN;  XW, JX Bhimji 2016 JS;  RX, YX
21 April 15 Molecular Dynamics Phillips 2002 SS;  MZ, LM Shaw 2009 XW;  BM, DN
April 20
Mid-term (during class)
22 April 22 The n-body Problem Warren 1993 JX;  BB, OC Hamada 2009 RX;  AK, GL
23 April 27 Parallel Discrete-event Simulations Acun 2015 YX;  ML, XM Yeom 2014 MZ;  PN, AP
24 April 29 Machine Learning and HPC Bhatele 2020 AP;  MZ Li 2020 LM;  XW
May 4
Work on Group Projects
May 6
Project Demos (Groups 1, 3, 7)
May 11
Project Demos (Groups 2, 4, 5, 6)
Web Accessibility