 |
CMSC 5743 Efficient Computing of Deep Neural Networks – Fall 2023
| Lecture: | Monday 18:30-21:15 | YIA 405 |
| Zoom: https://cuhk.zoom.us/j/99819033248 | ||
| Instructor: | Prof. Bei Yu | byu@cse.cuhk.edu.hk |
| Course Tutors: | Xinyun Zhang | xyzhang21@cse.cuhk.edu.hk |
Announcements
Course Requirements
Homework (30%), Lab (40%), quiz (30%), and extra bonus.
Please submit your lab reports and homework through blackboard (link).
Schedule
| Date | Topic | Lab/Quiz | Homework | Note |
| Sep. 04 | Introduction (slides) | Lab0 warm-up (slides) | ||
| Sep. 11 | Im1 GEMM (slides) | — | Zoom | |
| Sep. 18 | — | — | Lecturer in travel | |
| Sep. 25 | Mo1 Pruning (slides) | Lab1 GEMM | HW 1 | |
| Oct. 02 | — | — | National Day | |
| Oct. 09 | Im2 Direct Conv (slides) | — | ||
| Oct. 16 | Im3 Winograd (slides) | Lab2 Winograd | ||
| Oct. 23 | — | — | Chung Yeung Festival | |
| Oct. 30 | Mo2 Decomposition (slides) | — | HW 2 | Zoom |
| Nov. 06 | Mo3 Quantization (slides) | Quiz-1 | ||
| Nov. 13 | Mo4 BNN (slides) | — | ||
| Nov. 20 | Im4 Sparse Conv (slides) | Lab3 Sparse | HW 3 | |
| Nov. 27 | Mo5 KD (slides) | Quiz-2 | ||
| Dec. 04 | Im5 CUDA (slides) | Lab4 CUDA | at YIA 505 |
References
All papers mentioned in lecture slides.
Sze, Vivienne, et al., “Efficient processing of deep neural networks”, Synthesis Lectures on Computer Architecture, 2020.
Erwei Wang et al., “Deep Neural Network Approximation for Custom Hardware: Where We've Been, Where We're Going”, CSUR, 2019.
Qianru Zhang et al., “Recent Advances in Convolutional Neural Network Acceleration”, NeuroComputing, 2019.
Bing Li et al., “Running Sparse and Low-Precision Neural Network: When Algorithm Meets Hardware”, ASPDAC, 2018.
Important Dates:
11:59 AM, Oct. 06, 2023: HW1 due.
11:59 AM, Oct. 16, 2023: Lab1 due.
Knowledge Graph
 |