 |
CMSC 5743 Efficient Computing of Deep Neural Networks – Spring 2023
| Lecture: | H 18:30-21:15 | YIA LT9 |
| Instructor: | Prof. Bei Yu | byu@cse.cuhk.edu.hk |
| Course Tutors: | Wenqian Zhao | wqzhao@cse.cuhk.edu.hk |
| Wanli Chen | wlchen@cse.cuhk.edu.hk | |
| Yang Bai | ybai@cse.cuhk.edu.hk | |
| Xinyun Zhang | xyzhang21@cse.cuhk.edu.hk | |
| Xufeng Yao | xfyao@cse.cuhk.edu.hk |
Announcements
Course Requirements
Homework (30%), Lab (40%), quiz (30%), and extra bonus.
Please submit your lab reports and homework through blackboard (link).
Schedule
| Date | Topic | Lab/Tutorial/Quiz | Homework | Note |
| Jan. 12 | Introduction (slides) | — | ||
| Jan. 19 | Im1 Conv Speedup (slides) | Lab01 GEMM (report, slides) | HW 1 | |
| Jan. 26 | — | — | Lunar New Year | |
| Feb. 02 | Mo1 Pruning (slides) | Tutorial-1 | ||
| Feb. 09 | Im2 CUDA-1 | Lab02 CUDA-1 | HW 2 | |
| Feb. 16 | Mo2 Decomposition | Tutorial-2 | ||
| Feb. 23 | Im3 CUDA-2 | Lab03 CUDA-2 | HW 3 | |
| Mar. 02 | Mo3 Quantization | Tutorial-3 | ||
| Mar. 09 | — | — | Reading Week | |
| Mar. 16 | Mo4 BNN | Quiz-1 | ||
| Mar. 23 | Im4 MNN | Lab04 MNN | HW 4 | |
| Mar. 30 | Mo5 KD | Tutorial-4 | ||
| Apr. 06 | Im5 TVM-1 | Lab05 TVM-1 | ||
| Apr. 13 | Im6 TVM-2 | Lab06 TVM-2 | ||
| Apr. 20 | Mo6 NAS | Quiz-2 |
References
All papers mentioned in lecture slides.
Sze, Vivienne, et al., “Efficient processing of deep neural networks”, Synthesis Lectures on Computer Architecture, 2020.
Erwei Wang et al., “Deep Neural Network Approximation for Custom Hardware: Where We've Been, Where We're Going”, CSUR, 2019.
Qianru Zhang et al., “Recent Advances in Convolutional Neural Network Acceleration”, NeuroComputing, 2019.
Bing Li et al., “Running Sparse and Low-Precision Neural Network: When Algorithm Meets Hardware”, ASPDAC, 2018.
Knowledge Graph
 |