 |
CMSC 5743 Efficient Computing of Deep Neural Networks – Fall 2024
| Lecture: | Monday 18:30-21:15 | YIA 405 |
| Instructor: | Prof. Bei Yu | byu@cse.cuhk.edu.hk |
| Course Tutors: | Zehua Pei | zhpei23@cse.cuhk.edu.hk |
Announcements
Course Requirements
Homework (30%), Lab (40%), quiz (30%), and extra bonus.
Please submit your lab reports and homework through blackboard (link).
Schedule
| Date | Topic | Lab/Quiz | Homework | Note |
| Sep. 02 | Introduction (slides) | |||
| Sep. 09 | Im1 GEMM (slides) | — | ||
| Sep. 16 | Im2 Direct Conv (slides) | — | ||
| Sep. 23 | Im3 Winograd (slides) | Lab1 GEMM | ||
| Sep. 30 | Mo1 Pruning (slides) | — | ||
| Oct. 07 | Im4 Sparse Conv (slides) | |||
| Oct. 14 | Mo2 Decomposition (slides) | Lab2 Winograd | HW 1 | |
| Oct. 21 | Mo3 Quantization (slides) | — | ||
| Oct. 28 | — | Quiz-1 | Lecturer in travel | |
| Nov. 04 | Mo4 BNN (slides) | Lab3 Sparse | ||
| Nov. 11 | Mo5 KD (slides) | — | ||
| Nov. 18 | Mo6 NAS | HW 2 | ||
| Nov. 25 | Quiz-2 | |||
| Dec. 04 | Im5 CUDA (slides) | Lab4 CUDA |
References
All papers mentioned in lecture slides.
Sze, Vivienne, et al., “Efficient processing of deep neural networks”, Synthesis Lectures on Computer Architecture, 2020.
Erwei Wang et al., “Deep Neural Network Approximation for Custom Hardware: Where We've Been, Where We're Going”, CSUR, 2019.
Qianru Zhang et al., “Recent Advances in Convolutional Neural Network Acceleration”, NeuroComputing, 2019.
Bing Li et al., “Running Sparse and Low-Precision Neural Network: When Algorithm Meets Hardware”, ASPDAC, 2018.
Important Dates:
Knowledge Graph
 |