MATH3320 - Foundation of Data Analytics - 2020/21

Announcement

• Zoom Link: https://cuhk.zoom.us/j/94379471220
• Please log in with your full name and department. Otherwise you could be kicked out.
• This is no Tutorial today (September 8, 2020).
• Arrangements for Online Classes and Online Examinations : Unless otherwise advised by the course teachers concerned with alternative arrangements, all online classes and online examinations will continue as scheduled under any weather conditions, including when Tropical Cyclone Warning Signal No. 8 or above and/or Black Rainstorm Signal is hoisted.
• Midterm will be held on November 3, 12:30pm-2:15pm. It will cover all the content of our courses including tutorial.
• The final exam will be held from 5:30 pm to 7:45 pm on December 11. You will have 15min to submit via blackboard(before 8:00 pm). We will use the same zoom link used in class.

---

General Information

Lecturer

• Prof. Zeng Tieyong
  • Office: LSB225
  • Tel: 39437966
  • Email:

Teaching Assistant

• Jianwei Niu
  • Office: LSB 222A
  • Tel: 3943 3575
  • Email:
• Tiange Wang
  • Office: LSB 222A
  • Tel: 3943 3575
  • Email:

Time and Venue

• Lecture: Mo 9:30AM - 10:15AM; Tu 12:30PM - 2:15PM
• Tutorial: Tu 11:30AM - 12:15PM

Course Description

This course gives an introduction to computational data analytics, with emphasis on its mathematical foundations. The goal is to carefully develop and explore mathematical theories and methods that make up the backbone of modern mathematical data sciences, such as knowledge discovery in databases, machine learning, and mathematical artificial intelligence. Topics include mathematical foundations of probability, linear approximation and its polynomial and high dimensional extensions, proper orthogonal decomposition methods, optimization, theories of nonlinear neural network and approximations. Students taking this course are expected to have knowledge of basic linear algebra.

Advisory: MATH Majors should select not more than 5 MATH courses in a term.

Textbooks

• Ian Goodfellow, Yoshua Bengio and Aaron Courville, Deep Learning, The MIT Press, 2016.
• Christopher M. Bishop, Pattern Recognition and Machine Learning, Springer, 2006.
• Kevin P. Murphy, Machine Learning: A Probabilistic Perspective, The MIT Press, 2012.:
• "Mathematics for Machine Learning" by Marc Peter Deisenroth, A. Aldo Faisal, and Cheng Soon Ong, Cambridge University Press.

References

• Shai Shalev-Shwartz and Shai Ben-David, Understanding Machine Learning: From Theory to Algorithms, Cambridge University Press, 2014
• Richard Duda, Peter Hart and David Stock,Pattern Classification, Wiley-Interscience, 2nd Edition, 2015.
• Tom Mitchell, Machine Learning, 1st Edition, McGraw-Hill, 1997

Pre-class Notes

• linear approximation
• PDF
• Estimation
• Estimation_MLE
• Classfication
• Gradient Descent
• Gradient Descent
• Cross validation
• Bayes
• Bayes Regression
• k-means clustering
• SVM
• K-NN
• PCA

Lecture Notes

• Notes1
• Notes2
• Notes3
• cuhk Notes (updated: Dec 1, 2020)
• Video (updated: Dec 1, 2020)

Class Notes

• Notes on Linear Algebra (Jean Walrand)
• Linear Algebra
• Topics in Matrix Theory(SVD)
• More on Multivariate Gaussians (Stanford)

Tutorial Notes

• Tutorial 1
• Tutorial 2
• Tutorial 3
• Tutorial 4
• Tutorial 5
• Tutorial 6
• Tutorial 7
• Tutorial 8
• Tutorial 9
• Tutorial 10_1
• Tutorial 10_2
• Tutorial 11

Assignments

• Project

Solutions

• Midterm Solution
• Solution1
• Solution4
• Solution2
• Solution3
• Solution5
• Solution6
• Solution 10

Assessment Scheme

Tutorial attendance & good efforts		10%
Mid-Exam		12.5%
Homework/Project		12.5%
Final Exam		65%
Back-up Plan: In case face-to-face teaching and assessment is not possible due to the pandemic, the assessment will be changed to: Tutorial and homework 30%; Midterm 35% ; Project 35%		%

Useful Links

• Introduction to Machine Learning
• Foundation of Data Science
• A Comprehensive Guide to Machine Learning
• Introduction to Monte Carlo
• PCA
• K-means
• K-Medoids
• Mixtures of Gaussian
• scikit-learn Machine Learning in Python
• Mixtures of Gaussian
• Hidden Markov Models
• Support Vector Machines(Andrew Ng)
• Machine Learning(Andrew Ng)
• Hidden Markov Models
• Neural Networks and Introduction to Deep Learning
• CNN-Li Feifei
• Deep Learning (Adrew Ng)
• LSTM
• Introduction to Machine Learning
• Lasso
• Machine Learning for OR & FE (Columbia University)
• CS229: Machine Learning (Stanford)
• Mathematics for Machine Learning

Honesty in Academic Work

The Chinese University of Hong Kong places very high importance on honesty in academic work submitted by students, and adopts a policy of zero tolerance on cheating and plagiarism. Any related offence will lead to disciplinary action including termination of studies at the University. Although cases of cheating or plagiarism are rare at the University, everyone should make himself / herself familiar with the content of the following website:

http://www.cuhk.edu.hk/policy/academichonesty/

and thereby help avoid any practice that would not be acceptable.

---

Assessment Policy

Last updated: December 01, 2020 15:42:14