| Course code | CSCI3320 |
| Course title | Fundamentals of Machine Learning 機器學習之基礎課程 |
| Course description | The first part introduces basic methods, including minimum error versus maximum likelihood, parametric versus nonparametric estimation, linear regression, factor analysis, Fisher analysis, singular value decomposition, clustering analysis, Gaussian Mixture, EM algorithm, spectral clustering, nonnegative matrix factorization. The second part provides an introduction on small sample size learning, consisting of model selection criteria, RPCL learning, automatic model selection during learning, regularization and sparse learning. 第一部分介紹基本方法，包括最小誤差與最大似然、參數與非參數估計、線性回歸分析、因數分析、費歇判別分析、奇異值分解、聚類分析、高斯混合、EM 演算法、譜聚類、非負矩陣分解。第二部分簡介有限樣本學習，包括模型選擇準則、RPCL 學習、學習過程中自動模型選擇、規則化與稀疏學習。 |
| Unit(s) | 3 |
| Course level | Undergraduate |
| Pre-requisite | ENGG2430 or 2450 or 2760 or 2780 or ESTR2002 or 2005 or 2018 or 2020 or 2308 or 2362 or IERG2470 or MIEG2440 or STAT2001 |
| Semester | 1 or 2 |
| Grading basis | Graded |
| Grade Descriptors | A/A-: EXCELLENT – exceptionally good performance and far exceeding expectation in all or most of the course learning outcomes; demonstration of superior understanding of the subject matter, the ability to analyze problems and apply extensive knowledge, and skillful use of concepts and materials to derive proper solutions. B+/B/B-: GOOD – good performance in all course learning outcomes and exceeding expectation in some of them; demonstration of good understanding of the subject matter and the ability to use proper concepts and materials to solve most of the problems encountered. C+/C/C-: FAIR – adequate performance and meeting expectation in all course learning outcomes; demonstration of adequate understanding of the subject matter and the ability to solve simple problems. D+/D: MARGINAL – performance barely meets the expectation in the essential course learning outcomes; demonstration of partial understanding of the subject matter and the ability to solve simple problems. F: FAILURE – performance does not meet the expectation in the essential course learning outcomes; demonstration of serious deficiencies and the need to retake the course. |
| Learning Objectives | 1. basic methods of supervised and unsupervised learning; 2. fundamental knowledge on a small sample size learning; 3. skills on some machine learning applications. |
| Learning outcomes | 1. understand basic concepts of statistical learning; 2. develop analytical skills on typical linear model based supervised and unsupervised learning; 3. develop analytical skills on typical approaches for clustering analysis; 4. become knowledgeable on fundamentals on a small sample size learning. |
| Assessment (for reference only) |
Short answer test or exam: 55% Assignments: 35% Selected response test or exam: 10% |
| Recommended Reading List | 1. Mitchell, T. (1997). Machine Learning, McGraw Hill. ISBN 0-07-042807-7 2. Richard O. Duda, Peter E. Hart, David G. Stork (2001) Pattern classification (2nd edition), Wiley, New York, ISBN 0-471-05669-3 3. Trevor Hastie, Robert Tibshirani and Jerome Friedman (2001). The Elements of Statistical Learning, Springer. ISBN 0-387-95284-5 |
| CSCIN programme learning outcomes | Course mapping |
| Upon completion of their studies, students will be able to: | |
| 1. identify, formulate, and solve computer science problems (K/S); | T |
| 2. design, implement, test, and evaluate a computer system, component, or algorithm to meet desired needs (K/S); |
TP |
| 3. receive the broad education necessary to understand the impact of computer science solutions in a global and societal context (K/V); | |
| 4. communicate effectively (S/V); |
|
| 5. succeed in research or industry related to computer science (K/S/V); |
T |
| 6. have solid knowledge in computer science and engineering, including programming and languages, algorithms, theory, databases, etc. (K/S); | TP |
| 7. integrate well into and contribute to the local society and the global community related to computer science (K/S/V); | P |
| 8. practise high standard of professional ethics (V); | |
| 9. draw on and integrate knowledge from many related areas (K/S/V); |
TP |
| Remarks: K = Knowledge outcomes; S = Skills outcomes; V = Values and attitude outcomes; T = Teach; P = Practice; M = Measured | |