The aim of this course is to give an introduction to machine learning and an overview of its most fundamental methods, with a particular emphasis put on why these models are designed the way they are.
Each course is divided into two parts of 3h :
- a course part, where we describe a model, or a machine learning concept, study its key properties, and the associated learning algorithms
- a second part where we study in depth the construction of this model/method, and a practical session using this method.
All practical sessions are done using Python notebooks.
Always come with your laptop, with Anaconda installed (Jupyter).
This course is mostly based on the three following books:
- Gareth James, Daniela Witten, Trevor Hastie, Rob Tibshirani, and Jonathan Taylor "An Introduction to Statistical Learning" [link]
- Shai Shalev-Shwartz & Shai Ben-David "Understanding Machine Learning: From Theory to Algorithms", Cambridge University Press [link]
- Christopher M. Bishop, "Pattern Recognition and Machine Learning", Springer, 2006 [link]
If you need to consolidate your knowledge of linear algebra, probabilities, etc., specifically for machine learning, the following book is for you:
- Marc Peter Deisenroth, A. Aldo Faisal, and Cheng Soon Ong, "Mathematics of Machine Learning", Cambridge University Press [link]
- Kaare Brandt Petersen, and Michael Syskind Pedersen, "The Matrix Cookbook" [link]
Further readings (some exercises from the PC's are taken from these books):
- Trevor Hastie, Robert Tibshirani and Jerome Friedman, "The Elements of Statistical Learning", Springer, 2009.
- Kevin P. Murphy, "Machine Learning: a Probabilistic Perspective", MIT Press, 2012.
- Richard O. Duda, Peter E. Hart & David G. Stork, "Pattern Classification. Second Edition", Wiley & Sons, 2001.
- David J.C. MacKay, "Information Theory, Inference and Learning Algorithms", Cambridge University Press, 2003.