13-03-2012 MIT OpenCourseWare | Electrical Engin…

Hom e > Course s > Ele ctrica l Enginee ring a nd C om puter Scie nce > Ma chine Le a rning > Le cture Note s

Lecture Notes
LEC # TOPICS

1 Introduction, linear classification, perceptron update rule (PDF)

2 Perceptron convergence, generalization (PDF)

3 Maximum margin classification (PDF)

4 C lassification errors, regularization, logistic regression (PDF)

5 Linear regression, estimator bias and variance, active learning (PDF)

6 Active learning (cont.), non-linear predictions, kernals (PDF)

7 Kernal regression, kernels (PDF)

8 Support vector machine (SVM) and kernels, kernel optimization (PDF)

9 Model selection (PDF)

10 Model selection criteria (PDF)

11 Description length, feature selection (PDF)

12 C ombining classifiers, boosting (PDF)

13 Boosting, margin, and complexity (PDF)

14 Margin and generalization, mixture models (PDF)

15 Mixtures and the expectation maximization (EM) algorithm (PDF)

16 EM, regularization, clustering (PDF)

17 C lustering (PDF)

18 Spectral clustering, Markov models (PDF)

19 Hidden Markov models (HMMs) (PDF)

20 HMMs (cont.) (PDF)

21 Bayesian networks (PDF)

22 Learning Bayesian networks (PDF)

Probabilistic inference
23
Guest lecture on collaborative filtering (PDF)

24 C urrent problems in machine learning, wrap up

Your use of the MIT O pe nCourse W a re site a nd course m a te ria ls is subje ct to our C re a tive Com m ons Lice nse a nd othe r te rm s of use .

ocw.mit.edu/courses/…/lecture-notes/ 1/1