Lecture notes are taken by students. The scribe is expected to verify the correctness of all proofs, to fill in any obvious gaps in the lecture, and to add figures and illustrative images as needed.
| Title | File | |
| 1 & 2 | Introduction | |
| 3 | Finite Hypothesis Classes | |
| 4 | Finite Hypothesis Classes, Estimation vs Approximation | |
| 5 | Rademacher Complexity | |
| 6 | Linear Hypothesis Classes 1 | |
| 7 | Linear Hypothesis Classes 2 | |
| 8 | VC Theory | |
| 9 | Sauer's Lemma | |
| 10 | Growth Functions and VC Dimension | |
| 11 | PAC Bayes 1 | |
| 12 | PAC Bayes 2 | |
| 13 | PAC Bayes 3 | |
| 14 | Derandomizing PAC Bayes | |
| 15 | Martingales and Online Learning | |
| 16 | Stochastic Gradient Descent | |
| 17 | Online to Batch Conversions | |
| 18 | Sample Compression | |
| 19 | Stability | |
| 20 | Beyond Inductive Learning |