Steward R208 or Zoom : https://arizona.zoom.us/j/6849448207
Dive into Deep Learning (https://d2l.ai)
| ID | Day | Topic | Materials | Presenters | Notes |
|---|---|---|---|---|---|
| 1 | 1/12 | Course Introduction | Tim | ||
| 2 | 1/19 | Overview of Machine Learning | Hung-Jin | slides | |
| 3 | 1/24 | ML Applications in Astro | Tim | ||
| 4 | 1/26 | Gaussian Processes and NNs to sample parameter spaces quickly | Supranta | ||
| 5 | 1/31 | Linear Regression (theory & implementation) | d2l 3.1-3.3 | Wei Leong | notebook |
| 6 | 2/2 | Logistic/Softmax Regression (theory & implementation) | d2l §3.4, 3.5-3.7 | Chia-Lin | slides |
| 7 | 2/7 | Multilayer Perceptrons | d2l §4.1, 4.2, 4.3 notebook: MLP |
Hina | slides |
| 8 | 2/9 | Model Selection, Underfitting & Overfitting, Weight Decay, Dropout | d2l §4.4, §4.5, §4.6 notebook: dropout |
Jeff | slides |
| 9 | 2/14 | Forward & Backward Prop, Vanishing gradient and parameter initialization | d2l §4.7, §4.8 | Yang | slides |
| 10 | 2/16 | DL computation basics | d2l §5.1, §5.2, §5.4-5.6 | Joe | slides notebook |
| 11 | 2/21 | CNN basics 1 (Intro, Convolution, Padding & Stride) | d2l §6.1, §6.2-§6.3 | Annie | CNN 6.1-6.3.pdf |
| 12 | 2/23 | CNN basics 2 (Channels, Pooling, LeNet) | d2l §6.4-§6.6 | Patrick | slides |
| 13 | 2/28 | Optimization Basics, Convexity | d2l §11.1, §11.2 | Lily | slides |
| 14 | 3/2 | ------ Prelim, no lecture today ------ | |||
| 15 | 3/14 | Gradient Descent | d2l §11.3, §11.4-§11.5 | Vivian | slides |
| 16 | 3/16 | Optimization algorithm 1 (momentum, adagrad) | d2l §11.6, §11.7 | Hayden | slides |
| 17 | 3/21 | Optimization algorithm 2 (RMSProp, Adadelta, Adam) | d2l §11.8, §11.9, §11.10 | Gabriela | slides |
| 18 | 3/23 | Learning Rate decay, Batch Normalization | d2l §11.11, §7.5 | Haley | slides |
| 19 | 3/28 | CNN architecture 1 (AlexNet, VGG) | d2l §7.1, §7.2 | Paul | |
| 20 | 3/30 | CNN architecture 2 (NiN, GoogLeNet) | d2l §7.3, §7.4 | Jake | slides, notes |
| 21 | 4/4 | CNN architecture 3 (ResNet, DenseNet) | d2l §7.6, §7.7 | Yu-Hsiu | slides |
| 22 | 4/6 | Features learned in ConvNet | notebook1, notebook2 | Hung-Jin | slides |
| 23 | 4/11 | Term Project 1 | paper1, paper2 | Jeff, Patrick | |
| 24 | 4/13 | Term Project 2 | paper | Chia-Lin | slides |
| 25 | 4/18 | Term Project 3 | paper1, paper2 | Joe, Jake | |
| 26 | 4/20 | Term Project 4 | paper1, paper2 | Hina, Colin | slides2 |
| 27 | 4/25 | Term Project 5 | paper1, paper2 | Lily, Haley | |
| 28 | 4/27 | Term Project 6 | paper1, TBD | Yu-Hsiu, Vivian | |
| 29 | 5/2 | Term Project 7 | TBD, paper2 | Paul, Annie | |
| 30 | 5/4 | Term Project 8 | paper1, paper2 | Hayden, Yang | |
| 31 | 5/9 | Term Project 9 | paper1, paper2 | Wei Leong, Maria Gabriela |