CSE 4095/5095
 Deep Learning


Course Schedule

(Tentative schedule for the course and deviations may be necessary as the course progresses.)

Date Topic Notes Reading (Textbook or Other Materials)
Jan. 21 Introduction Chapter 1, 2, 3, Nature review on DL, Basic calculus refresher
Jan. 23 Machine Learning Basics Chapter 4, 5, Machine learning math essentials
Jan. 28 Shallow Classifiers
Project Details
Chapter 4, 5
Jan. 30 Loss Functions
Chapter 4, 5
Feb. 4
Optimization, SGD
Chapter 4, 5
Feb. 11 Backpropagation Chapter 4, 5
Feb. 13 Intro to Neural Networks
Feb. 18 Intro to Convolutional Neural Networks, Convolution AlexNet
Feb. 20 Pooling, Demo, BP example All Convolutional Net
Feb. 25 Training Neural Networks
Feb. 27 Training Neural Networks II, Batch Normalization Batch Normalization
Mar. 4 Second-order Optimization Chapter 8
Mar. 6 Regularization, Transfer Learning Dropout, Blackout, DeCAF
Mar. 11 ImageNet, CNN Architectures AlexNet, VGGNet, GoogleNet, ResNet
Mar. 13 CNN Architectures and Visualization Wide ResNet, Zeiler and Fergus, Yosinski et al.
Mar. 17-21 No classes
Spring Recess
Mar. 25 Word2Vec
word2vec, glove, wordrank
Mar. 27 RNN rnnlm
Apr. 1 LSTM, GRU LSTM, GRU
Apr. 3 Image Caption, Machine Translation Show, Attend and Tell, NMT with Attention

 

back to course page