CO673/CS794  Lectures (tentative)
2020 Fall
 Date  Topic  Slides  Notes  Videos  Comments  Applications 
00  Sep 08, 2020  Introduction  pptx, pdf  –  mp4  optional reading  perceptron 
01  Sep 10, 2020  Basics  pdf  pdf  mp4   
02  Sep 15, 2020  Gradient Descent  bb  pdf  mp4  hw1 [pdf, tex]  linear regression 
03  Sep 17, 2020  Projected Gradient  –  pdf  mp4   whitebox attack 
04  Sep 22, 2020  Proximal Gradient  –  pdf  mp4   lasso 
05  Sep 24, 2020  Conditional Gradient  –  pdf  mp4   recommendation system 
06  Sep 29, 2020  Subgradient  –  pdf  mp4  hw2 [pdf, tex]  svm 
07  Oct 01, 2020  Mirror Descent  –  pdf  mp4   online prediction 
08  Oct 06, 2020  Metric Gradient  –  pdf  mp4   distributed learning 
09  Oct 08, 2020  Lower Bound I  –  pdf  mp4   
 Oct 13, 2020      hw3 [pdf, tex]  reading week 
 Oct 15, 2020       reading week 
10  Oct 20, 2020  Acceleration  –  pdf  mp4   total variation denoising 
11  Oct 22, 2020  Smoothing  –  pdf  mp4   robust lasso 
12  Oct 27, 2020  Fejer Algorithm  –  pdf  mp4  hw4 [pdf, tex]  optimal transport 
13  Oct 29, 2020  Alternating  –  pdf  mp4   convex estimation 
14  Nov 03, 2020  Proximal Average  –  pdf  mp4   federated learning 
15  Nov 05, 2020  Minimax  –  pdf  mp4   adversarial training 
16  Nov 10, 2020  Averaging  –  pdf  mp4  hw5 [pdf, tex]  GANs 
17  Nov 12, 2020  Extragradient  –  pdf  mp4   max entropy 
18  Nov 17, 2020  Stochastic Gradient  –  pdf  mp4   privacy 
19  Nov 19, 2020  Variance Reduction  –  pdf  mp4   boosting 
20  Nov 24, 2020  Gradientfree  –  pdf  mp4  hw6 [pdf, tex]  blackbox attack 
21  Nov 26, 2020  Riemannian Gradient      hyperbolic embedding 
22  Dec 01, 2020  Lower Bound II      
23  Dec 03, 2020  Lower Bound III     

