CSCI 1051: Deep Learning
Instructor: R. Teal Witter. Please call me Teal.
Class Times: We meet Monday, Tuesday, Wednesday, and Thursday in 75 Shannon St Room 202. The lecture is from 10am to noon and the discussion is from 2 to 4pm.
Office Hours: I will hold office hours in 75 Shannon St Room 221 from 3 to 4pm.
Participation: I expect you to engage in class, ask questions, and make connections. So I can check in with you, please fill out this form every lecture.
Scribed Notes: Notes are a great resource for augmenting your in-class learning. Since I updated the material in this course, I would like to ask for your help in writing these notes. You can find the assignment here.
Assignments: You will receive one problem per class. I expect you to solve the problem with your group during the discussion (I’ll be there to answer questions). Once you have solved the problem, you should write up your solution on your own. In addition, there will be a project on a lecture topic of your choice.
| Assignment | Due |
| Problem Set 1 (LaTeX) | Friday 1/10 |
| Problem Set 2 | Friday 1/17 |
| Problem Set 3 | Friday 1/24 |
| Problem Set 4 | Wednesday 1/29 |
| Project Proposal | Wednesday 1/22 |
| Project | Friday 1/31 |
| Class | Topic | Slides | Resources |
| The Three-Step Framework | |||
| Monday 1/6 | Linear Regression and Mean Squared Error | Slides | Notes |
| Tuesday 1/7 | Logistic Regression and Cross Entropy Loss | Slides | |
| Wednesday 1/8 | Gradient Descent and Neural Networks | Slides | Notes |
| Thursday 1/9 | Back-propagation and Optimization | Slides | Notes |
| Language Generation | |||
| Monday 1/13 | Language Embeddings and Contrastive Loss | ||
| Tuesday 1/14 | Transformers and Positional Encoding | ||
| Wednesday 1/15 | Low Rank Adaptation and Sparse Autoencoders | ||
| Thursday 1/16 | Watermarking | ||
| Image Generation | |||
| Tuesday 1/21 | Convolutional Neural Networks and Image Embeddings | ||
| Wednesday 1/22 | Diffusion | ||
| Thursday 1/23 | Schrödinger Bridges | ||
| AI Safety | |||
| Monday 1/27 | Interpretability | ||
| Tuesday 1/28 | Implicit Regularization | ||
| Wednesday 1/29 | Project Preparation | ||
| Thursday 1/30 | Project Presentations | ||