Designing, Visualizing and Understanding Deep Neural Networks
UC Berkeley
Lectures
Lectures are Mondays and Wednesdays, 5:10PM - 6:30PM, in Dwinelle 155 or online via Zoom. Lecture slides are provided via Piazza, and lecture videos are provided via bCourses. Students are responsible for all lecture content.
Lecture Slides
- 2022/01/19: Introduction
- 2022/01/24: ML Review Part 1
- 2022/01/26: ML Review Part 2
- 2022/01/31: Neural Networks
- 2022/02/07: Optimization
- 2022/02/09: Building Blocks
- 2022/02/14: ConvNets
- 2022/02/23: RNNs
- 2022/02/28: MT1 Review
- 2022/03/07: Transformers Part 1
- 2022/03/09: Transformers Part 2
- 2022/03/14: Sequence to Sequence Models
- 2022/03/28: Distribution Shift
- 2022/03/30: Robustness
- 2022/04/04: Adversarial Examples
- 2022/04/06: Generative Models
- 2022/04/11: Self-Supervised Learning
- 2022/04/13: Massive Models
- 2022/04/25: MT2 Review
Discussion Sections
The discussion sections will not cover new material, but rather will give you additional practice solving problems. You can attend any discussion section you like. However, if there are less crowded sections that fit your schedule, those offer more opportunities for you to interact with your TA.
Section Notes
- Discussion 1: Section Notes, Solution
- Discussion 2: Section Notes, Solution
- Discussion 3: Section Notes, Solution
- Discussion 4: Section Notes, Solution
- Discussion 5: Section Notes, Solution
- Discussion 6: Section Notes, Solution
- Discussion 7: Section Notes, Solution
- Discussion 8: Section Notes, Solution
- Discussion 9: Section Notes, Solution
- Discussion 10: Section Notes, Solution
- Discussion 11: Section Notes, Solution
- Discussion 12: Section Notes, Solution
Homeworks
All homeworks are graded for accuracy. You are given a total of 5 slip days for use only on homeworks. These slip days are intended for emergency use, and as such we employ a strict late policy. There is no additional slack beyond slip days available. Homework solutions are provided via Piazza.
Homeworks
- Homework 1, due 02/21/2022 11:59 PM PST
- Homework 2, due 03/14/2022 11:59 PM PST
- Homework 3, due 04/11/2022 11:59 PM PST
- Homework 4, due 05/02/2022 11:59 PM PST