Learning Plan: DL & CV

Deep Learning, Hung-Yi Lee, NTU

Compulsory Course

• Deep Learning Preview
• CNN
• Self-Attention
• Transformer
• Reinforcement Learning

Optional Course

• Generative Model
• Self-Supervised Learning
• Explainable AI

Compulsory Homework

• Regression
• Classification
• CNN
• Self-Attention
• Transformer
• Reinforcement Learning

Optional Homework

• GAN
• BERT
• Explainable AI

CS231n: Computer Vision, Feifei Li, Stanford

Course

• Image Classification with Linear Classifiers
• Regularization and Optimization
• Neural Networks and Backpropagation
• Image Classification with CNNs
• CNN Architectures
• Recurrent Neural Networks
• Attention and Transformers
• Object Detection, Image Segmentation, Visualizing and Understanding
• Video Understanding
• Large Scale Distributed Training
• Self-supervised Learning
• Generative Models
• 3D Vision
• Vision and Language
• Robot Learning
• Human-Centered AI

Assignments

• Assignment 1: Image Classification, kNN, Softmax, Fully-Connected Neural Network, Fully-Connected Nets
• Assignment 2: Batch Normalization, Dropout, Convolutional Nets, Network Visualization, Image Captioning with RNNs
• Assignment 3 : Image Captioning with Transformers, Self-Supervised Learning, Diffusion Models, CLIP and DINO Models

Project

• Final Project