Winter 2021 CS291A Syllabus

• 1/4 Introduction, logistics, and deep learning.
• 1/6 Tips for a successful class project
• 1/11 Neural network basics, & backpropagation
• 1/13 Word embeddings (Project proposal due submission link, HW1 out)
  • Enriching Word Vectors with Subword Information
  • Contextual String Embeddings for Sequence Labeling
  • GloVe: Global Vectors for Word Representation
• 1/18 University Holiday: Martin Luther King Jr. Day
• 1/20 RNNs
  • Recurrent neural network based language model
• 1/25 LSTMs/GRUs
  • Deep contextualized word representations
  • Universal Language Model Fine-tuning for Text Classification
• 1/27 Sequence-to-sequence models
• 2/1 Convolutional Neural Networks (HW1 due and HW2 out)
  • Improved protein structure prediction using potentials from deep learning
• 2/3 Attention mechanisms
• 2/8 Transformer and BERT (Mid-term report due submission link)
  • XLNet: Generalized Autoregressive Pretraining for Language Understanding
  • RoBERTa: A Robustly Optimized BERT Pretraining Approach
  • [ALBERT: A Lite BERT for Self-supervised Learning of Language Representations]
• 2/10 Mid-term project updates
• 2/15 University Holiday: Presidents' Day
• 2/17 Language and vision
  • An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• 2/22 Deep Reinforcement Learning 1 (HW2 due: 02/26 Monday 11:59pm)
• 2/24 Deep Reinforcement Learning 2
  • Causal Discovery with Reinforcement Learning
  • Grandmaster level in StarCraft II using multi-agent reinforcement learning
  • Mastering Atari, Go, chess and shogi by planning with a learned model
• 3/1 Generative Adversarial Networks
  • Towards Principled Methods for Training Generative Adversarial Networks
  • Wasserstein GAN
  • Boundary Equilibrium GAN
• 3/3 Project: final presentation (1)
• 3/8 Project: final presentation (2)
• 3/10 Project: final presentation (3)
• 3/19 23:59PM PT Project Final Report Due submission link.