Skip to content

Latest commit

 

History

History
52 lines (37 loc) · 2.22 KB

README.md

File metadata and controls

52 lines (37 loc) · 2.22 KB

SnowSelect

Paper that must read. SnowSelect is all you need.

Natual Language Processing

  1. Long and Short-Term Memory : A well-known solution for long sentences processing.
  2. Learning Longer Memory in RNN
  3. Seq2Seq
  4. CNN on Sentence Classification
  5. Neural Machine Translation by Jointly Learning to Align and Translate : Attention first introduced in NLP field.
  6. Attention is All You Need. : first transduction model relying entirely on self-attention to compute representations of its input and output without using RNNs or convolution.
  7. BERT
  8. Transformer-XL:

Computer Vision

  1. AlexNet:The Beginning of Deep Learning
  2. First Attention Solution
  3. GoogLeNet

Optimization

  1. On Optimization Methods for Deep Learning
  2. Adam Optimization
  3. VGG
  4. SPP Net

GAN

  1. VAE
  2. GAN
  3. conditional GAN
  4. Generalized Denoising Auto-Encoders as Generative Models

Deep Representations

  1. Better Mixing via Deep Representations

Tricks

  1. Dropout
  2. No More Pesky Learning Rates
  3. Bag of Tricks for CV

Audio Processing

  1. WaveNet
  2. Deep Voice
  3. WaveNet for Denoising