Paper that must read. SnowSelect is all you need.
- Long and Short-Term Memory : A well-known solution for long sentences processing.
- Learning Longer Memory in RNN
- Seq2Seq
- CNN on Sentence Classification
- Neural Machine Translation by Jointly Learning to Align and Translate : Attention first introduced in NLP field.
- Attention is All You Need. : first transduction model relying entirely on self-attention to compute representations of its input and output without using RNNs or convolution.
- BERT
- Transformer-XL:
- AlexNet:The Beginning of Deep Learning
- First Attention Solution
- GoogLeNet