A Survey on Visual Transformer

[junxnone]

Reference

• 2021-01 A Survey on Visual Transformer [Paper]
• 论文笔记 - 0809zheng

Brief

• 研究方向
  • CNN + Transformer 探索
  • 减少复杂度
  • 不同领域的应用

不同领域的应用

• NLP
  • BERT - QA/IR/Chatbot(DialogSystem)/Summarization/Augmentation/Classification
  • GPT - 理解/生成
• CV
  • Image classification
  • High Level Tasks
    • Object detection
    • Segmentation
    • Pose Estimation
  • Low Level Tasks
    • Image enhancement
    • Image generation
  • Video inpainting 修补
  • Video captioning 字幕？描述
  • Decomposition 分解
  • Distillation
  • Quantization
  • Architecture design
• 原始 Transformer 介绍 Vanilla Transformer
• CV Key Papers
  • CNN + Transformer
    • Visual Transformers
  • Only Transformer
    • iGPT
    • ViT
    • DeiT

[junxnone]

#913