ML Transformer Vision

[junxnone]

Transformer 在视觉方面的应用

Reference

• 2021-01 A Survey on Visual Transformer [Paper] [Note]
• 2021-01 Transformers in Vision: A Survey [Paper] [Note]
• vision_transformer - google-research
• DETR
• LSTR: Lane Shape Prediction with Transformers - Github
• vit-pytorch
  • x-transformers
  • linformer
• self-attention-cv - The-AI-Summer

Brief

• Classification

CNN Vs Transformer

CNN Vs Transformer	不同点
CNN	参数共享, Local 信息聚合
Transformer	全局感受野, Global 信息聚合

Name	Description	CNN	Transformer
ViT		❌	✅
DETR		✅	✅
BoTNet		✅	✅
T2T-ViT		❌	✅
DeiT		❌	✅

Classification

Models

• ViT
• T2T-ViT
• DeiT
• W/ Efficient Attention
  • Linformer
  • Routing Transformer
  • Sinkhorn Transformer
  • Nystromformer

OpenSource Code

• timm release with pretrained weight
• vit-pytorch
  • module
    • vit_pytorch => vanilla vit
    • distill
      • DistillableViT
    • t2t
      • T2TViT
    • efficient => 自定义的 Transformer module
      • Linformer
      • Nystromformer

[junxnone]

#212