arXiv : [2104.14294] Emerging Properties in Self-Supervised Vision Transformers (arxiv.org)

github : https://github.com/facebookresearch/dino

• Notation

• Motivation

• Contribution

• SSL with Knowledge Distillation

• Avoiding collapse

• Evaluation protocol

• vs Supervised learning

• Ablation study