MoCo
Momentum Contrast for Unsupervised Visual Representation Learning[1]
作者是来自FAIR的Kaiming He等人。论文引用[1]:He, Kaiming et al. “Momentum Contrast for Unsupervised Visual Representation Learning.” 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2019): 9726-9735.
Time
- 2020.Mar
Key Word
- Self-Supervised learning
- 一句话总结:就是用momentum update,来动态更新key encoder。
总结
- 作者提出了Momentum Contrast(MoCO),用于无监督的视觉表征学习。从对比学习作为一种字典查找(dictionary lookup)的视角出发,作者构建了一个具有队列和moving-averaged encoder,这能够即时构建一个大的dictionary, 促进了对比无监督学习。