Transcription of Co2L: Contrastive Continual Learning - openaccess.thecvf.com
{{id}} {{{paragraph}}}
Example: barber
Co2L: Contrastive Continual Learning - openaccess.thecvf.com
Co2L: Contrastive Continual LearningHyuntak ChaJaeho LeeJinwoo ShinKAISTD aejeon, South Korea{ , jaeho-lee, breakthroughs in self-supervised Learning showthat such algorithms learn visual representations that can betransferred better to unseen tasks than cross-entropy basedmethods which rely on task-specific supervision. In this pa-per, we found that the similar holds in the Continual learningcontext: contrastively learned representations are more ro-bust against the catastrophic forgetting than ones trainedwith the cross-entropy objective. Based on this novel ob-servation, we propose a rehearsal-based Continual learningalgorithm that focuses on continually Learning and main-taining transferable representations.}
encoders. Meanwhile, it has been shown that supervised learning can also enjoy the benefits of contrastive representa-tion learning by simply using labels to extend the definition ... domain-incremental learning (Domain-IL), and class-incremental learning (Class-IL).
Loading..
Tags:
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: