Transcription of Unsupervised Data Augmentation for Consistency Training
{{id}} {{{paragraph}}}
Unsupervised Data Augmentation for Consistency Training Qizhe Xie1,2 , Zihang Dai1,2 , Eduard Hovy2 , Minh-Thang Luong1 , Quoc V. Le1. 1. Google Research, Brain Team, 2 Carnegie Mellon University {qizhex, dzihang, {thangluong, Abstract Semi-supervised learning lately has shown much promise in improving deep learn- ing models when labeled data is scarce. Common among recent approaches is the use of Consistency Training on a large amount of unlabeled data to constrain model predictions to be invariant to input noise. In this work, we present a new perspective on how to effectively noise unlabeled examples and argue that the quality of noising, specifically those produced by advanced data Augmentation methods, plays a crucial role in semi-supervised learning.}}
Unsupervised Data Augmentation for Consistency Training Qizhe Xie 1, 2, Zihang Dai , Eduard Hovy , Minh-Thang Luong , Quoc V. Le1 1 Google Research, Brain Team, 2 Carnegie Mellon University {qizhex, dzihang, hovy}@cs.cmu.edu, {thangluong, qvl}@google.com Abstract Semi-supervised learning lately has shown much promise in improving deep learn-
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document:
{{id}} {{{paragraph}}}