PDF4PRO ⚡AMP

Modern search engine that looking for books and documents around the web

Example: stock market

Unsupervised Data Augmentation for Consistency Training

Unsupervised Data Augmentation for Consistency Training Qizhe Xie1,2 , Zihang Dai1,2 , Eduard Hovy2 , Minh-Thang Luong1 , Quoc V. Le1. 1. Google Research, Brain Team, 2 Carnegie Mellon University {qizhex, dzihang, {thangluong, Abstract Semi-supervised learning lately has shown much promise in improving deep learn- ing models when labeled data is scarce. Common among recent approaches is the use of Consistency Training on a large amount of unlabeled data to constrain model predictions to be invariant to input noise. In this work, we present a new perspective on how to effectively noise unlabeled examples and argue that the quality of noising, specifically those produced by advanced data Augmentation methods, plays a crucial role in semi-supervised learning.}}

Unsupervised Data Augmentation for Consistency Training Qizhe Xie 1, 2, Zihang Dai , Eduard Hovy , Minh-Thang Luong , Quoc V. Le1 1 Google Research, Brain Team, 2 Carnegie Mellon University {qizhex, dzihang, hovy}@cs.cmu.edu, {thangluong, qvl}@google.com Abstract Semi-supervised learning lately has shown much promise in improving deep learn-

Loading..

Information

Domain:

Source:

Link to this page:

Please notify us if you found a problem with this document:

Spam in document Broken preview Other abuse

Transcription of Unsupervised Data Augmentation for Consistency Training

Related search queries