Transcription of Understanding deep learning requires rethinking …
{{id}} {{{paragraph}}}
Example: biology
Understanding deep learning requires rethinking …
Understanding deep learning requires RE-THINKING GENERALIZATIONC hiyuan Zhang Massachusetts Institute of BengioGoogle HardtGoogle Recht University of California, VinyalsGoogle their massive size, successful deep artificial neural networks can exhibit aremarkably small difference between training and test performance. Conventionalwisdom attributes small generalization error either to properties of the model fam-ily, or to the regularization techniques used during extensive systematic experiments, we show how these traditional ap-proaches fail to explain why large neural networks generalize well in , our experiments establish that state-of-the-art convolutional networksfor image classification trained with stochastic gradient methods easily fit a ran-dom labeling of the training data.
Randomization tests. At the heart of our methodology is a variant of the well-known randomiza-tion test from non-parametric statistics (Edgington & Onghena, 2007).
Tags:
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: