Understanding deep learning requires rethinking …

arxiv.org

may not be essential for generalization, it is certainly the case that not all models that t the training data well generalize well. Indeed, in neural networks, we almost always choose our model as the output of running stochastic gradient descent. Appealing to linear models, we analyze how SGD acts as …

  Understanding, Deep, Rethinking, Generalization, Understanding deep