PDF4PRO ⚡AMP

Modern search engine that looking for books and documents around the web

Example: quiz answers

!Neural!Networks!for!Machine!Learning! !Lecture!6a ...

Neural Networks for Machine Learning Lecture 6a Overview of mini- batch gradient descent Geoffrey hinton with Ni@sh Srivastava Kevin Swersky Reminder: The error surface for a linear neuron The error surface lies in a space with a horizontal axis for each weight and one ver@cal axis for the error. For a linear neuron with a squared error, it is a quadra@c bowl. Ver@cal cross- sec@ons are parabolas. Horizontal cross- sec@ons are ellipses. For mul@- layer, non- linear nets the error surface is much more complicated. But locally, a piece of a quadra@c bowl is usually a very good E w1 w2 Convergence speed of full batch learning when the error surface is a quadra@c bowl Going downhill reduces the error, but the direc@on of steepest descent does not point at the minimum unless the ellipse is a circle.

!Neural!Networks!for!Machine!Learning!!!Lecture!6a Overview!of!mini9batch!gradientdescent Geoffrey!Hinton!! with! Ni@sh!Srivastava!! Kevin!Swersky!

Loading..

Tags:

  Hinton

Information

Domain:

Source:

Link to this page:

Please notify us if you found a problem with this document:

Spam in document Broken preview Other abuse

Transcription of !Neural!Networks!for!Machine!Learning! !Lecture!6a ...

Related search queries