Gradient-Based Learning Applied to Document Recognition

← Back to document page

Gradient-Based Learning Appliedto Document RecognitionYANN LECUN,MEMBER, IEEE,L EON BOTTOU, YOSHUA BENGIO,ANDPATRICK HAFFNERInvited PaperMultilayer neural networks trained with the back-propagationalgorithm constitute the best example of a successful Gradient-Based Learning technique. Given an appropriate networkarchitecture, Gradient-Based Learning algorithms can be usedto synthesize a complex decision surface that can classifyhigh-dimensional patterns, such as handwritten characters, withminimal preprocessing. This paper reviews various methodsapplied to handwritten character Recognition and compares themon a standard handwritten digit Recognition task. Convolutionalneural networks, which are specifically designed to deal withthe variability of two dimensional (2-D) shapes, are shown tooutperform all other Document Recognition systems are composed of multiplemodules including field extraction, segmentation, Recognition ,and language modeling.

produce immediate feedback as the user writes. The core of the system is a convolutional NN. The results clearly ... average of the errors over a set of labeled examples called the training set In the ... The general problem of minimizing a function with respect to a set of parameters is at the root of many

  User, Errors, Minimizing