Transcription of Introduction to Convolutional Neural Networks
{{id}} {{{paragraph}}}
Introduction to Convolutional Neural NetworksJianxin WuLAMDA GroupNational Key Lab for Novel Software TechnologyNanjing University, 1, 2017 Contents1 Introduction22 Tensor and vectorization .. Vector calculus and the chain rule ..43 CNN in a The architecture .. The forward run .. Stochastic gradient descent (SGD) .. Error back propagation ..84 Layer input, output and notations95 The ReLU layer106 The convolution What is convolution? .. Why to convolve? .. Convolution as matrix product .. The Kronecker product .. Backward propagation: update the parameters .. Even higher dimensional indicator matrices .. Backward propagation: prepare supervision signal for the previ-ous layer .. Fully connected layer as a convolution layer .. 227 The pooling layer2318 A case study: the VGG-16 VGG-Verydeep-16.
converts a matrix into a column vector in the column- rst order. An example is: A= 1 2 3 4 ; A(:) = (1;3;2;4)T = 2 6 6 4 1 3 2 4 3 7 7 5: (1) In mathematics, we use ...
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document:
{{id}} {{{paragraph}}}