PDF4PRO ⚡AMP

Modern search engine that looking for books and documents around the web

Example: confidence

arXiv:1402.1128v1 [cs.NE] 5 Feb 2014

LONG SHORT-TERM memory BASED RECURRENT NEURAL NETWORK. ARCHITECTURES FOR LARGE VOCABULARY SPEECH RECOGNITION. Has im Sak, Andrew Senior, Franc oise Beaufays Google ABSTRACT architecture of LSTMs contained special units called memory blocks [ ] 5 Feb 2014. in the recurrent hidden layer. The memory blocks contain memory Long Short-Term memory (LSTM) is a recurrent neural network cells with self-connections storing (remembering) the temporal state (RNN) architecture that has been designed to address the vanish- of the network in addition to special multiplicative units called gates ing and exploding gradient problems of conventional RNNs.

memory block, ignoring the biases, can be calculated as follows: W= n c n c 4 + n i n c 4 + n c n o + n c 3 where n c is the number of memory cells (and number of memory blocks in this case), n i is the number of input units, and n o is the number of output units. The computational complexity of learning LSTM models per weight and time step ...

Tags:

  Memory

Information

Domain:

Source:

Link to this page:

Please notify us if you found a problem with this document:

Spam in document Broken preview Other abuse

Transcription of arXiv:1402.1128v1 [cs.NE] 5 Feb 2014

Related search queries