Transcription of Sequence to Sequence Learning with Neural Networks
{{id}} {{{paragraph}}}
Example: biology
Sequence to Sequence Learning with Neural Networks
[ ] 14 Dec 2014 Sequence to Sequence Learningwith Neural NetworksIlya V. Neural Networks (DNNs) are powerful models that have achieved excel-lent performance on difficult Learning tasks. Although DNNswork well wheneverlarge labeled training sets are available, they cannot be used to map sequences tosequences. In this paper, we present a general end-to-end approach to sequencelearning that makes minimal assumptions on the Sequence structure. Our methoduses a multilayered Long Short-Term Memory (LSTM) to map theinput sequenceto a vector of a fixed dimensionality, and then another deep LSTM to decode thetarget Sequence from the vector. Our main result is that on anEnglish to Frenchtranslation task from the WMT 14 dataset, the translationsproduced by the LSTM achieve a BLEU score of on the entire test set, where the LSTM s BLEU score was penalized on out-of-vocabulary words.
The simplest strategy for general sequence learning is to map the input sequence to a fixed-sized vector using one RNN, and then to map the vector to the target sequence with another RNN (this approach has also been taken by Cho et al. [5]). While it …
Loading..
Tags:
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: