Transcription of Recurrent Neural Network for Text Classification with ...
{{id}} {{{paragraph}}}
Recurrent Neural Network for TextClassification with Multi-Task LearningPengfei Liu Xipeng Qiu Xuanjing HuangShanghai Key Laboratory of Intelligent Information Processing, Fudan UniversitySchool of Computer Science, Fudan University825 Zhangheng Road, Shanghai, Network based methods have obtained greatprogress on a variety of natural language process-ing tasks. However, in most previous works, themodels are learned based on single-task super-vised objectives, which often suffer from insuffi-cient training data. In this paper, we use the multi-task learning framework to jointly learn across mul-tiple related tasks. Based on Recurrent Neural net-work, we propose three different mechanisms ofsharing information to model text with task-specificand shared layers.
Long short-term memory network (LSTM) was proposed by [Hochreiter and Schmidhuber, 1997] to specifically ad-dress this issue of learning long-term dependencies. The LSTM maintains a separate memory cell inside it that up-dates and exposes its content only when deemed necessary. A number of minor modifications to the standard LSTM unit have ...
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document:
{{id}} {{{paragraph}}}