Effective Approaches to Attention-based Neural Machine ...

based models: a global approach in which all sourcewordsareattended andalocal onewhereby only a subset of source words are considered at a time. The former approach resembles the model of (Bahdanau et al., 2015) but is simpler architec-turally. The latter can be viewed as an interesting blend between the hard and soft attention models

  Based, Model, Attention, Model based, Attention models