Transcription of Coordinate Attention for Efficient Mobile Network Design
{{id}} {{{paragraph}}}
Coordinate Attention for Efficient Mobile Network DesignQibin Hou1 Daquan Zhou1 Jiashi Feng2,11 National University of Singapore2 SEA AI studies on Mobile Network Design have demon-strated the remarkable effectiveness of channel atten-tion ( ,the Squeeze-and-Excitation Attention ) for liftingmodel performance, but they generally neglect the posi-tional information, which is important for generating spa-tially selective Attention maps. In this paper, we propose anovel Attention mechanism for Mobile networks by embed-ding positional information into channel Attention , whichwe call Coordinate Attention .
same size to X. To provide a clear description of the pro-posed coordinate attention, we first revisit the SE attention, which is widely used in mobile networks. 3.1. Revisit SqueezeandExcitation Attention As demonstrated in [18], the standard convolution it-self is difficult to model the channel relationships. Explic-
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document:
{{id}} {{{paragraph}}}