Search results with tag "Convo lutions"
Xception: Deep Learning With Depthwise Separable …
openaccess.thecvf.comules and depthwise separable convolutions are also possible: in effect, there is a discrete spectrum between regular convo-lutions and depthwise separable convolutions, parametrized by the number of independent channel-space segments used for performing spatial convolutions. A regular convolution (preceded by a 1x1 convolution), at one extreme ...
Lite-HRNet: A Lightweight High-Resolution Network
openaccess.thecvf.comWe find that the heavily-used pointwise (1 × 1) convo-lutions in shuffle blocks become the computational bottle-neck. We introduce a lightweight unit, conditional chan-nel weighting, to replace costly pointwise (1 × 1) convolu-tions in shuffle blocks. The complexity of channel weight-ing is linear w.r.t the number of channels and lower than
An Empirical Study of Training Self-Supervised Vision ...
arxiv.orgthan interlaced with non-degenerated (i.e., non-1 1) convo-lutions.2 This largely closes the architectural gap between NLP and vision. ViT achieves compelling accuracy in su-pervised learning, especially with large-scale data and high-capacity models. Given these properties, we believe ViT is a must-study baseline for self-supervised learning ...