Dense Contrastive Learning for Self-Supervised Visual Pre ...

What Have We Learned From Deep Representations for …

what these powerful models actually have learned. In this paper we shed light on deep spatiotemporal net-works by visualizing what excites the learned models us-ing activation maximization by backpropagating on the in-put. We are the first to visualize the hierarchical features

  What, Have, Learned, What we have learned, Have learned

Finding Tiny Faces in the Wild With Generative Adversarial ...

faces, which are unfriendly for the face classifier. Toward-s this end, we design a refinement sub-network to recover some detailed information. In the discriminator network, the basic GAN [17, 12, 8] is trained to distinguish the real and fake high resolution images. To classify faces or non-

  Faces

Squeeze-and-Excitation Networks - openaccess.thecvf.com

Squeeze-and-Excitation Networks Jie Hu1∗ Li Shen2∗ Gang Sun1 hujie@momenta.ai lishen@robots.ox.ac.uk sungang@momenta.ai 1 Momenta 2 Department of Engineering Science, University of Oxford Abstract Convolutional neural networks are built upon the con-

  Network, Excitation, Squeeze and excitation networks, Squeeze

RegularFace: Deep Face Recognition via Exclusive ...

RegularFace: Deep Face Recognition via Exclusive Regularization Kai Zhao Jingyi Xu Ming-Ming Cheng ∗ TKLNDST, CS, Nankai University kaiz.xyz@gmail.com cmm@nankai.edu.cn

  Zhao

Protecting World Leaders Against Deep Fakes

Protecting World Leaders Against Deep Fakes Shruti Agarwal and Hany Farid University of California, Berkeley Berkeley CA, USA {shrutiagarwal, hfarid}@berkeley.edu

Auto-DeepLab: Hierarchical Neural Architecture Search for ...

Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation Chenxi Liu1∗, Liang-Chieh Chen 2, Florian Schroff2, Hartwig Adam2, Wei Hua2, Alan Yuille1, Li Fei-Fei3 1Johns Hopkins University 2Google 3Stanford University Abstract Recently, NeuralArchitectureSearch(NAS)hassuccess-

PointNet: Deep Learning on Point Sets ... - CVF Open Access

PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation Charles R. Qi* Hao Su* Kaichun Mo Leonidas J. Guibas Stanford University

  Open, Learning, Points, Deep, Sets, Pointnet, Deep learning on point sets

Frustum PointNets for 3D Object Detection From RGB-D Data

Frustum PointNets for 3D Object Detection from RGB-D Data Charles R. Qi1∗ Wei Liu2 Chenxia Wu2 Hao Su3 Leonidas J. Guibas1 1Stanford University 2Nuro, Inc. 3UC San Diego Abstract In this work, we study 3D object detection from RGB-D data in both indoor and outdoor scenes.

Class-Balanced Loss Based on Effective Number of Samples

and large-scale datasets including ImageNet and iNatural-ist. Our results show that when trained with the proposed class-balanced loss, the network is able to achieve signifi-cant performance gains on long-tailed datasets. 1. Introduction The recent success of deep Convolutional Neural Net-works (CNNs) for visual recognition [26, 37, 38, 16] owes

  Scale, Visual, Recognition, Visual recognition

ESRGAN: Enhanced Super-Resolution Generative Adversarial ...

ESRGAN: EnhancedSuper-Resolution Generative Adversarial Networks Xintao Wang 1, Ke Yu , Shixiang Wu2, Jinjin Gu3, Yihao Liu4, Chao Dong 2, Yu Qiao , and Chen Change Loy5 1 CUHK-SenseTime Joint Lab, The Chinese University of Hong Kong 2 Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences 3 The Chinese University of Hong Kong, …

  Network, Adversarial, Generative, Generative adversarial, Generative adversarial networks

An Empirical Study of Training Self-Supervised Vision ...

Self-supervised visual representation learning. In com-puter vision, contrastive learning [19] has become increas-ingly successful for self-supervised learning, e.g., [45,34, 22,2,20,10]. The methodology is to learn representa-tions that attract similar (positive) samples and dispel dif-ferent (negative) samples. The representations from con-

  Learning, Visual, Contrastive, Contrastive learning

A Simple Framework for Contrastive Learning of Visual ...

A Simple Framework for Contrastive Learning of Visual Representations Algorithm 1 SimCLR’s main learning algorithm. input: batch size N, constant ˝, structure of f, g, T. for sampled minibatch fx kgN k=1 do for all k2f1;:::;Ngdo draw two augmentation functions t˘T, t0˘T # the first augmentation x~ 2k 1 = t(x k) h 2k 1 = f(x~ 2k 1 ...

  Framework, Learning, Simple, Visual, Contrastive, Simple framework for contrastive learning of visual

DetCo: Unsupervised Contrastive Learning for Object Detection

In this work, we present DetCo, which is a contrastive learning framework beneficial for instance-level detection tasks while maintaining competitive image classification transfer accuracy. DetCo contains (1) multi-level supervi-sion on features from different stages of the backbone net-work. (2) contrastive learning between global image and

  Framework, Learning, Contrastive, Contrastive learning, Contrastive learning framework