about
MixNet: Mixed Depthwise Convolutional Kernels (arxiv.org)
22 points by asparagui on Jul 24, 2019 | hide | past | pdf | 1 comment on HN

In plain words: A depthwise convolution normally scans an image with one filter size; this design mixes several sizes in one layer to catch both fine and coarse detail. Swapped into MobileNets, it beat MobileNetV2 by 4.2 points on ImageNet while staying fast enough for phones.

Abstract · MixConv: Mixed Depthwise Convolutional Kernels

Depthwise convolution is becoming increasingly popular in modern efficient ConvNets, but its kernel size is often overlooked. In this paper, we systematically study the impact of different kernel sizes, and observe that combining the benefits of multiple kernel sizes can lead to better accuracy and efficiency. Based on this observation, we propose a new mixed depthwise convolution (MixConv), which naturally mixes up multiple kernel sizes in a single convolution. As a simple drop-in replacement of vanilla depthwise convolution, our MixConv improves the accuracy and efficiency for existing MobileNets on both ImageNet classification and COCO object detection. To demonstrate the effectiveness of MixConv, we integrate it into AutoML search space and develop a new family of models, named as MixNets, which outperform previous mobile models including MobileNetV2 [20] (ImageNet top-1 accuracy +4.2%), ShuffleNetV2 [16] (+3.5%), MnasNet [26] (+1.3%), ProxylessNAS [2] (+2.2%), and FBNet [27] (+2.0%). In particular, our MixNet-L achieves a new state-of-the-art 78.9% ImageNet top-1 accuracy under typical mobile settings (<600M FLOPS). Code is at https://github.com/ tensorflow/tpu/tree/master/models/official/mnasnet/mixnet

Mingxing Tan, Quoc V. Le
arXiv:1907.09595 · cs.CV, cs.LG · submitted Jul 22, 2019 · updated Dec 1, 2019
abstract · pdf · html · BMVC 2019

add comment on HN

Love it when the code is presented up and center as in Figure 3!