Xception: Deep Learning with Depthwise Separable Convolutions
Xception: Глубокое обучение с глубинно-разделяемыми свертками
2016-10-07
SCID: 54.1/q9pzqbqn
Discuss with AI
ImageNetInception V3Inception modulesXceptiondepthwise separable convolution
Figures from the paper
Abstract (AI)
We present an interpretation of Inception modules in convolutional neural networks as being an intermediate step in-between regular convolution and the depthwise separable convolution operation (a depthwise convolution followed by a pointwise convolution). In this light, a depthwise separable convolution can be understood as an Inception module with a maximally large number of towers. This observation leads us to propose a novel deep convolutional neural network architecture inspired by Inception, where Inception modules have been replaced with depthwise separable convolutions. We show that this architecture, dubbed Xception, slightly outperforms Inception V3 on the ImageNet dataset (which Inception V3 was designed for), and significantly outperforms Inception V3 on a larger image classification dataset comprising 350 million images and 17,000 classes. Since the Xception architecture has the same number of parameters as Inception V3, the performance gains are not due to increased capacity but rather to a more efficient use of model parameters.
Key Findings
1
Depthwise separable convolution is equivalent to an Inception module with a maximally large number of towers.
2
Interprets Inception modules as an intermediate between regular convolution and depthwise separable convolution.
3
Proposes Xception: an architecture replacing Inception modules with depthwise separable convolutions.
4
Xception achieves these gains with the same number of parameters as Inception V3, indicating more efficient parameter usage rather than increased capacity.
5
Xception significantly outperforms Inception V3 on a larger dataset of 350 million images and 17,000 classes.
6
Xception slightly outperforms Inception V3 on the ImageNet dataset.
Research Object
Xception deep convolutional neural network architecture (using depthwise separable convolutions)
Research Subject
Comparison of performance and parameter-efficiency of Xception versus Inception V3 for large-scale image classification (ImageNet and a 350M-image, 17k-class dataset), attributing gains to more efficient use of model parameters
Publication Details
Publication Date
2016-10-07
Journal
Publisher
ISSN
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest