Xception: Deep Learning with Depthwise Separable Convolutions

Xception: Глубокое обучение с глубинно-разделяемыми свертками
François Chollet
2016-10-07

ImageNetInception V3Inception modulesXceptiondepthwise separable convolution
We present an interpretation of Inception modules in convolutional neural networks as being an intermediate step in-between regular convolution and the depthwise separable convolution operation (a depthwise convolution followed by a pointwise convolution). In this light, a depthwise separable convolution can be understood as an Inception module with a maximally large number of towers. This observation leads us to propose a novel deep convolutional neural network architecture inspired by Inception, where Inception modules have been replaced with depthwise separable convolutions. We show that this architecture, dubbed Xception, slightly outperforms Inception V3 on the ImageNet dataset (which Inception V3 was designed for), and significantly outperforms Inception V3 on a larger image classification dataset comprising 350 million images and 17,000 classes. Since the Xception architecture has the same number of parameters as Inception V3, the performance gains are not due to increased capacity but rather to a more efficient use of model parameters.
1
Depthwise separable convolution is equivalent to an Inception module with a maximally large number of towers.
2
Interprets Inception modules as an intermediate between regular convolution and depthwise separable convolution.
3
Proposes Xception: an architecture replacing Inception modules with depthwise separable convolutions.
4
Xception achieves these gains with the same number of parameters as Inception V3, indicating more efficient parameter usage rather than increased capacity.
5
Xception significantly outperforms Inception V3 on a larger dataset of 350 million images and 17,000 classes.
6
Xception slightly outperforms Inception V3 on the ImageNet dataset.

Xception deep convolutional neural network architecture (using depthwise separable convolutions)

Comparison of performance and parameter-efficiency of Xception versus Inception V3 for large-scale image classification (ImageNet and a 350M-image, 17k-class dataset), attributing gains to more efficient use of model parameters

Publication Details
Publication Date
2016-10-07
Journal
Publisher
ISSN
Access Type
Author Information
Authors
François Chollet
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%