A survey on Image Data Augmentation for Deep Learning

Обзор методов аугментации изображений для глубокого обучения
Connor Shorten, Taghi M. Khoshgoftaar
2019-07-06

deep convolutional neural networksgenerative adversarial networksimage data augmentationmedical image analysistest-time augmentation
Deep convolutional neural networks have performed remarkably well on many Computer Vision tasks. However, these networks are heavily reliant on big data to avoid overfitting. Overfitting refers to the phenomenon when a network learns a function with very high variance such as to perfectly model the training data. Unfortunately, many application domains do not have access to big data, such as medical image analysis. This survey focuses on Data Augmentation, a data-space solution to the problem of limited data. Data Augmentation encompasses a suite of techniques that enhance the size and quality of training datasets such that better Deep Learning models can be built using them. The image augmentation algorithms discussed in this survey include geometric transformations, color space augmentations, kernel filters, mixing images, random erasing, feature space augmentation, adversarial training, generative adversarial networks, neural style transfer, and meta-learning. The application of augmentation methods based on GANs are heavily covered in this survey. In addition to augmentation techniques, this paper will briefly discuss other characteristics of Data Augmentation such as test-time augmentation, resolution impact, final dataset size, and curriculum learning. This survey will present existing methods for Data Augmentation, promising developments, and meta-level decisions for implementing Data Augmentation. Readers will understand how Data Augmentation can improve the performance of their models and expand limited datasets to take advantage of the capabilities of big data.
1
Data augmentation is presented as a data-space solution for reducing overfitting when deep convolutional networks are trained on limited datasets.
2
GAN-based augmentation methods receive particular emphasis because they can expand limited image datasets with synthetic training examples.
3
The paper synthesizes promising augmentation developments and practical decisions for improving deep learning models, especially in data-constrained domains such as medical imaging.
4
The survey categorizes image augmentation methods including geometric and color transformations, filtering, image mixing, random erasing, feature-space augmentation, adversarial training, GANs, style transfer, and meta-learning.
5
The survey examines implementation factors beyond augmentation techniques, including test-time augmentation, image resolution, final dataset size, and curriculum learning.

Image data augmentation techniques for deep learning training datasets

techniques, applications, and meta-level factors for expanding and improving limited training datasets and enhancing deep learning model performance

Publication Details
Publication Date
2019-07-06
Journal
Publisher
ISSN
Cited by
13101
Access Type
Author Information
Authors
Connor Shorten
Taghi M. Khoshgoftaar
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%