A survey on Image Data Augmentation for Deep Learning
Обзор методов аугментации изображений для глубокого обучения
2019-07-06
SCID: 54.1/556v5keu
Discuss with AI
deep convolutional neural networksgenerative adversarial networksimage data augmentationmedical image analysistest-time augmentation
Figures from the paper
Abstract (AI)
Deep convolutional neural networks have performed remarkably well on many Computer Vision tasks. However, these networks are heavily reliant on big data to avoid overfitting. Overfitting refers to the phenomenon when a network learns a function with very high variance such as to perfectly model the training data. Unfortunately, many application domains do not have access to big data, such as medical image analysis. This survey focuses on Data Augmentation, a data-space solution to the problem of limited data. Data Augmentation encompasses a suite of techniques that enhance the size and quality of training datasets such that better Deep Learning models can be built using them. The image augmentation algorithms discussed in this survey include geometric transformations, color space augmentations, kernel filters, mixing images, random erasing, feature space augmentation, adversarial training, generative adversarial networks, neural style transfer, and meta-learning. The application of augmentation methods based on GANs are heavily covered in this survey. In addition to augmentation techniques, this paper will briefly discuss other characteristics of Data Augmentation such as test-time augmentation, resolution impact, final dataset size, and curriculum learning. This survey will present existing methods for Data Augmentation, promising developments, and meta-level decisions for implementing Data Augmentation. Readers will understand how Data Augmentation can improve the performance of their models and expand limited datasets to take advantage of the capabilities of big data.
Key Findings
1
Data augmentation is presented as a data-space solution for reducing overfitting when deep convolutional networks are trained on limited datasets.
2
GAN-based augmentation methods receive particular emphasis because they can expand limited image datasets with synthetic training examples.
3
The paper synthesizes promising augmentation developments and practical decisions for improving deep learning models, especially in data-constrained domains such as medical imaging.
4
The survey categorizes image augmentation methods including geometric and color transformations, filtering, image mixing, random erasing, feature-space augmentation, adversarial training, GANs, style transfer, and meta-learning.
5
The survey examines implementation factors beyond augmentation techniques, including test-time augmentation, image resolution, final dataset size, and curriculum learning.
Research Object
Image data augmentation techniques for deep learning training datasets
Research Subject
techniques, applications, and meta-level factors for expanding and improving limited training datasets and enhancing deep learning model performance
Publication Details
Publication Date
2019-07-06
Journal
Publisher
ISSN
Cited by
13101
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai11
ImageNet classification with deep convolutional neural networks2017
Very Deep Convolutional Networks for Large-Scale Image Recognition2014
ImageNet: A large-scale hierarchical image database2009
Gradient-based learning applied to document recognition1998
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network2017
Unsupervised Representation Learning with Deep Convolutional Generative\n Adversarial Networks2015
A survey of transfer learning2016
Least Squares Generative Adversarial Networks2017
Albumentations: Fast and Flexible Image Augmentations2020
Deep Residual Learning for Image Recognition2016
Distributed Representations of Words and Phrases and their Compositionality2013
Cited by20
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions2021
Albumentations: Fast and Flexible Image Augmentations2020
Text Data Augmentation for Deep Learning2021
A survey of uncertainty in deep neural networks2023
Artificial intelligence in the creative industries: a review2021
AI applications to medical images: From machine learning to deep learning2021
Transparency and reproducibility in artificial intelligence2020
Artificial intelligence and machine learning for medical imaging: A technology review2021
Hyperspectral Image Classification—Traditional to Deep Models: A Survey for Future Prospects2021
State-of-the-art augmented NLP transformer models for direct and single-step retrosynthesis2020
A survey on data‐efficient algorithms in big data era2021
A Review of Machine Learning and Deep Learning for Object Detection, Semantic Segmentation, and Human Action Recognition in Machine and Robotic Vision2024
Augmenting organizational decision-making with deep learning algorithms: Principles, promises, and challenges2020
Computational approaches to Explainable Artificial Intelligence: Advances in theory, applications and trends2023
A Review of Practical AI for Remote Sensing in Earth Sciences2023
Symmetry prediction and knowledge discovery from X-ray diffraction patterns using an interpretable machine learning approach2020
An overview of 3D printed metal implants in orthopedic applications: Present and future perspectives2023
Unmanned aerial vehicle-based computer vision for structural vibration measurement and condition assessment: A concise survey2023
Synthetic data in generalizable, learning-based neuroimaging2024