Deep Learning for Automatic Vision-Based Recognition of Industrial Surface Defects: A Survey
Глубокое обучение для автоматического распознавания промышленных поверхностных дефектов на основе машинного зрения: обзор
2023-01-01
SCID: 54.1/bbcbgefd
Discuss with AI
deep learningdefect detection and classificationexplainable artificial intelligenceindustrial surface defect inspectiontransfer learning
Figures from the paper
Abstract (AI)
Automatic vision-based inspection systems have played a key role in product quality assessment for decades through the segmentation, detection, and classification of defects. Historically, machine learning frameworks, based on hand-crafted feature extraction, selection, and validation, counted on a combined approach of parameterized image processing algorithms and explicated human knowledge. The outstanding performance of deep learning (DL) for vision systems, in automatically discovering a feature representation suitable for the corresponding task, has exponentially increased the number of scientific articles and commercial products aiming at industrial quality assessment. In such a context, this article reviews more than 220 relevant articles from the related literature published until February 2023, covering the recent consolidation and advances in the field of fully-automatic DL-based surface defects inspection systems, deployed in various industrial applications. The analyzed papers have been classified according to a bi-dimensional taxonomy, that considers both the specific defect recognition task and the employed learning paradigm. The dependency on large and high-quality labeled datasets and the different neural architectures employed to achieve an overall perception of both well-visible and subtle defects, through the supervision of fine or/and coarse data annotations have been assessed. The results of our analysis highlight a growing research interest in defect representation power enrichment, especially by transferring pre-trained layers to an optimized network and by explaining the network decisions to suggest trustworthy retention or rejection of the products being evaluated.
Key Findings
1
Deep learning reduces reliance on hand-crafted features by automatically learning representations for defect segmentation, detection, and classification.
2
It introduces a two-dimensional taxonomy classifying research by defect-recognition task and learning paradigm.
3
Large, high-quality labeled datasets remain a major dependency for deep-learning-based industrial inspection systems.
4
Research increasingly focuses on enriching defect representations through transfer learning and explaining model decisions to support trustworthy product acceptance or rejection.
5
The reviewed systems address both clearly visible and subtle defects using neural architectures supervised by fine-grained and/or coarse annotations.
6
The survey reviews more than 220 publications through February 2023 on fully automatic deep-learning-based industrial surface-defect inspection.
Research Object
fully automatic deep-learning-based vision inspection systems for industrial surface defects
Research Subject
surface-defect recognition tasks, learning paradigms, data and neural-architecture requirements, and defect-representation and decision-explanation capabilities
Publication Details
Publication Date
2023-01-01
Journal
Publisher
ISSN
Cited by
178
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai18
Deep Residual Learning for Image Recognition2016
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews2021
ImageNet classification with deep convolutional neural networks2017
Very Deep Convolutional Networks for Large-Scale Image Recognition2014
ImageNet: A large-scale hierarchical image database2009
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows2021
Rethinking the Inception Architecture for Computer Vision2016
Distilling the Knowledge in a Neural Network2015
Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks2017
Generative adversarial networks2020
A survey on Image Data Augmentation for Deep Learning2019
A Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI2020
A survey on semi-supervised learning2019
State of the Art in Defect Detection Based on Machine Vision2021
Visual-Based Defect Detection and Classification Approaches for Industrial Applications—A SURVEY2020
MSFT-YOLO: Improved YOLOv5 Based on Transformer for Detecting Defects of Steel Surface2022
Automated defect detection in digital radiography of aerospace welds using deep learning2022
A Multi-Modal Distributed Real-Time IoT System for Urban Traffic Control (Invited Paper)2024