Automated data processing and feature engineering for deep learning and big data applications: A survey

Автоматическая обработка данных и конструирование признаков для приложений глубокого обучения и больших данных: обзор
Alhassan Mumuni, Fuseini Mumuni
2024-01-08

automated data processingautomated machine learningdata augmentationdeep learning pipelinesfeature engineering
Modern approach to artificial intelligence (AI) aims to design algorithms that learn directly from data. This approach has achieved impressive results and has contributed significantly to the progress of AI, particularly in the sphere of supervised deep learning. It has also simplified the design of machine learning systems as the learning process is highly automated. However, not all data processing tasks in conventional deep learning pipelines have been automated. In most cases data has to be manually collected, preprocessed and further extended through data augmentation before they can be effective for training. Recently, special techniques for automating these tasks have emerged. The automation of data processing tasks is driven by the need to utilize large volumes of complex, heterogeneous data for machine learning and big data applications. Today, end-to-end automated data processing systems based on automated machine learning (AutoML) techniques are capable of taking raw data and transforming them into useful features for Big Data tasks by automating all intermediate processing stages. In this work, we present a thorough review of approaches for automating data processing tasks in deep learning pipelines, including automated data preprocessing– e.g., data cleaning, labeling, missing data imputation, and categorical data encoding–as well as data augmentation (including synthetic data generation using generative AI methods) and feature engineering–specifically, automated feature extraction, feature construction and feature selection. In addition to automating specific data processing tasks, we discuss the use of AutoML methods and tools to simultaneously optimize all stages of the machine learning pipeline.
1
AutoML systems can transform raw data into useful features for Big Data applications by jointly optimizing all machine-learning pipeline stages.
2
It organizes automated feature engineering into feature extraction, feature construction, and feature selection.
3
It reviews automated preprocessing methods for data cleaning, labeling, missing-data imputation, and categorical-data encoding.
4
The paper covers data augmentation approaches, including synthetic data generation with generative AI methods, for complex and heterogeneous datasets.
5
The survey examines automation of previously manual deep-learning data-processing stages, including collection, preprocessing, augmentation, and feature engineering.

automated data processing systems and deep learning pipelines for Big Data applications

automation and joint optimization of data preprocessing, data augmentation, and feature engineering across machine learning pipelines

Publication Details
Publication Date
2024-01-08
Journal
Publisher
ISSN
Cited by
163
Access Type
Author Information
Authors
Alhassan Mumuni
Fuseini Mumuni
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%