Human emotion recognition from EEG-based brain–computer interface using machine learning: a comprehensive review

Распознавание эмоций человека на основе интерфейсов мозг–компьютер с использованием ЭЭГ и машинного обучения: всесторонний обзор
Essam Halim Houssein, Abdelmgeid Amin Ali, Asmaa S.A. Hammad
2022-05-07

EEG-based emotion recognitionaffective computingbrain–computer interfacesdeep learningmachine learning
Abstract Affective computing, a subcategory of artificial intelligence, detects, processes, interprets, and mimics human emotions. Thanks to the continued advancement of portable non-invasive human sensor technologies, like brain–computer interfaces (BCI), emotion recognition has piqued the interest of academics from a variety of domains. Facial expressions, speech, behavior (gesture/posture), and physiological signals can all be used to identify human emotions. However, the first three may be ineffectual because people may hide their true emotions consciously or unconsciously (so-called social masking). Physiological signals can provide more accurate and objective emotion recognition. Electroencephalogram (EEG) signals respond in real time and are more sensitive to changes in affective states than peripheral neurophysiological signals. Thus, EEG signals can reveal important features of emotional states. Recently, several EEG-based BCI emotion recognition techniques have been developed. In addition, rapid advances in machine and deep learning have enabled machines or computers to understand, recognize, and analyze emotions. This study reviews emotion recognition methods that rely on multi-channel EEG signal-based BCIs and provides an overview of what has been accomplished in this area. It also provides an overview of the datasets and methods used to elicit emotional states. According to the usual emotional recognition pathway, we review various EEG feature extraction, feature selection/reduction, machine learning methods (e.g., k-nearest neighbor), support vector machine, decision tree, artificial neural network, random forest, and naive Bayes) and deep learning methods (e.g., convolutional and recurrent neural networks with long short term memory). In addition, EEG rhythms that are strongly linked to emotions as well as the relationship between distinct brain areas and emotions are discussed. We also discuss several human emotion recognition studies, published between 2015 and 2021, that use EEG data and compare different machine and deep learning algorithms. Finally, this review suggests several challenges and future research directions in the recognition and classification of human emotional states using EEG.
1
EEG responds in real time and is more sensitive to affective-state changes than peripheral neurophysiological signals, enabling extraction of informative emotional features.
2
EEG-based physiological signals are presented as more objective and potentially accurate for emotion recognition than facial expressions, speech, and behavior vulnerable to social masking.
3
It surveys deep-learning approaches such as convolutional and recurrent neural networks with long short-term memory for EEG emotion recognition.
4
The review summarizes emotion-elicitation datasets, EEG rhythms associated with emotions, and relationships between brain regions and emotional states.
5
The review synthesizes multi-channel EEG-based BCI emotion-recognition methods, including feature extraction, feature selection or reduction, and conventional machine-learning classifiers.

multi-channel EEG-based brain–computer interface emotion recognition systems

methods, features, brain rhythms, and brain-region relationships underlying the recognition and analysis of human emotional states using machine and deep learning

Publication Details
Publication Date
2022-05-07
Journal
Publisher
ISSN
Cited by
470
Access Type
Author Information
Authors
Essam Halim Houssein
Abdelmgeid Amin Ali
Asmaa S.A. Hammad
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%