DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses

DECAF: мультимодальная база данных на основе МЭГ для декодирования аффективных физиологических реакций
Nicu Sebe, Paolo Avesani, Ioannis Patras, Ramanathan Subramanian, Mojtaba Khomami Abadi, Seyed Mostafa Kia
2015-01-15

DECAF multimodal datasetaffective physiological responsesdynamic emotion predictionmagnetoencephalography (MEG)single-trial emotion classification
In this work, we present DECAF-a multimodal data set for decoding user physiological responses to affective multimedia content. Different from data sets such as DEAP [15] and MAHNOB-HCI [31], DECAF contains (1) brain signals acquired using the Magnetoencephalogram (MEG) sensor, which requires little physical contact with the user's scalp and consequently facilitates naturalistic affective response, and (2) explicit and implicit emotional responses of 30 participants to 40 one-minute music video segments used in [15] and 36 movie clips, thereby enabling comparisons between the EEG versus MEG modalities as well as movie versus music stimuli for affect recognition. In addition to MEG data, DECAF comprises synchronously recorded near-infra-red (NIR) facial videos, horizontal Electrooculogram (hEOG), Electrocardiogram (ECG), and trapezius-Electromyogram (tEMG) peripheral physiological responses. To demonstrate DECAF's utility, we present (i) a detailed analysis of the correlations between participants' self-assessments and their physiological responses and (ii) single-trial classification results for valence, arousal and dominance, with performance evaluation against existing data sets. DECAF also contains time-continuous emotion annotations for movie clips from seven users, which we use to demonstrate dynamic emotion prediction.
1
DECAF includes explicit and implicit emotional responses, enabling comparisons between EEG and MEG modalities and between movie and music stimuli.
2
DECAF introduces a multimodal affective-response dataset containing MEG recordings from 30 participants exposed to music videos and movie clips.
3
The authors analyze correlations between self-reported affect and physiological responses and evaluate single-trial classification of valence, arousal, and dominance against existing datasets.
4
The dataset combines MEG with synchronized NIR facial video, horizontal EOG, ECG, and trapezius EMG peripheral signals.
5
Time-continuous emotion annotations from seven users support demonstrations of dynamic emotion prediction for movie clips.

DECAF multimodal physiological-response dataset, comprising MEG, facial-video, hEOG, ECG, and tEMG recordings from participants exposed to affective music videos and movie clips

Decoding and characterization of affective physiological responses, including their correlations with self-assessed emotions and classification/prediction of valence, arousal, dominance, and dynamic emotion

Publication Details
Publication Date
2015-01-15
Journal
Publisher
ISSN
Cited by
375
Access Type
Author Information
Authors
Nicu Sebe
Paolo Avesani
Ioannis Patras
Ramanathan Subramanian
Mojtaba Khomami Abadi
Seyed Mostafa Kia
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%