DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses
DECAF: мультимодальная база данных на основе МЭГ для декодирования аффективных физиологических реакций
2015-01-15
SCID: 54.1/uavdpf87
Discuss with AI
DECAF multimodal datasetaffective physiological responsesdynamic emotion predictionmagnetoencephalography (MEG)single-trial emotion classification
Figures from the paper
Abstract (AI)
In this work, we present DECAF-a multimodal data set for decoding user physiological responses to affective multimedia content. Different from data sets such as DEAP [15] and MAHNOB-HCI [31], DECAF contains (1) brain signals acquired using the Magnetoencephalogram (MEG) sensor, which requires little physical contact with the user's scalp and consequently facilitates naturalistic affective response, and (2) explicit and implicit emotional responses of 30 participants to 40 one-minute music video segments used in [15] and 36 movie clips, thereby enabling comparisons between the EEG versus MEG modalities as well as movie versus music stimuli for affect recognition. In addition to MEG data, DECAF comprises synchronously recorded near-infra-red (NIR) facial videos, horizontal Electrooculogram (hEOG), Electrocardiogram (ECG), and trapezius-Electromyogram (tEMG) peripheral physiological responses. To demonstrate DECAF's utility, we present (i) a detailed analysis of the correlations between participants' self-assessments and their physiological responses and (ii) single-trial classification results for valence, arousal and dominance, with performance evaluation against existing data sets. DECAF also contains time-continuous emotion annotations for movie clips from seven users, which we use to demonstrate dynamic emotion prediction.
Key Findings
1
DECAF includes explicit and implicit emotional responses, enabling comparisons between EEG and MEG modalities and between movie and music stimuli.
2
DECAF introduces a multimodal affective-response dataset containing MEG recordings from 30 participants exposed to music videos and movie clips.
3
The authors analyze correlations between self-reported affect and physiological responses and evaluate single-trial classification of valence, arousal, and dominance against existing datasets.
4
The dataset combines MEG with synchronized NIR facial video, horizontal EOG, ECG, and trapezius EMG peripheral signals.
5
Time-continuous emotion annotations from seven users support demonstrations of dynamic emotion prediction for movie clips.
Research Object
DECAF multimodal physiological-response dataset, comprising MEG, facial-video, hEOG, ECG, and tEMG recordings from participants exposed to affective music videos and movie clips
Research Subject
Decoding and characterization of affective physiological responses, including their correlations with self-assessed emotions and classification/prediction of valence, arousal, dominance, and dynamic emotion
Publication Details
Publication Date
2015-01-15
Journal
Publisher
ISSN
Cited by
375
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest