An Integrated Electroencephalography and Eye-Tracking Analysis Using eXtreme Gradient Boosting for Mental Workload Evaluation in Surgery

Интегрированный анализ электроэнцефалографии и отслеживания движений глаз с использованием экстремального градиентного бустинга для оценки умственной нагрузки при выполнении хирургических задач
Somayeh B. Shafiei, Saeed Shadpour, James Lloyd Mohler
2024-09-26

eXtreme Gradient Boosting (XGBoost)electroencephalographyeye trackingmental workload evaluationsurgical task analysis
Objective We aimed to develop advanced machine learning models using electroencephalogram (EEG) and eye-tracking data to predict the mental workload associated with engaging in various surgical tasks. Background Traditional methods of evaluating mental workload often involve self-report scales, which are subject to individual biases. Due to the multidimensional nature of mental workload, there is a pressing need to identify factors that contribute to mental workload across different surgical tasks. Method EEG and eye-tracking data from 26 participants performing Matchboard and Ring Walk tasks from the da Vinci simulator and the pattern cut and suturing tasks from the Fundamentals of Laparoscopic Surgery (FLS) program were used to develop an eXtreme Gradient Boosting (XGBoost) model for mental workload evaluation. Results The developed XGBoost models demonstrated strong predictive performance with R 2 values of 0.82, 0.81, 0.82, and 0.83 for the Matchboard, Ring Walk, pattern cut, and suturing tasks, respectively. Key features for predicting mental workload included task average pupil diameter, complexity level, average functional connectivity strength at the temporal lobe, and the total trajectory length of the nondominant eye’s pupil. Integrating features from both EEG and eye-tracking data significantly enhanced the performance of mental workload evaluation models, as evidenced by repeated-measures t-tests yielding p -values less than 0.05. However, this enhancement was not observed in the Pattern Cut task (repeated-measures t-tests; p > 0.05). Conclusion The findings underscore the potential for machine learning and multidimensional feature integration to predict mental workload and thereby improve task design and surgical training. Application The advanced mental workload prediction models could serve as instrumental tools to enhance our understanding of surgeons’ cognitive demands and significantly improve the effectiveness of surgical training programs.
1
An XGBoost model integrating EEG and eye-tracking data predicted mental workload across four surgical tasks with R² values of 0.81–0.83.
2
Combining EEG and eye-tracking features significantly improved workload-evaluation performance for most tasks, with repeated-measures t-tests showing p < 0.05.
3
Important workload-predictive features included average pupil diameter, task complexity, temporal-lobe functional connectivity strength, and nondominant-eye pupil trajectory length.
4
The evaluated tasks included Matchboard, Ring Walk, pattern cutting, and suturing performed in robotic and laparoscopic simulators by 26 participants.
5
The multimodal integration improvement was not significant for the Pattern Cut task, where repeated-measures t-tests yielded p > 0.05.

Participants performing simulated surgical tasks from the da Vinci simulator and Fundamentals of Laparoscopic Surgery program

Mental workload associated with different surgical tasks and its prediction from integrated EEG and eye-tracking features

Publication Details
Publication Date
2024-09-26
Journal
Publisher
ISSN
Access Type
Author Information
Authors
Somayeh B. Shafiei
Saeed Shadpour
James Lloyd Mohler
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%