Real-Time Workload Estimation Using Eye Tracking: A Bayesian Inference Approach

Оценка рабочей нагрузки в реальном времени с использованием отслеживания взгляда: подход на основе байесовского вывода
Paramsothy Jayakumar, Ruikun Luo, Yifan Weng, Mark Brudnak, Victor Paul, Vishnu R. Desaraju, Jeffrey L. Stein, Tulga Ersal, X. Jessie Yang
2023-05-04

Bayesian inference modeleye trackinggaze trajectorypupil size changereal-time workload estimation
Workload management is a critical concern in shared control of unmanned ground vehicles. In response to this challenge, prior studies have developed methods to estimate human operators’ workload by analyzing their physiological data. However, these studies have primarily adopted a single-model-single-feature or a single-model-multiple-feature approach. The present study proposes a Bayesian inference model to estimate workload, which leverages different machine learning models for different features. We conducted a human subject experiment with 24 participants, in which a human operator teleoperated a simulated High Mobility Multipurpose Wheeled Vehicle (HMMWV) with the help from an autonomy while performing a surveillance task simultaneously. Participants’ eye-related features, including gaze trajectory and pupil size change, were used as the physiological input to the proposed Bayesian inference model. Results show that the Bayesian inference model achieves a 0.823 F1 score, 0.824 precision, and 0.821 recall, outperforming the single models.
1
A Bayesian inference model was proposed to estimate operator workload by combining different machine learning models for different eye-tracking features.
2
In a human-subject experiment with 24 participants teleoperating a simulated HMMWV during a surveillance task, the Bayesian model achieved an F1 score of 0.823.
3
The Bayesian inference model achieved precision 0.824 and recall 0.821, outperforming single-model approaches.
4
The model uses eye-related features—gaze trajectory and pupil size change—as physiological inputs for real-time workload estimation.

Human operators teleoperating a simulated High Mobility Multipurpose Wheeled Vehicle (HMMWV) while performing a surveillance task, with their eye-related physiological data recorded

Real-time estimation of operator workload from eye-related features (gaze trajectory and pupil size change) using a Bayesian inference model that combines different machine learning models per feature

Publication Details
Publication Date
2023-05-04
Journal
Publisher
ISSN
Cited by
12
Access Type
Author Information
Authors
Paramsothy Jayakumar
Ruikun Luo
Yifan Weng
Mark Brudnak
Victor Paul
Vishnu R. Desaraju
Jeffrey L. Stein
Tulga Ersal
X. Jessie Yang
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%