Login / Signup

Multimodal Approach to Assess a Virtual Reality-based Surgical Training Platform.

Doga DemirelHasan Onur KelesChinmoy ModakKubranur Kara BasturkJacob R BarkerTansel Halic
Published in: Virtual, augmented and mixed reality : 15th International Conference, VAMR 2023, held as part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23-28, 2023, proceedings. VAMR (Conference) (15th : 2023 : Cope... (2023)
Virtual reality (VR) can bring numerous benefits to the learning process. Combining a VR environment with physiological sensors can be beneficial in skill assessment. We aim to investigate trainees' physiological (ECG) and behavioral differences during the virtual reality-based surgical training environment. Our finding showed a significant association between the VR-Score and all participants' total NASA-TLX workload score. The extent of the NASA-TLX workload score was negatively correlated with VR-Score (R 2 =0.15, P < 0.03). In time-domain ECG analysis, we found that RMSSD (R 2 =0.16, P < 0.05) and pNN50 (R 2 =0.15, P < 0.05) scores correlated with significantly higher VR-score of all participants. In this study, we used SVM (linear kernel) and Logistic Regression classification techniques to classify the participants as gamers and non-gamers using data from VR headsets. Both SVM and Logistic Regression accurately classified the participants as gamers and non-gamers with 83% accuracy. For both SVM and Linear Regression, precision was noted as 88%, recall as 83%, and f1-score as 83%. There is increasing interest in characterizing trainees' physiological and behavioral activity profiles in a VR environment, aiming to develop better training and assessment methodologies.
Keyphrases
  • virtual reality
  • heart rate variability
  • heart rate
  • primary care
  • electronic health record
  • artificial intelligence