REMoDNaV: robust eye-movement classification for dynamic stimulation.
Asim H DarAdina S WagnerMichael HankePublished in: Behavior research methods (2021)
Tracking of eye movements is an established measurement for many types of experimental paradigms. More complex and more prolonged visual stimuli have made algorithmic approaches to eye-movement event classification the most pragmatic option. A recent analysis revealed that many current algorithms are lackluster when it comes to data from viewing dynamic stimuli such as video sequences. Here we present an event classification algorithm-built on an existing velocity-based approach-that is suitable for both static and dynamic stimulation, and is capable of classifying saccades, post-saccadic oscillations, fixations, and smooth pursuit events. We validated classification performance and robustness on three public datasets: 1) manually annotated, trial-based gaze trajectories for viewing static images, moving dots, and short video sequences, 2) lab-quality gaze recordings for a feature-length movie, and 3) gaze recordings acquired under suboptimal lighting conditions inside the bore of a magnetic resonance imaging (MRI) scanner for the same full-length movie. We found that the proposed algorithm performs on par or better compared to state-of-the-art alternatives for static stimulation. Moreover, it yields eye-movement events with biologically plausible characteristics on prolonged dynamic recordings. Lastly, algorithm performance is robust on data acquired under suboptimal conditions that exhibit a temporally varying noise level. These results indicate that the proposed algorithm is a robust tool with improved classification accuracy across a range of use cases. The algorithm is cross-platform compatible, implemented using the Python programming language, and readily available as free and open-source software from public sources.
Keyphrases
- deep learning
- machine learning
- artificial intelligence
- magnetic resonance imaging
- big data
- convolutional neural network
- healthcare
- electronic health record
- mental health
- clinical trial
- depressive symptoms
- contrast enhanced
- drinking water
- emergency department
- randomized controlled trial
- autism spectrum disorder
- high throughput
- single cell
- air pollution
- diffusion weighted imaging
- genetic diversity
- neural network
- image quality
- molecularly imprinted