A multimodal user interface for touchless control of robotic ultrasound.

Josefine SchreiterTonia MielkeDanny SchottMaximilian ThormannJazan OmariMaciej PechChristian Hansen

Published in: International journal of computer assisted radiology and surgery (2022)

A multimodal, touchless interaction concept for a robotic US for the use case of needle-based procedures in interventional radiology was developed, incorporating combined voice and hand gesture control. Future steps will include the integration of a solution for the missing haptic feedback and the evaluation of its clinical suitability.

Keyphrases

minimally invasive
pain management
ultrasound guided
magnetic resonance imaging
artificial intelligence
current status
virtual reality
machine learning
deep learning