Login / Signup

Frequency-encoded eye tracking smart contact lens for human-machine interaction.

Hengtian ZhuHuan YangSiqi XuYuanyuan MaShugeng ZhuZhengyi MaoWeiwei ChenZizhong HuRongrong PanYurui XuYifeng XiongYe ChenYan-Qing LuXing-Hai NingDe-Chen JiangSongtao YuanFei Xu
Published in: Nature communications (2024)
Eye tracking techniques enable high-efficient, natural, and effortless human-machine interaction by detecting users' eye movements and decoding their attention and intentions. Here, a miniature, imperceptible, and biocompatible smart contact lens is proposed for in situ eye tracking and wireless eye-machine interaction. Employing the frequency encoding strategy, the chip-free and battery-free lens successes in detecting eye movement and closure. Using a time-sequential eye tracking algorithm, the lens has a great angular accuracy of <0.5°, which is even less than the vision range of central fovea. Multiple eye-machine interaction applications, such as eye-drawing, Gluttonous Snake game, web interaction, pan-tilt-zoom camera control, and robot vehicle control, are demonstrated on the eye movement model and in vivo rabbit. Furthermore, comprehensive biocompatibility tests are implemented, demonstrating low cytotoxicity and low eye irritation. Thus, the contact lens is expected to enrich approaches of eye tracking techniques and promote the development of human-machine interaction technology.
Keyphrases
  • endothelial cells
  • deep learning
  • high throughput
  • mass spectrometry
  • circulating tumor cells
  • neural network