Login / Signup

Anti-distortion bioinspired camera with an inhomogeneous photo-pixel array.

Changsoon ChoiHenry HintonHyojin SeungSehui ChangJi Su KimWoosang YouMin Sung KimJung Pyo HongJung-Ah LimDo Kyung HwangGil Ju LeeHouk JangYoung Min SongDae-Hyeong KimDonhee Ham
Published in: Nature communications (2024)
The bioinspired camera, comprising a single lens and a curved image sensor-a photodiode array on a curved surface-, was born of flexible electronics. Its economical build lends itself well to space-constrained machine vision applications. The curved sensor, much akin to the retina, helps image focusing, but the curvature also creates a problem of image distortion, which can undermine machine vision tasks such as object recognition. Here we report an anti-distortion single-lens camera, where 4096 silicon photodiodes arrayed on a curved surface in a nonuniform pattern assimilated to the distorting optics are the key to anti-distortion engineering. That is, the photo-pixel distribution pattern itself is warped in the same manner as images are warped, which correctively reverses distortion. Acquired images feature no appreciable distortion across a 120° horizontal view, as confirmed by their neural-network recognition accuracies. This distortion correction via photo-pixel array reconfiguration is a form of in-sensor computing.
Keyphrases
  • deep learning
  • convolutional neural network
  • neural network
  • high resolution
  • high throughput
  • working memory
  • mass spectrometry
  • optical coherence tomography
  • electron transfer
  • gestational age
  • single cell
  • visible light