Login / Signup

Computational modeling of human multisensory spatial representation by a neural architecture.

Nicola DomeniciValentina SanguinetiPietro MorerioClaudio CampusAlessio Del BueMonica GoriVittorio Murino
Published in: PloS one (2023)
Our brain constantly combines sensory information in unitary percept to build coherent representations of the environment. Even though this process could appear smooth, integrating sensory inputs from various sensory modalities must overcome several computational issues, such as recoding and statistical inferences problems. Following these assumptions, we developed a neural architecture replicating humans' ability to use audiovisual spatial representations. We considered the well-known ventriloquist illusion as a benchmark to evaluate its phenomenological plausibility. Our model closely replicated human perceptual behavior, proving a truthful approximation of the brain's ability to develop audiovisual spatial representations. Considering its ability to model audiovisual performance in a spatial localization task, we release our model in conjunction with the dataset we recorded for its validation. We believe it will be a powerful tool to model and better understand multisensory integration processes in experimental and rehabilitation environments.
Keyphrases
  • working memory
  • endothelial cells
  • white matter
  • resting state
  • induced pluripotent stem cells
  • blood brain barrier
  • functional connectivity
  • brain injury
  • cerebral ischemia