The cortical representation of language timescales is shared between reading and listening.
Catherine ChenTom Dupré la TourJack L GallantDaniel KleinFatma DenizPublished in: Communications biology (2024)
Language comprehension involves integrating low-level sensory inputs into a hierarchy of increasingly high-level features. Prior work studied brain representations of different levels of the language hierarchy, but has not determined whether these brain representations are shared between written and spoken language. To address this issue, we analyze fMRI BOLD data that were recorded while participants read and listened to the same narratives in each modality. Levels of the language hierarchy are operationalized as timescales, where each timescale refers to a set of spectral components of a language stimulus. Voxelwise encoding models are used to determine where different timescales are represented across the cerebral cortex, for each modality separately. These models reveal that between the two modalities timescale representations are organized similarly across the cortical surface. Our results suggest that, after low-level sensory processing, language integration proceeds similarly regardless of stimulus modality.
Keyphrases
- autism spectrum disorder
- resting state
- working memory
- functional connectivity
- white matter
- magnetic resonance imaging
- multiple sclerosis
- computed tomography
- genome wide
- machine learning
- optical coherence tomography
- electronic health record
- subarachnoid hemorrhage
- blood brain barrier
- single molecule
- artificial intelligence
- cerebral ischemia
- neural network