The role of visual representations during the lexical access of spoken words

Gwyneth Lewis, David Poeppel

Research output: Contribution to journalArticle

Abstract

Do visual representations contribute to spoken word recognition? We examine, using MEG, the effects of sublexical and lexical variables at superior temporal (ST) areas and the posterior middle temporal gyrus (pMTG) compared with that of word imageability at visual cortices. Embodied accounts predict early modulation of visual areas by imageability - concurrently with or prior to modulation of pMTG by lexical variables. Participants responded to speech stimuli varying continuously in imageability during lexical decision with simultaneous MEG recording. We employed the linguistic variables in a new type of correlational time course analysis to assess trial-by-trial activation in occipital, ST, and pMTG regions of interest (ROIs). The linguistic variables modulated the ROIs during different time windows. Critically, visual regions reflected an imageability effect prior to effects of lexicality on pMTG. This surprising effect supports a view on which sensory aspects of a lexical item are not a consequence of lexical activation.

Original languageEnglish (US)
Pages (from-to)1-10
Number of pages10
JournalBrain and Language
Volume134
DOIs
StatePublished - 2014

Fingerprint

Temporal Lobe
activation
Linguistics
linguistics
recording
Visual Cortex
stimulus
Visual Representation
Lexical Access
Spoken Word
Imageability
time

Keywords

  • Imageability
  • Lexical access
  • MEG
  • PMTG
  • Speech recognition

ASJC Scopus subject areas

  • Linguistics and Language
  • Speech and Hearing
  • Experimental and Cognitive Psychology
  • Cognitive Neuroscience
  • Language and Linguistics

Cite this

The role of visual representations during the lexical access of spoken words. / Lewis, Gwyneth; Poeppel, David.

In: Brain and Language, Vol. 134, 2014, p. 1-10.

Research output: Contribution to journalArticle

@article{fcb4beeba2be4fb9bb46194e23466a2c,
title = "The role of visual representations during the lexical access of spoken words",
abstract = "Do visual representations contribute to spoken word recognition? We examine, using MEG, the effects of sublexical and lexical variables at superior temporal (ST) areas and the posterior middle temporal gyrus (pMTG) compared with that of word imageability at visual cortices. Embodied accounts predict early modulation of visual areas by imageability - concurrently with or prior to modulation of pMTG by lexical variables. Participants responded to speech stimuli varying continuously in imageability during lexical decision with simultaneous MEG recording. We employed the linguistic variables in a new type of correlational time course analysis to assess trial-by-trial activation in occipital, ST, and pMTG regions of interest (ROIs). The linguistic variables modulated the ROIs during different time windows. Critically, visual regions reflected an imageability effect prior to effects of lexicality on pMTG. This surprising effect supports a view on which sensory aspects of a lexical item are not a consequence of lexical activation.",
keywords = "Imageability, Lexical access, MEG, PMTG, Speech recognition",
author = "Gwyneth Lewis and David Poeppel",
year = "2014",
doi = "10.1016/j.bandl.2014.03.008",
language = "English (US)",
volume = "134",
pages = "1--10",
journal = "Brain and Language",
issn = "0093-934X",
publisher = "Academic Press Inc.",

}

TY - JOUR

T1 - The role of visual representations during the lexical access of spoken words

AU - Lewis, Gwyneth

AU - Poeppel, David

PY - 2014

Y1 - 2014

N2 - Do visual representations contribute to spoken word recognition? We examine, using MEG, the effects of sublexical and lexical variables at superior temporal (ST) areas and the posterior middle temporal gyrus (pMTG) compared with that of word imageability at visual cortices. Embodied accounts predict early modulation of visual areas by imageability - concurrently with or prior to modulation of pMTG by lexical variables. Participants responded to speech stimuli varying continuously in imageability during lexical decision with simultaneous MEG recording. We employed the linguistic variables in a new type of correlational time course analysis to assess trial-by-trial activation in occipital, ST, and pMTG regions of interest (ROIs). The linguistic variables modulated the ROIs during different time windows. Critically, visual regions reflected an imageability effect prior to effects of lexicality on pMTG. This surprising effect supports a view on which sensory aspects of a lexical item are not a consequence of lexical activation.

AB - Do visual representations contribute to spoken word recognition? We examine, using MEG, the effects of sublexical and lexical variables at superior temporal (ST) areas and the posterior middle temporal gyrus (pMTG) compared with that of word imageability at visual cortices. Embodied accounts predict early modulation of visual areas by imageability - concurrently with or prior to modulation of pMTG by lexical variables. Participants responded to speech stimuli varying continuously in imageability during lexical decision with simultaneous MEG recording. We employed the linguistic variables in a new type of correlational time course analysis to assess trial-by-trial activation in occipital, ST, and pMTG regions of interest (ROIs). The linguistic variables modulated the ROIs during different time windows. Critically, visual regions reflected an imageability effect prior to effects of lexicality on pMTG. This surprising effect supports a view on which sensory aspects of a lexical item are not a consequence of lexical activation.

KW - Imageability

KW - Lexical access

KW - MEG

KW - PMTG

KW - Speech recognition

UR - http://www.scopus.com/inward/record.url?scp=84900528446&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84900528446&partnerID=8YFLogxK

U2 - 10.1016/j.bandl.2014.03.008

DO - 10.1016/j.bandl.2014.03.008

M3 - Article

C2 - 24814579

AN - SCOPUS:84900528446

VL - 134

SP - 1

EP - 10

JO - Brain and Language

JF - Brain and Language

SN - 0093-934X

ER -