Visual input enhances selective speech envelope tracking in auditory cortex at a "Cocktail Party"

Elana Zion Golumbic, Gregory B. Cogan, Charles E. Schroeder, David Poeppel

Research output: Contribution to journalArticle

Abstract

Our ability to selectively attend to one auditory signal amid competing input streams, epitomized by the "Cocktail Party" problem, continues to stimulate research from various approaches. How this demanding perceptual feat is achieved from a neural systems perspective remains unclear and controversial. It is well established that neural responses to attended stimuli are enhanced compared with responses to ignored ones, but responses to ignored stimuli are nonetheless highly significant, leading to interference in performance. Weinvestigated whether congruent visual input of an attended speaker enhances cortical selectivity in auditory cortex, leading to diminished representation of ignored stimuli.Werecorded magnetoencephalographic signals from human participants as they attended to segments of natural continuous speech. Using two complementary methods of quantifying the neural response to speech, we found that viewing a speaker's face enhances the capacity of auditory cortex to track the temporal speech envelope of that speaker. This mechanism was most effective in a Cocktail Party setting, promoting preferential tracking of the attended speaker, whereas without visual input no significant attentional modulation was observed. These neurophysiological results underscore the importance of visual input in resolving perceptual ambiguity in a noisy environment. Since visual cues in speech precede the associated auditory signals, they likely serve a predictive role in facilitating auditory processing of speech, perhaps by directing attentional resources to appropriate points in time when to-be-attended acoustic input is expected to arrive.

Original languageEnglish (US)
Pages (from-to)1417-1426
Number of pages10
JournalJournal of Neuroscience
Volume33
Issue number4
DOIs
StatePublished - Jan 23 2013

Fingerprint

Auditory Cortex
Aptitude
Acoustics
Cues
Research

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Visual input enhances selective speech envelope tracking in auditory cortex at a "Cocktail Party". / Zion Golumbic, Elana; Cogan, Gregory B.; Schroeder, Charles E.; Poeppel, David.

In: Journal of Neuroscience, Vol. 33, No. 4, 23.01.2013, p. 1417-1426.

Research output: Contribution to journalArticle

Zion Golumbic, Elana ; Cogan, Gregory B. ; Schroeder, Charles E. ; Poeppel, David. / Visual input enhances selective speech envelope tracking in auditory cortex at a "Cocktail Party". In: Journal of Neuroscience. 2013 ; Vol. 33, No. 4. pp. 1417-1426.
@article{4ad8d2add83d4fa680873ffeaac01fc8,
title = "Visual input enhances selective speech envelope tracking in auditory cortex at a {"}Cocktail Party{"}",
abstract = "Our ability to selectively attend to one auditory signal amid competing input streams, epitomized by the {"}Cocktail Party{"} problem, continues to stimulate research from various approaches. How this demanding perceptual feat is achieved from a neural systems perspective remains unclear and controversial. It is well established that neural responses to attended stimuli are enhanced compared with responses to ignored ones, but responses to ignored stimuli are nonetheless highly significant, leading to interference in performance. Weinvestigated whether congruent visual input of an attended speaker enhances cortical selectivity in auditory cortex, leading to diminished representation of ignored stimuli.Werecorded magnetoencephalographic signals from human participants as they attended to segments of natural continuous speech. Using two complementary methods of quantifying the neural response to speech, we found that viewing a speaker's face enhances the capacity of auditory cortex to track the temporal speech envelope of that speaker. This mechanism was most effective in a Cocktail Party setting, promoting preferential tracking of the attended speaker, whereas without visual input no significant attentional modulation was observed. These neurophysiological results underscore the importance of visual input in resolving perceptual ambiguity in a noisy environment. Since visual cues in speech precede the associated auditory signals, they likely serve a predictive role in facilitating auditory processing of speech, perhaps by directing attentional resources to appropriate points in time when to-be-attended acoustic input is expected to arrive.",
author = "{Zion Golumbic}, Elana and Cogan, {Gregory B.} and Schroeder, {Charles E.} and David Poeppel",
year = "2013",
month = "1",
day = "23",
doi = "10.1523/JNEUROSCI.3675-12.2013",
language = "English (US)",
volume = "33",
pages = "1417--1426",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "4",

}

TY - JOUR

T1 - Visual input enhances selective speech envelope tracking in auditory cortex at a "Cocktail Party"

AU - Zion Golumbic, Elana

AU - Cogan, Gregory B.

AU - Schroeder, Charles E.

AU - Poeppel, David

PY - 2013/1/23

Y1 - 2013/1/23

N2 - Our ability to selectively attend to one auditory signal amid competing input streams, epitomized by the "Cocktail Party" problem, continues to stimulate research from various approaches. How this demanding perceptual feat is achieved from a neural systems perspective remains unclear and controversial. It is well established that neural responses to attended stimuli are enhanced compared with responses to ignored ones, but responses to ignored stimuli are nonetheless highly significant, leading to interference in performance. Weinvestigated whether congruent visual input of an attended speaker enhances cortical selectivity in auditory cortex, leading to diminished representation of ignored stimuli.Werecorded magnetoencephalographic signals from human participants as they attended to segments of natural continuous speech. Using two complementary methods of quantifying the neural response to speech, we found that viewing a speaker's face enhances the capacity of auditory cortex to track the temporal speech envelope of that speaker. This mechanism was most effective in a Cocktail Party setting, promoting preferential tracking of the attended speaker, whereas without visual input no significant attentional modulation was observed. These neurophysiological results underscore the importance of visual input in resolving perceptual ambiguity in a noisy environment. Since visual cues in speech precede the associated auditory signals, they likely serve a predictive role in facilitating auditory processing of speech, perhaps by directing attentional resources to appropriate points in time when to-be-attended acoustic input is expected to arrive.

AB - Our ability to selectively attend to one auditory signal amid competing input streams, epitomized by the "Cocktail Party" problem, continues to stimulate research from various approaches. How this demanding perceptual feat is achieved from a neural systems perspective remains unclear and controversial. It is well established that neural responses to attended stimuli are enhanced compared with responses to ignored ones, but responses to ignored stimuli are nonetheless highly significant, leading to interference in performance. Weinvestigated whether congruent visual input of an attended speaker enhances cortical selectivity in auditory cortex, leading to diminished representation of ignored stimuli.Werecorded magnetoencephalographic signals from human participants as they attended to segments of natural continuous speech. Using two complementary methods of quantifying the neural response to speech, we found that viewing a speaker's face enhances the capacity of auditory cortex to track the temporal speech envelope of that speaker. This mechanism was most effective in a Cocktail Party setting, promoting preferential tracking of the attended speaker, whereas without visual input no significant attentional modulation was observed. These neurophysiological results underscore the importance of visual input in resolving perceptual ambiguity in a noisy environment. Since visual cues in speech precede the associated auditory signals, they likely serve a predictive role in facilitating auditory processing of speech, perhaps by directing attentional resources to appropriate points in time when to-be-attended acoustic input is expected to arrive.

UR - http://www.scopus.com/inward/record.url?scp=84872703974&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84872703974&partnerID=8YFLogxK

U2 - 10.1523/JNEUROSCI.3675-12.2013

DO - 10.1523/JNEUROSCI.3675-12.2013

M3 - Article

C2 - 23345218

AN - SCOPUS:84872703974

VL - 33

SP - 1417

EP - 1426

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 4

ER -