Auditory cortex tracks both auditory and visual stimulus dynamics using low-frequency neuronal phase modulation

Huan Luo, Zuxiang Liu, David Poeppel

Research output: Contribution to journalArticle

Abstract

Integrating information across sensory domains to construct a unified representation of multi-sensory signals is a fundamental characteristic of perception in ecological contexts. One provocative hypothesis deriving from neurophysiology suggests that there exists early and direct cross-modal phase modulation. We provide evidence, based on magnetoencephalography (MEG) recordings from participants viewing audiovisual movies, that low-frequency neuronal information lies at the basis of the synergistic coordination of information across auditory and visual streams. In particular, the phase of the 2-7 Hz delta and theta band responses carries robust (in single trials) and usable information (for parsing the temporal structure) about stimulus dynamics in both sensory modalities concurrently. These experiments are the first to show in humans that a particular cortical mechanism, delta-theta phase modulation across early sensory areas, plays an important "active" role in continuously tracking naturalistic audio-visual streams, carrying dynamic multi-sensory information, and reflecting cross-sensory interaction in real time.

Original languageEnglish (US)
Pages (from-to)25-26
Number of pages2
JournalPLoS Biology
Volume8
Issue number8
DOIs
StatePublished - Aug 2010

Fingerprint

Auditory Cortex
Phase modulation
cortex
Magnetoencephalography
Neurophysiology
Delta modulation
audiovisuals
Motion Pictures
neurophysiology
Experiments

ASJC Scopus subject areas

  • Agricultural and Biological Sciences(all)
  • Biochemistry, Genetics and Molecular Biology(all)
  • Immunology and Microbiology(all)
  • Neuroscience(all)

Cite this

Auditory cortex tracks both auditory and visual stimulus dynamics using low-frequency neuronal phase modulation. / Luo, Huan; Liu, Zuxiang; Poeppel, David.

In: PLoS Biology, Vol. 8, No. 8, 08.2010, p. 25-26.

Research output: Contribution to journalArticle

@article{6c119b6d514e4e3bb336e8b668ae7c44,
title = "Auditory cortex tracks both auditory and visual stimulus dynamics using low-frequency neuronal phase modulation",
abstract = "Integrating information across sensory domains to construct a unified representation of multi-sensory signals is a fundamental characteristic of perception in ecological contexts. One provocative hypothesis deriving from neurophysiology suggests that there exists early and direct cross-modal phase modulation. We provide evidence, based on magnetoencephalography (MEG) recordings from participants viewing audiovisual movies, that low-frequency neuronal information lies at the basis of the synergistic coordination of information across auditory and visual streams. In particular, the phase of the 2-7 Hz delta and theta band responses carries robust (in single trials) and usable information (for parsing the temporal structure) about stimulus dynamics in both sensory modalities concurrently. These experiments are the first to show in humans that a particular cortical mechanism, delta-theta phase modulation across early sensory areas, plays an important {"}active{"} role in continuously tracking naturalistic audio-visual streams, carrying dynamic multi-sensory information, and reflecting cross-sensory interaction in real time.",
author = "Huan Luo and Zuxiang Liu and David Poeppel",
year = "2010",
month = "8",
doi = "10.1371/journal.pbio.1000445",
language = "English (US)",
volume = "8",
pages = "25--26",
journal = "PLoS Biology",
issn = "1544-9173",
publisher = "Public Library of Science",
number = "8",

}

TY - JOUR

T1 - Auditory cortex tracks both auditory and visual stimulus dynamics using low-frequency neuronal phase modulation

AU - Luo, Huan

AU - Liu, Zuxiang

AU - Poeppel, David

PY - 2010/8

Y1 - 2010/8

N2 - Integrating information across sensory domains to construct a unified representation of multi-sensory signals is a fundamental characteristic of perception in ecological contexts. One provocative hypothesis deriving from neurophysiology suggests that there exists early and direct cross-modal phase modulation. We provide evidence, based on magnetoencephalography (MEG) recordings from participants viewing audiovisual movies, that low-frequency neuronal information lies at the basis of the synergistic coordination of information across auditory and visual streams. In particular, the phase of the 2-7 Hz delta and theta band responses carries robust (in single trials) and usable information (for parsing the temporal structure) about stimulus dynamics in both sensory modalities concurrently. These experiments are the first to show in humans that a particular cortical mechanism, delta-theta phase modulation across early sensory areas, plays an important "active" role in continuously tracking naturalistic audio-visual streams, carrying dynamic multi-sensory information, and reflecting cross-sensory interaction in real time.

AB - Integrating information across sensory domains to construct a unified representation of multi-sensory signals is a fundamental characteristic of perception in ecological contexts. One provocative hypothesis deriving from neurophysiology suggests that there exists early and direct cross-modal phase modulation. We provide evidence, based on magnetoencephalography (MEG) recordings from participants viewing audiovisual movies, that low-frequency neuronal information lies at the basis of the synergistic coordination of information across auditory and visual streams. In particular, the phase of the 2-7 Hz delta and theta band responses carries robust (in single trials) and usable information (for parsing the temporal structure) about stimulus dynamics in both sensory modalities concurrently. These experiments are the first to show in humans that a particular cortical mechanism, delta-theta phase modulation across early sensory areas, plays an important "active" role in continuously tracking naturalistic audio-visual streams, carrying dynamic multi-sensory information, and reflecting cross-sensory interaction in real time.

UR - http://www.scopus.com/inward/record.url?scp=79952108257&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79952108257&partnerID=8YFLogxK

U2 - 10.1371/journal.pbio.1000445

DO - 10.1371/journal.pbio.1000445

M3 - Article

VL - 8

SP - 25

EP - 26

JO - PLoS Biology

JF - PLoS Biology

SN - 1544-9173

IS - 8

ER -