Compressive temporal summation in human visual cortex

Jingyang Zhou, Noah C. Benson, Kendrick N. Kay, Jonathan Winawer

Research output: Contribution to journalArticle

Abstract

Combining sensory inputs over space and time is fundamental to vision. Population receptive field models have been successful in characterizing spatial encoding throughout the human visual pathways. A parallel question, how visual areas in the human brain process information distributed over time, has received less attention. One challenge is that the most widely used neuroimaging method, fMRI, has coarse temporal resolution compared with the time-scale of neural dynamics. Here, via carefully controlled temporally modulated stimuli, we show that information about temporal processing can be readily derived from fMRI signal amplitudes in male and female subjects. We find that all visual areas exhibit subadditive summation, whereby responses to longer stimuli are less than the linear prediction from briefer stimuli. We also find fMRI evidence that the neural response to two stimuli is reduced for brief interstimulus intervals (indicating adaptation). These effects are more pronounced in visual areas anterior to V1-V3. Finally, we develop a general model that shows how these effects can be captured with two simple operations: temporal summation followed by a compressive nonlinearity. This model operates for arbitrary temporal stimulation patterns and provides a simple and interpretable set of computations that can be used to characterize neural response properties across the visual hierarchy. Importantly, compressive temporal summation directly parallels earlier findings of compressive spatial summation in visual cortex describing responses to stimuli distributed across space. This indicates that, for space and time, cortex uses a similar processing strategy to achieve higher-level and increasingly invariant representations of the visual world.

Original languageEnglish (US)
Pages (from-to)691-709
Number of pages19
JournalJournal of Neuroscience
Volume38
Issue number3
DOIs
StatePublished - Jan 17 2018

Fingerprint

Visual Cortex
Magnetic Resonance Imaging
Visual Pathways
Neuroimaging
Brain

Keywords

  • Adaptation
  • fMRI
  • Population receptive fields
  • Temporal summation
  • Visual cortex
  • Visual hierarchy

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Compressive temporal summation in human visual cortex. / Zhou, Jingyang; Benson, Noah C.; Kay, Kendrick N.; Winawer, Jonathan.

In: Journal of Neuroscience, Vol. 38, No. 3, 17.01.2018, p. 691-709.

Research output: Contribution to journalArticle

Zhou, J, Benson, NC, Kay, KN & Winawer, J 2018, 'Compressive temporal summation in human visual cortex', Journal of Neuroscience, vol. 38, no. 3, pp. 691-709. https://doi.org/10.1523/JNEUROSCI.1724-17.2017
Zhou, Jingyang ; Benson, Noah C. ; Kay, Kendrick N. ; Winawer, Jonathan. / Compressive temporal summation in human visual cortex. In: Journal of Neuroscience. 2018 ; Vol. 38, No. 3. pp. 691-709.
@article{d0e7d429886147f493a927e6eeb90c82,
title = "Compressive temporal summation in human visual cortex",
abstract = "Combining sensory inputs over space and time is fundamental to vision. Population receptive field models have been successful in characterizing spatial encoding throughout the human visual pathways. A parallel question, how visual areas in the human brain process information distributed over time, has received less attention. One challenge is that the most widely used neuroimaging method, fMRI, has coarse temporal resolution compared with the time-scale of neural dynamics. Here, via carefully controlled temporally modulated stimuli, we show that information about temporal processing can be readily derived from fMRI signal amplitudes in male and female subjects. We find that all visual areas exhibit subadditive summation, whereby responses to longer stimuli are less than the linear prediction from briefer stimuli. We also find fMRI evidence that the neural response to two stimuli is reduced for brief interstimulus intervals (indicating adaptation). These effects are more pronounced in visual areas anterior to V1-V3. Finally, we develop a general model that shows how these effects can be captured with two simple operations: temporal summation followed by a compressive nonlinearity. This model operates for arbitrary temporal stimulation patterns and provides a simple and interpretable set of computations that can be used to characterize neural response properties across the visual hierarchy. Importantly, compressive temporal summation directly parallels earlier findings of compressive spatial summation in visual cortex describing responses to stimuli distributed across space. This indicates that, for space and time, cortex uses a similar processing strategy to achieve higher-level and increasingly invariant representations of the visual world.",
keywords = "Adaptation, fMRI, Population receptive fields, Temporal summation, Visual cortex, Visual hierarchy",
author = "Jingyang Zhou and Benson, {Noah C.} and Kay, {Kendrick N.} and Jonathan Winawer",
year = "2018",
month = "1",
day = "17",
doi = "10.1523/JNEUROSCI.1724-17.2017",
language = "English (US)",
volume = "38",
pages = "691--709",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "3",

}

TY - JOUR

T1 - Compressive temporal summation in human visual cortex

AU - Zhou, Jingyang

AU - Benson, Noah C.

AU - Kay, Kendrick N.

AU - Winawer, Jonathan

PY - 2018/1/17

Y1 - 2018/1/17

N2 - Combining sensory inputs over space and time is fundamental to vision. Population receptive field models have been successful in characterizing spatial encoding throughout the human visual pathways. A parallel question, how visual areas in the human brain process information distributed over time, has received less attention. One challenge is that the most widely used neuroimaging method, fMRI, has coarse temporal resolution compared with the time-scale of neural dynamics. Here, via carefully controlled temporally modulated stimuli, we show that information about temporal processing can be readily derived from fMRI signal amplitudes in male and female subjects. We find that all visual areas exhibit subadditive summation, whereby responses to longer stimuli are less than the linear prediction from briefer stimuli. We also find fMRI evidence that the neural response to two stimuli is reduced for brief interstimulus intervals (indicating adaptation). These effects are more pronounced in visual areas anterior to V1-V3. Finally, we develop a general model that shows how these effects can be captured with two simple operations: temporal summation followed by a compressive nonlinearity. This model operates for arbitrary temporal stimulation patterns and provides a simple and interpretable set of computations that can be used to characterize neural response properties across the visual hierarchy. Importantly, compressive temporal summation directly parallels earlier findings of compressive spatial summation in visual cortex describing responses to stimuli distributed across space. This indicates that, for space and time, cortex uses a similar processing strategy to achieve higher-level and increasingly invariant representations of the visual world.

AB - Combining sensory inputs over space and time is fundamental to vision. Population receptive field models have been successful in characterizing spatial encoding throughout the human visual pathways. A parallel question, how visual areas in the human brain process information distributed over time, has received less attention. One challenge is that the most widely used neuroimaging method, fMRI, has coarse temporal resolution compared with the time-scale of neural dynamics. Here, via carefully controlled temporally modulated stimuli, we show that information about temporal processing can be readily derived from fMRI signal amplitudes in male and female subjects. We find that all visual areas exhibit subadditive summation, whereby responses to longer stimuli are less than the linear prediction from briefer stimuli. We also find fMRI evidence that the neural response to two stimuli is reduced for brief interstimulus intervals (indicating adaptation). These effects are more pronounced in visual areas anterior to V1-V3. Finally, we develop a general model that shows how these effects can be captured with two simple operations: temporal summation followed by a compressive nonlinearity. This model operates for arbitrary temporal stimulation patterns and provides a simple and interpretable set of computations that can be used to characterize neural response properties across the visual hierarchy. Importantly, compressive temporal summation directly parallels earlier findings of compressive spatial summation in visual cortex describing responses to stimuli distributed across space. This indicates that, for space and time, cortex uses a similar processing strategy to achieve higher-level and increasingly invariant representations of the visual world.

KW - Adaptation

KW - fMRI

KW - Population receptive fields

KW - Temporal summation

KW - Visual cortex

KW - Visual hierarchy

UR - http://www.scopus.com/inward/record.url?scp=85040828971&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85040828971&partnerID=8YFLogxK

U2 - 10.1523/JNEUROSCI.1724-17.2017

DO - 10.1523/JNEUROSCI.1724-17.2017

M3 - Article

VL - 38

SP - 691

EP - 709

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 3

ER -