Multi-voxel patterns of visual category representation during episodic encoding are predictive of subsequent memory

Brice A. Kuhl, Jesse Rissman, Anthony D. Wagner

Research output: Contribution to journalArticle

Abstract

Successful encoding of episodic memories is thought to depend on contributions from prefrontal and temporal lobe structures. Neural processes that contribute to successful encoding have been extensively explored through univariate analyses of neuroimaging data that compare mean activity levels elicited during the encoding of events that are subsequently remembered vs. those subsequently forgotten. Here, we applied pattern classification to fMRI data to assess the degree to which distributed patterns of activity within prefrontal and temporal lobe structures elicited during the encoding of word-image pairs were diagnostic of the visual category (Face or Scene) of the encoded image. We then assessed whether representation of category information was predictive of subsequent memory. Classification analyses indicated that temporal lobe structures contained information robustly diagnostic of visual category. Information in prefrontal cortex was less diagnostic of visual category, but was nonetheless associated with highly reliable classifier-based evidence for category representation. Critically, trials associated with greater classifier-based estimates of category representation in temporal and prefrontal regions were associated with a higher probability of subsequent remembering. Finally, consideration of trial-by-trial variance in classifier-based measures of category representation revealed positive correlations between prefrontal and temporal lobe representations, with the strength of these correlations varying as a function of the category of image being encoded. Together, these results indicate that multi-voxel representations of encoded information can provide unique insights into how visual experiences are transformed into episodic memories.

Original languageEnglish (US)
Pages (from-to)458-469
Number of pages12
JournalNeuropsychologia
Volume50
Issue number4
DOIs
StatePublished - Mar 2012

Fingerprint

Temporal Lobe
Episodic Memory
Prefrontal Cortex
Neuroimaging
Magnetic Resonance Imaging
Encoding
Diagnostics
Classifier

Keywords

  • Category selectivity
  • Encoding
  • Episodic memory
  • FMRI
  • Pattern classification
  • Prefrontal cortex

ASJC Scopus subject areas

  • Behavioral Neuroscience
  • Cognitive Neuroscience
  • Experimental and Cognitive Psychology
  • Arts and Humanities (miscellaneous)

Cite this

Multi-voxel patterns of visual category representation during episodic encoding are predictive of subsequent memory. / Kuhl, Brice A.; Rissman, Jesse; Wagner, Anthony D.

In: Neuropsychologia, Vol. 50, No. 4, 03.2012, p. 458-469.

Research output: Contribution to journalArticle

Kuhl, Brice A. ; Rissman, Jesse ; Wagner, Anthony D. / Multi-voxel patterns of visual category representation during episodic encoding are predictive of subsequent memory. In: Neuropsychologia. 2012 ; Vol. 50, No. 4. pp. 458-469.
@article{dc7b2764b4d34c37b9d57da949bad61e,
title = "Multi-voxel patterns of visual category representation during episodic encoding are predictive of subsequent memory",
abstract = "Successful encoding of episodic memories is thought to depend on contributions from prefrontal and temporal lobe structures. Neural processes that contribute to successful encoding have been extensively explored through univariate analyses of neuroimaging data that compare mean activity levels elicited during the encoding of events that are subsequently remembered vs. those subsequently forgotten. Here, we applied pattern classification to fMRI data to assess the degree to which distributed patterns of activity within prefrontal and temporal lobe structures elicited during the encoding of word-image pairs were diagnostic of the visual category (Face or Scene) of the encoded image. We then assessed whether representation of category information was predictive of subsequent memory. Classification analyses indicated that temporal lobe structures contained information robustly diagnostic of visual category. Information in prefrontal cortex was less diagnostic of visual category, but was nonetheless associated with highly reliable classifier-based evidence for category representation. Critically, trials associated with greater classifier-based estimates of category representation in temporal and prefrontal regions were associated with a higher probability of subsequent remembering. Finally, consideration of trial-by-trial variance in classifier-based measures of category representation revealed positive correlations between prefrontal and temporal lobe representations, with the strength of these correlations varying as a function of the category of image being encoded. Together, these results indicate that multi-voxel representations of encoded information can provide unique insights into how visual experiences are transformed into episodic memories.",
keywords = "Category selectivity, Encoding, Episodic memory, FMRI, Pattern classification, Prefrontal cortex",
author = "Kuhl, {Brice A.} and Jesse Rissman and Wagner, {Anthony D.}",
year = "2012",
month = "3",
doi = "10.1016/j.neuropsychologia.2011.09.002",
language = "English (US)",
volume = "50",
pages = "458--469",
journal = "Neuropsychologia",
issn = "0028-3932",
publisher = "Elsevier Limited",
number = "4",

}

TY - JOUR

T1 - Multi-voxel patterns of visual category representation during episodic encoding are predictive of subsequent memory

AU - Kuhl, Brice A.

AU - Rissman, Jesse

AU - Wagner, Anthony D.

PY - 2012/3

Y1 - 2012/3

N2 - Successful encoding of episodic memories is thought to depend on contributions from prefrontal and temporal lobe structures. Neural processes that contribute to successful encoding have been extensively explored through univariate analyses of neuroimaging data that compare mean activity levels elicited during the encoding of events that are subsequently remembered vs. those subsequently forgotten. Here, we applied pattern classification to fMRI data to assess the degree to which distributed patterns of activity within prefrontal and temporal lobe structures elicited during the encoding of word-image pairs were diagnostic of the visual category (Face or Scene) of the encoded image. We then assessed whether representation of category information was predictive of subsequent memory. Classification analyses indicated that temporal lobe structures contained information robustly diagnostic of visual category. Information in prefrontal cortex was less diagnostic of visual category, but was nonetheless associated with highly reliable classifier-based evidence for category representation. Critically, trials associated with greater classifier-based estimates of category representation in temporal and prefrontal regions were associated with a higher probability of subsequent remembering. Finally, consideration of trial-by-trial variance in classifier-based measures of category representation revealed positive correlations between prefrontal and temporal lobe representations, with the strength of these correlations varying as a function of the category of image being encoded. Together, these results indicate that multi-voxel representations of encoded information can provide unique insights into how visual experiences are transformed into episodic memories.

AB - Successful encoding of episodic memories is thought to depend on contributions from prefrontal and temporal lobe structures. Neural processes that contribute to successful encoding have been extensively explored through univariate analyses of neuroimaging data that compare mean activity levels elicited during the encoding of events that are subsequently remembered vs. those subsequently forgotten. Here, we applied pattern classification to fMRI data to assess the degree to which distributed patterns of activity within prefrontal and temporal lobe structures elicited during the encoding of word-image pairs were diagnostic of the visual category (Face or Scene) of the encoded image. We then assessed whether representation of category information was predictive of subsequent memory. Classification analyses indicated that temporal lobe structures contained information robustly diagnostic of visual category. Information in prefrontal cortex was less diagnostic of visual category, but was nonetheless associated with highly reliable classifier-based evidence for category representation. Critically, trials associated with greater classifier-based estimates of category representation in temporal and prefrontal regions were associated with a higher probability of subsequent remembering. Finally, consideration of trial-by-trial variance in classifier-based measures of category representation revealed positive correlations between prefrontal and temporal lobe representations, with the strength of these correlations varying as a function of the category of image being encoded. Together, these results indicate that multi-voxel representations of encoded information can provide unique insights into how visual experiences are transformed into episodic memories.

KW - Category selectivity

KW - Encoding

KW - Episodic memory

KW - FMRI

KW - Pattern classification

KW - Prefrontal cortex

UR - http://www.scopus.com/inward/record.url?scp=82955236691&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=82955236691&partnerID=8YFLogxK

U2 - 10.1016/j.neuropsychologia.2011.09.002

DO - 10.1016/j.neuropsychologia.2011.09.002

M3 - Article

VL - 50

SP - 458

EP - 469

JO - Neuropsychologia

JF - Neuropsychologia

SN - 0028-3932

IS - 4

ER -