The neural representation of facial-emotion categories reflects conceptual structure

Jeffrey A. Brooks, Junichi Chikazoe, Norihiro Sadato, Jonathan Freeman

Research output: Contribution to journalArticle

Abstract

Humans reliably categorize configurations of facial actions into specific emotion categories, leading some to argue that this process is invariant between individuals and cultures. However, growing behavioral evidence suggests that factors such as emotion-concept knowledge may shape the way emotions are visually perceived, leading to variability—rather than universality—in facial-emotion perception. Understanding variability in emotion perception is only emerging, and the neural basis of any impact from the structure of emotion-concept knowledge remains unknown. In a neuroimaging study, we used a representational similarity analysis (RSA) approach to measure the correspondence between the conceptual, perceptual, and neural representational structures of the six emotion categories Anger, Disgust, Fear, Happiness, Sadness, and Surprise. We found that subjects exhibited individual differences in their conceptual structure of emotions, which predicted their own unique perceptual structure. When viewing faces, the representational structure of multivoxel patterns in the right fusiform gyrus was significantly predicted by a subject’s unique conceptual structure, even when controlling for potential physical similarity in the faces themselves. Finally, cross-cultural differences in emotion perception were also observed, which could be explained by individual differences in conceptual structure. Our results suggest that the representational structure of emotion expressions in visual face-processing regions may be shaped by idiosyncratic conceptual understanding of emotion categories.

Original languageEnglish (US)
Pages (from-to)15861-15870
Number of pages10
JournalProceedings of the National Academy of Sciences of the United States of America
Volume116
Issue number32
DOIs
StatePublished - Aug 6 2019

Fingerprint

Emotions
Individuality
Happiness
Anger
Temporal Lobe
Neuroimaging
Fear

Keywords

  • Conceptual knowledge
  • Emotion perception
  • Facial expressions
  • Functional magnetic resonance imaging
  • Fusiform gyrus

ASJC Scopus subject areas

  • General

Cite this

The neural representation of facial-emotion categories reflects conceptual structure. / Brooks, Jeffrey A.; Chikazoe, Junichi; Sadato, Norihiro; Freeman, Jonathan.

In: Proceedings of the National Academy of Sciences of the United States of America, Vol. 116, No. 32, 06.08.2019, p. 15861-15870.

Research output: Contribution to journalArticle

@article{bbf38501066148e8b9cee89236d2a280,
title = "The neural representation of facial-emotion categories reflects conceptual structure",
abstract = "Humans reliably categorize configurations of facial actions into specific emotion categories, leading some to argue that this process is invariant between individuals and cultures. However, growing behavioral evidence suggests that factors such as emotion-concept knowledge may shape the way emotions are visually perceived, leading to variability—rather than universality—in facial-emotion perception. Understanding variability in emotion perception is only emerging, and the neural basis of any impact from the structure of emotion-concept knowledge remains unknown. In a neuroimaging study, we used a representational similarity analysis (RSA) approach to measure the correspondence between the conceptual, perceptual, and neural representational structures of the six emotion categories Anger, Disgust, Fear, Happiness, Sadness, and Surprise. We found that subjects exhibited individual differences in their conceptual structure of emotions, which predicted their own unique perceptual structure. When viewing faces, the representational structure of multivoxel patterns in the right fusiform gyrus was significantly predicted by a subject’s unique conceptual structure, even when controlling for potential physical similarity in the faces themselves. Finally, cross-cultural differences in emotion perception were also observed, which could be explained by individual differences in conceptual structure. Our results suggest that the representational structure of emotion expressions in visual face-processing regions may be shaped by idiosyncratic conceptual understanding of emotion categories.",
keywords = "Conceptual knowledge, Emotion perception, Facial expressions, Functional magnetic resonance imaging, Fusiform gyrus",
author = "Brooks, {Jeffrey A.} and Junichi Chikazoe and Norihiro Sadato and Jonathan Freeman",
year = "2019",
month = "8",
day = "6",
doi = "10.1073/pnas.1816408116",
language = "English (US)",
volume = "116",
pages = "15861--15870",
journal = "Proceedings of the National Academy of Sciences of the United States of America",
issn = "0027-8424",
number = "32",

}

TY - JOUR

T1 - The neural representation of facial-emotion categories reflects conceptual structure

AU - Brooks, Jeffrey A.

AU - Chikazoe, Junichi

AU - Sadato, Norihiro

AU - Freeman, Jonathan

PY - 2019/8/6

Y1 - 2019/8/6

N2 - Humans reliably categorize configurations of facial actions into specific emotion categories, leading some to argue that this process is invariant between individuals and cultures. However, growing behavioral evidence suggests that factors such as emotion-concept knowledge may shape the way emotions are visually perceived, leading to variability—rather than universality—in facial-emotion perception. Understanding variability in emotion perception is only emerging, and the neural basis of any impact from the structure of emotion-concept knowledge remains unknown. In a neuroimaging study, we used a representational similarity analysis (RSA) approach to measure the correspondence between the conceptual, perceptual, and neural representational structures of the six emotion categories Anger, Disgust, Fear, Happiness, Sadness, and Surprise. We found that subjects exhibited individual differences in their conceptual structure of emotions, which predicted their own unique perceptual structure. When viewing faces, the representational structure of multivoxel patterns in the right fusiform gyrus was significantly predicted by a subject’s unique conceptual structure, even when controlling for potential physical similarity in the faces themselves. Finally, cross-cultural differences in emotion perception were also observed, which could be explained by individual differences in conceptual structure. Our results suggest that the representational structure of emotion expressions in visual face-processing regions may be shaped by idiosyncratic conceptual understanding of emotion categories.

AB - Humans reliably categorize configurations of facial actions into specific emotion categories, leading some to argue that this process is invariant between individuals and cultures. However, growing behavioral evidence suggests that factors such as emotion-concept knowledge may shape the way emotions are visually perceived, leading to variability—rather than universality—in facial-emotion perception. Understanding variability in emotion perception is only emerging, and the neural basis of any impact from the structure of emotion-concept knowledge remains unknown. In a neuroimaging study, we used a representational similarity analysis (RSA) approach to measure the correspondence between the conceptual, perceptual, and neural representational structures of the six emotion categories Anger, Disgust, Fear, Happiness, Sadness, and Surprise. We found that subjects exhibited individual differences in their conceptual structure of emotions, which predicted their own unique perceptual structure. When viewing faces, the representational structure of multivoxel patterns in the right fusiform gyrus was significantly predicted by a subject’s unique conceptual structure, even when controlling for potential physical similarity in the faces themselves. Finally, cross-cultural differences in emotion perception were also observed, which could be explained by individual differences in conceptual structure. Our results suggest that the representational structure of emotion expressions in visual face-processing regions may be shaped by idiosyncratic conceptual understanding of emotion categories.

KW - Conceptual knowledge

KW - Emotion perception

KW - Facial expressions

KW - Functional magnetic resonance imaging

KW - Fusiform gyrus

UR - http://www.scopus.com/inward/record.url?scp=85070224158&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85070224158&partnerID=8YFLogxK

U2 - 10.1073/pnas.1816408116

DO - 10.1073/pnas.1816408116

M3 - Article

C2 - 31332015

AN - SCOPUS:85070224158

VL - 116

SP - 15861

EP - 15870

JO - Proceedings of the National Academy of Sciences of the United States of America

JF - Proceedings of the National Academy of Sciences of the United States of America

SN - 0027-8424

IS - 32

ER -