Automatic prediction of frustration

Ashish Kapoor, Winslow Burleson, Rosalind W. Picard

Research output: Contribution to journalArticle

Abstract

Predicting when a person might be frustrated can provide an intelligent system with important information about when to initiate interaction. For example, an automated Learning Companion or Intelligent Tutoring System might use this information to intervene, providing support to the learner who is likely to otherwise quit, while leaving engaged learners free to discover things without interruption. This paper presents the first automated method that assesses, using multiple channels of affect-related information, whether a learner is about to click on a button saying "I'm frustrated." The new method was tested on data gathered from 24 participants using an automated Learning Companion. Their indication of frustration was automatically predicted from the collected data with 79% accuracy (chance = 58 %). The new assessment method is based on Gaussian process classification and Bayesian inference. Its performance suggests that non-verbal channels carrying affective cues can help provide important information to a system for formulating a more intelligent response.

Original languageEnglish (US)
Pages (from-to)724-736
Number of pages13
JournalInternational Journal of Human Computer Studies
Volume65
Issue number8
DOIs
StatePublished - Aug 2007

Fingerprint

Frustration
Intelligent systems
frustration
Information use
Learning
Cues
learning
indication
human being
interaction
performance

Keywords

  • Affect recognition
  • Affective Learning Companion
  • Intelligent Tutoring System
  • Learner state assessment

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Experimental and Cognitive Psychology

Cite this

Automatic prediction of frustration. / Kapoor, Ashish; Burleson, Winslow; Picard, Rosalind W.

In: International Journal of Human Computer Studies, Vol. 65, No. 8, 08.2007, p. 724-736.

Research output: Contribution to journalArticle

Kapoor, Ashish ; Burleson, Winslow ; Picard, Rosalind W. / Automatic prediction of frustration. In: International Journal of Human Computer Studies. 2007 ; Vol. 65, No. 8. pp. 724-736.
@article{536769f9bbcf49d89d827b7ac26321f7,
title = "Automatic prediction of frustration",
abstract = "Predicting when a person might be frustrated can provide an intelligent system with important information about when to initiate interaction. For example, an automated Learning Companion or Intelligent Tutoring System might use this information to intervene, providing support to the learner who is likely to otherwise quit, while leaving engaged learners free to discover things without interruption. This paper presents the first automated method that assesses, using multiple channels of affect-related information, whether a learner is about to click on a button saying {"}I'm frustrated.{"} The new method was tested on data gathered from 24 participants using an automated Learning Companion. Their indication of frustration was automatically predicted from the collected data with 79{\%} accuracy (chance = 58 {\%}). The new assessment method is based on Gaussian process classification and Bayesian inference. Its performance suggests that non-verbal channels carrying affective cues can help provide important information to a system for formulating a more intelligent response.",
keywords = "Affect recognition, Affective Learning Companion, Intelligent Tutoring System, Learner state assessment",
author = "Ashish Kapoor and Winslow Burleson and Picard, {Rosalind W.}",
year = "2007",
month = "8",
doi = "10.1016/j.ijhcs.2007.02.003",
language = "English (US)",
volume = "65",
pages = "724--736",
journal = "International Journal of Human Computer Studies",
issn = "1071-5819",
publisher = "Academic Press Inc.",
number = "8",

}

TY - JOUR

T1 - Automatic prediction of frustration

AU - Kapoor, Ashish

AU - Burleson, Winslow

AU - Picard, Rosalind W.

PY - 2007/8

Y1 - 2007/8

N2 - Predicting when a person might be frustrated can provide an intelligent system with important information about when to initiate interaction. For example, an automated Learning Companion or Intelligent Tutoring System might use this information to intervene, providing support to the learner who is likely to otherwise quit, while leaving engaged learners free to discover things without interruption. This paper presents the first automated method that assesses, using multiple channels of affect-related information, whether a learner is about to click on a button saying "I'm frustrated." The new method was tested on data gathered from 24 participants using an automated Learning Companion. Their indication of frustration was automatically predicted from the collected data with 79% accuracy (chance = 58 %). The new assessment method is based on Gaussian process classification and Bayesian inference. Its performance suggests that non-verbal channels carrying affective cues can help provide important information to a system for formulating a more intelligent response.

AB - Predicting when a person might be frustrated can provide an intelligent system with important information about when to initiate interaction. For example, an automated Learning Companion or Intelligent Tutoring System might use this information to intervene, providing support to the learner who is likely to otherwise quit, while leaving engaged learners free to discover things without interruption. This paper presents the first automated method that assesses, using multiple channels of affect-related information, whether a learner is about to click on a button saying "I'm frustrated." The new method was tested on data gathered from 24 participants using an automated Learning Companion. Their indication of frustration was automatically predicted from the collected data with 79% accuracy (chance = 58 %). The new assessment method is based on Gaussian process classification and Bayesian inference. Its performance suggests that non-verbal channels carrying affective cues can help provide important information to a system for formulating a more intelligent response.

KW - Affect recognition

KW - Affective Learning Companion

KW - Intelligent Tutoring System

KW - Learner state assessment

UR - http://www.scopus.com/inward/record.url?scp=34249276773&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34249276773&partnerID=8YFLogxK

U2 - 10.1016/j.ijhcs.2007.02.003

DO - 10.1016/j.ijhcs.2007.02.003

M3 - Article

VL - 65

SP - 724

EP - 736

JO - International Journal of Human Computer Studies

JF - International Journal of Human Computer Studies

SN - 1071-5819

IS - 8

ER -