Affective computing meets design patterns

A pattern-based model for a multimodal emotion recognition framework

Javier Gonzalez-Sanchez, Maria Elena Chavez-Echeagaray, Robert Atkinson, Winslow Burleson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

There is a growing interest in how to leverage information about user's emotions as a mean of personalizing the response of computer systems. This is particularly useful for computer-aided learning, health, and entertainment systems. However, there are few architectures, frameworks, libraries, or software tools that allow developers to easily integrate emotion recognition into their software projects. The work reported in this paper offers a way to address this shortcoming in models by proposing the use of software design patterns for modeling a multimodal emotion recognition framework. The framework is designed to: (1) integrate existing sensing devices and SDK platforms, (2) include diverse inference algorithms, and (3) correlate measurements from diverse sources. We describe our experience using this model and its impact on facets, such as creating a common language among stakeholders, supporting an incremental development, and adjusting to a highly shifting development team, as well as the qualities achieved and trade-offs made.

Original languageEnglish (US)
Title of host publicationEuroPLoP 2011 - 16th European Conference on Pattern Languages of Programs, Invited Post-Proceedings
DOIs
StatePublished - 2012
Event16th European Conference on Pattern Languages of Programs, EuroPLoP 2011 - Irsee, Germany
Duration: Jul 13 2011Jul 17 2011

Other

Other16th European Conference on Pattern Languages of Programs, EuroPLoP 2011
CountryGermany
CityIrsee
Period7/13/117/17/11

Fingerprint

Software design
Computer systems
Health

Keywords

  • design patterns
  • emotion recognition
  • framework
  • multimodal

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Gonzalez-Sanchez, J., Chavez-Echeagaray, M. E., Atkinson, R., & Burleson, W. (2012). Affective computing meets design patterns: A pattern-based model for a multimodal emotion recognition framework. In EuroPLoP 2011 - 16th European Conference on Pattern Languages of Programs, Invited Post-Proceedings https://doi.org/10.1145/2396716.2396730

Affective computing meets design patterns : A pattern-based model for a multimodal emotion recognition framework. / Gonzalez-Sanchez, Javier; Chavez-Echeagaray, Maria Elena; Atkinson, Robert; Burleson, Winslow.

EuroPLoP 2011 - 16th European Conference on Pattern Languages of Programs, Invited Post-Proceedings. 2012.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Gonzalez-Sanchez, J, Chavez-Echeagaray, ME, Atkinson, R & Burleson, W 2012, Affective computing meets design patterns: A pattern-based model for a multimodal emotion recognition framework. in EuroPLoP 2011 - 16th European Conference on Pattern Languages of Programs, Invited Post-Proceedings. 16th European Conference on Pattern Languages of Programs, EuroPLoP 2011, Irsee, Germany, 7/13/11. https://doi.org/10.1145/2396716.2396730
Gonzalez-Sanchez J, Chavez-Echeagaray ME, Atkinson R, Burleson W. Affective computing meets design patterns: A pattern-based model for a multimodal emotion recognition framework. In EuroPLoP 2011 - 16th European Conference on Pattern Languages of Programs, Invited Post-Proceedings. 2012 https://doi.org/10.1145/2396716.2396730
Gonzalez-Sanchez, Javier ; Chavez-Echeagaray, Maria Elena ; Atkinson, Robert ; Burleson, Winslow. / Affective computing meets design patterns : A pattern-based model for a multimodal emotion recognition framework. EuroPLoP 2011 - 16th European Conference on Pattern Languages of Programs, Invited Post-Proceedings. 2012.
@inproceedings{ed7a0b8197794097a1d33bd5a015bb52,
title = "Affective computing meets design patterns: A pattern-based model for a multimodal emotion recognition framework",
abstract = "There is a growing interest in how to leverage information about user's emotions as a mean of personalizing the response of computer systems. This is particularly useful for computer-aided learning, health, and entertainment systems. However, there are few architectures, frameworks, libraries, or software tools that allow developers to easily integrate emotion recognition into their software projects. The work reported in this paper offers a way to address this shortcoming in models by proposing the use of software design patterns for modeling a multimodal emotion recognition framework. The framework is designed to: (1) integrate existing sensing devices and SDK platforms, (2) include diverse inference algorithms, and (3) correlate measurements from diverse sources. We describe our experience using this model and its impact on facets, such as creating a common language among stakeholders, supporting an incremental development, and adjusting to a highly shifting development team, as well as the qualities achieved and trade-offs made.",
keywords = "design patterns, emotion recognition, framework, multimodal",
author = "Javier Gonzalez-Sanchez and Chavez-Echeagaray, {Maria Elena} and Robert Atkinson and Winslow Burleson",
year = "2012",
doi = "10.1145/2396716.2396730",
language = "English (US)",
isbn = "9781450313025",
booktitle = "EuroPLoP 2011 - 16th European Conference on Pattern Languages of Programs, Invited Post-Proceedings",

}

TY - GEN

T1 - Affective computing meets design patterns

T2 - A pattern-based model for a multimodal emotion recognition framework

AU - Gonzalez-Sanchez, Javier

AU - Chavez-Echeagaray, Maria Elena

AU - Atkinson, Robert

AU - Burleson, Winslow

PY - 2012

Y1 - 2012

N2 - There is a growing interest in how to leverage information about user's emotions as a mean of personalizing the response of computer systems. This is particularly useful for computer-aided learning, health, and entertainment systems. However, there are few architectures, frameworks, libraries, or software tools that allow developers to easily integrate emotion recognition into their software projects. The work reported in this paper offers a way to address this shortcoming in models by proposing the use of software design patterns for modeling a multimodal emotion recognition framework. The framework is designed to: (1) integrate existing sensing devices and SDK platforms, (2) include diverse inference algorithms, and (3) correlate measurements from diverse sources. We describe our experience using this model and its impact on facets, such as creating a common language among stakeholders, supporting an incremental development, and adjusting to a highly shifting development team, as well as the qualities achieved and trade-offs made.

AB - There is a growing interest in how to leverage information about user's emotions as a mean of personalizing the response of computer systems. This is particularly useful for computer-aided learning, health, and entertainment systems. However, there are few architectures, frameworks, libraries, or software tools that allow developers to easily integrate emotion recognition into their software projects. The work reported in this paper offers a way to address this shortcoming in models by proposing the use of software design patterns for modeling a multimodal emotion recognition framework. The framework is designed to: (1) integrate existing sensing devices and SDK platforms, (2) include diverse inference algorithms, and (3) correlate measurements from diverse sources. We describe our experience using this model and its impact on facets, such as creating a common language among stakeholders, supporting an incremental development, and adjusting to a highly shifting development team, as well as the qualities achieved and trade-offs made.

KW - design patterns

KW - emotion recognition

KW - framework

KW - multimodal

UR - http://www.scopus.com/inward/record.url?scp=84870947002&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84870947002&partnerID=8YFLogxK

U2 - 10.1145/2396716.2396730

DO - 10.1145/2396716.2396730

M3 - Conference contribution

SN - 9781450313025

BT - EuroPLoP 2011 - 16th European Conference on Pattern Languages of Programs, Invited Post-Proceedings

ER -