Click versus drag: User-performed tasks and the enactment effect in an interactive multimedia environment

Ruth N. Schwartz, Jan Plass

Research output: Contribution to journalArticle

Abstract

Does learner performance of specific tasks in an interactive multimedia environment affect learning outcomes? Within a multimedia environment, users may engage in a range of actions, or interactive tasks, from tapping a keyboard to executing large motor movements. To investigate the impact of particular performance tasks on learning, we first introduce an approach to classifying interactive multimedia tasks as enactive, iconic or symbolic. We then describe a study in which university students (N = 112) used a computer program that presented a series of action phrases in 4 different conditions, each condition requiring performance of a different task: listen (audio only), look (audio with static graphic), click (audio with animation triggered by a click), or drag (audio with click-and-drag graphic). Participants were tested on free recall and recognition of phrases immediately after treatment and again after 3 weeks. At immediate testing, recall was best for drag (iconic) items, followed by click (symbolic), look, and listen items, in that order, with significant differences between each pair of conditions. For immediate recognition, as well as for delayed free recall and delayed recognition, mean scores followed the same pattern, with some variations in significance. Results support our proposed classification of interactive behaviors, extend previous findings on the enactment effect into a computer environment, and suggest the importance of considering the design of interactive tasks in the development of multimedia learning materials.

Original languageEnglish (US)
Pages (from-to)242-255
Number of pages14
JournalComputers in Human Behavior
Volume33
DOIs
StatePublished - Apr 2014

Fingerprint

Multimedia
Drag
Task Performance and Analysis
Learning
Animation
Computer program listings
Students
Software
Testing
Enactment
Recognition (Psychology)
Therapeutics

Keywords

  • Embodiment
  • Enactment effect
  • Interactivity
  • Multimedia
  • User-performed tasks

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Psychology(all)
  • Arts and Humanities (miscellaneous)

Cite this

Click versus drag : User-performed tasks and the enactment effect in an interactive multimedia environment. / Schwartz, Ruth N.; Plass, Jan.

In: Computers in Human Behavior, Vol. 33, 04.2014, p. 242-255.

Research output: Contribution to journalArticle

@article{ed3c468d517b404b8cc8128e79d1f64d,
title = "Click versus drag: User-performed tasks and the enactment effect in an interactive multimedia environment",
abstract = "Does learner performance of specific tasks in an interactive multimedia environment affect learning outcomes? Within a multimedia environment, users may engage in a range of actions, or interactive tasks, from tapping a keyboard to executing large motor movements. To investigate the impact of particular performance tasks on learning, we first introduce an approach to classifying interactive multimedia tasks as enactive, iconic or symbolic. We then describe a study in which university students (N = 112) used a computer program that presented a series of action phrases in 4 different conditions, each condition requiring performance of a different task: listen (audio only), look (audio with static graphic), click (audio with animation triggered by a click), or drag (audio with click-and-drag graphic). Participants were tested on free recall and recognition of phrases immediately after treatment and again after 3 weeks. At immediate testing, recall was best for drag (iconic) items, followed by click (symbolic), look, and listen items, in that order, with significant differences between each pair of conditions. For immediate recognition, as well as for delayed free recall and delayed recognition, mean scores followed the same pattern, with some variations in significance. Results support our proposed classification of interactive behaviors, extend previous findings on the enactment effect into a computer environment, and suggest the importance of considering the design of interactive tasks in the development of multimedia learning materials.",
keywords = "Embodiment, Enactment effect, Interactivity, Multimedia, User-performed tasks",
author = "Schwartz, {Ruth N.} and Jan Plass",
year = "2014",
month = "4",
doi = "10.1016/j.chb.2014.01.012",
language = "English (US)",
volume = "33",
pages = "242--255",
journal = "Computers in Human Behavior",
issn = "0747-5632",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Click versus drag

T2 - User-performed tasks and the enactment effect in an interactive multimedia environment

AU - Schwartz, Ruth N.

AU - Plass, Jan

PY - 2014/4

Y1 - 2014/4

N2 - Does learner performance of specific tasks in an interactive multimedia environment affect learning outcomes? Within a multimedia environment, users may engage in a range of actions, or interactive tasks, from tapping a keyboard to executing large motor movements. To investigate the impact of particular performance tasks on learning, we first introduce an approach to classifying interactive multimedia tasks as enactive, iconic or symbolic. We then describe a study in which university students (N = 112) used a computer program that presented a series of action phrases in 4 different conditions, each condition requiring performance of a different task: listen (audio only), look (audio with static graphic), click (audio with animation triggered by a click), or drag (audio with click-and-drag graphic). Participants were tested on free recall and recognition of phrases immediately after treatment and again after 3 weeks. At immediate testing, recall was best for drag (iconic) items, followed by click (symbolic), look, and listen items, in that order, with significant differences between each pair of conditions. For immediate recognition, as well as for delayed free recall and delayed recognition, mean scores followed the same pattern, with some variations in significance. Results support our proposed classification of interactive behaviors, extend previous findings on the enactment effect into a computer environment, and suggest the importance of considering the design of interactive tasks in the development of multimedia learning materials.

AB - Does learner performance of specific tasks in an interactive multimedia environment affect learning outcomes? Within a multimedia environment, users may engage in a range of actions, or interactive tasks, from tapping a keyboard to executing large motor movements. To investigate the impact of particular performance tasks on learning, we first introduce an approach to classifying interactive multimedia tasks as enactive, iconic or symbolic. We then describe a study in which university students (N = 112) used a computer program that presented a series of action phrases in 4 different conditions, each condition requiring performance of a different task: listen (audio only), look (audio with static graphic), click (audio with animation triggered by a click), or drag (audio with click-and-drag graphic). Participants were tested on free recall and recognition of phrases immediately after treatment and again after 3 weeks. At immediate testing, recall was best for drag (iconic) items, followed by click (symbolic), look, and listen items, in that order, with significant differences between each pair of conditions. For immediate recognition, as well as for delayed free recall and delayed recognition, mean scores followed the same pattern, with some variations in significance. Results support our proposed classification of interactive behaviors, extend previous findings on the enactment effect into a computer environment, and suggest the importance of considering the design of interactive tasks in the development of multimedia learning materials.

KW - Embodiment

KW - Enactment effect

KW - Interactivity

KW - Multimedia

KW - User-performed tasks

UR - http://www.scopus.com/inward/record.url?scp=84893901706&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84893901706&partnerID=8YFLogxK

U2 - 10.1016/j.chb.2014.01.012

DO - 10.1016/j.chb.2014.01.012

M3 - Article

AN - SCOPUS:84893901706

VL - 33

SP - 242

EP - 255

JO - Computers in Human Behavior

JF - Computers in Human Behavior

SN - 0747-5632

ER -