Evaluation of a meta-tutor for constructing models of dynamic systems

Lishan Zhang, Kurt Vanlehn, Sylvie Girard, Winslow Burleson, Maria Elena Chavez-Echeagaray, Javier Gonzalez-Sanchez, Yoalli Hidalgo-Pontet

Research output: Contribution to journalArticle

Abstract

Modelling is an important skill to acquire, but it is not an easy one for students to learn. Existing instructional technology has had limited success in teaching modelling. We have applied a recently developed technology, meta-tutoring, to address the important problem of teaching model construction. More specifically, we have developed and evaluated a system that has two parts, a tutor and a meta-tutor. The tutor is a simple step-based tutoring system that can give correct/incorrect feedback on student's steps and can demonstrate steps for students when asked. Because deep modelling requires difficult analyses of the quantitative relationships in a given system, we expected, and found, that students tended to avoid deep modelling by abusing the tutor's help. In order to increase the frequency of deep modelling, we added a meta-tutor that coached students to follow a learning strategy that decomposed the overall modelling problem into a series of "atomic" modelling problems. We conducted three experiments to test the effectiveness of the meta-tutor. The results indicate that students who studied with meta-tutor did indeed engage in more deep modelling practices. However, when the meta-tutor and tutor were turned off, students tended to revert to shallow modelling. Thus, the next stage of the research is to add an affective agent that will try to persuade students to persist in using the taught strategies even when the meta-tutoring and tutoring have ceased.

Original languageEnglish (US)
Pages (from-to)196-217
Number of pages22
JournalComputers and Education
Volume75
DOIs
StatePublished - 2014

Fingerprint

tutor
Dynamical systems
Students
evaluation
student
Teaching
instructional technology
learning strategy
Feedback
experiment

Keywords

  • Gaming the system
  • Intelligent tutoring systems
  • Learning strategies
  • Meta-tutor
  • Modelling

ASJC Scopus subject areas

  • Computer Science(all)
  • Education

Cite this

Zhang, L., Vanlehn, K., Girard, S., Burleson, W., Chavez-Echeagaray, M. E., Gonzalez-Sanchez, J., & Hidalgo-Pontet, Y. (2014). Evaluation of a meta-tutor for constructing models of dynamic systems. Computers and Education, 75, 196-217. https://doi.org/10.1016/j.compedu.2014.02.015

Evaluation of a meta-tutor for constructing models of dynamic systems. / Zhang, Lishan; Vanlehn, Kurt; Girard, Sylvie; Burleson, Winslow; Chavez-Echeagaray, Maria Elena; Gonzalez-Sanchez, Javier; Hidalgo-Pontet, Yoalli.

In: Computers and Education, Vol. 75, 2014, p. 196-217.

Research output: Contribution to journalArticle

Zhang, L, Vanlehn, K, Girard, S, Burleson, W, Chavez-Echeagaray, ME, Gonzalez-Sanchez, J & Hidalgo-Pontet, Y 2014, 'Evaluation of a meta-tutor for constructing models of dynamic systems', Computers and Education, vol. 75, pp. 196-217. https://doi.org/10.1016/j.compedu.2014.02.015
Zhang, Lishan ; Vanlehn, Kurt ; Girard, Sylvie ; Burleson, Winslow ; Chavez-Echeagaray, Maria Elena ; Gonzalez-Sanchez, Javier ; Hidalgo-Pontet, Yoalli. / Evaluation of a meta-tutor for constructing models of dynamic systems. In: Computers and Education. 2014 ; Vol. 75. pp. 196-217.
@article{ec06c2d3d3e94982a609f25134820839,
title = "Evaluation of a meta-tutor for constructing models of dynamic systems",
abstract = "Modelling is an important skill to acquire, but it is not an easy one for students to learn. Existing instructional technology has had limited success in teaching modelling. We have applied a recently developed technology, meta-tutoring, to address the important problem of teaching model construction. More specifically, we have developed and evaluated a system that has two parts, a tutor and a meta-tutor. The tutor is a simple step-based tutoring system that can give correct/incorrect feedback on student's steps and can demonstrate steps for students when asked. Because deep modelling requires difficult analyses of the quantitative relationships in a given system, we expected, and found, that students tended to avoid deep modelling by abusing the tutor's help. In order to increase the frequency of deep modelling, we added a meta-tutor that coached students to follow a learning strategy that decomposed the overall modelling problem into a series of {"}atomic{"} modelling problems. We conducted three experiments to test the effectiveness of the meta-tutor. The results indicate that students who studied with meta-tutor did indeed engage in more deep modelling practices. However, when the meta-tutor and tutor were turned off, students tended to revert to shallow modelling. Thus, the next stage of the research is to add an affective agent that will try to persuade students to persist in using the taught strategies even when the meta-tutoring and tutoring have ceased.",
keywords = "Gaming the system, Intelligent tutoring systems, Learning strategies, Meta-tutor, Modelling",
author = "Lishan Zhang and Kurt Vanlehn and Sylvie Girard and Winslow Burleson and Chavez-Echeagaray, {Maria Elena} and Javier Gonzalez-Sanchez and Yoalli Hidalgo-Pontet",
year = "2014",
doi = "10.1016/j.compedu.2014.02.015",
language = "English (US)",
volume = "75",
pages = "196--217",
journal = "Computers and Education",
issn = "0360-1315",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Evaluation of a meta-tutor for constructing models of dynamic systems

AU - Zhang, Lishan

AU - Vanlehn, Kurt

AU - Girard, Sylvie

AU - Burleson, Winslow

AU - Chavez-Echeagaray, Maria Elena

AU - Gonzalez-Sanchez, Javier

AU - Hidalgo-Pontet, Yoalli

PY - 2014

Y1 - 2014

N2 - Modelling is an important skill to acquire, but it is not an easy one for students to learn. Existing instructional technology has had limited success in teaching modelling. We have applied a recently developed technology, meta-tutoring, to address the important problem of teaching model construction. More specifically, we have developed and evaluated a system that has two parts, a tutor and a meta-tutor. The tutor is a simple step-based tutoring system that can give correct/incorrect feedback on student's steps and can demonstrate steps for students when asked. Because deep modelling requires difficult analyses of the quantitative relationships in a given system, we expected, and found, that students tended to avoid deep modelling by abusing the tutor's help. In order to increase the frequency of deep modelling, we added a meta-tutor that coached students to follow a learning strategy that decomposed the overall modelling problem into a series of "atomic" modelling problems. We conducted three experiments to test the effectiveness of the meta-tutor. The results indicate that students who studied with meta-tutor did indeed engage in more deep modelling practices. However, when the meta-tutor and tutor were turned off, students tended to revert to shallow modelling. Thus, the next stage of the research is to add an affective agent that will try to persuade students to persist in using the taught strategies even when the meta-tutoring and tutoring have ceased.

AB - Modelling is an important skill to acquire, but it is not an easy one for students to learn. Existing instructional technology has had limited success in teaching modelling. We have applied a recently developed technology, meta-tutoring, to address the important problem of teaching model construction. More specifically, we have developed and evaluated a system that has two parts, a tutor and a meta-tutor. The tutor is a simple step-based tutoring system that can give correct/incorrect feedback on student's steps and can demonstrate steps for students when asked. Because deep modelling requires difficult analyses of the quantitative relationships in a given system, we expected, and found, that students tended to avoid deep modelling by abusing the tutor's help. In order to increase the frequency of deep modelling, we added a meta-tutor that coached students to follow a learning strategy that decomposed the overall modelling problem into a series of "atomic" modelling problems. We conducted three experiments to test the effectiveness of the meta-tutor. The results indicate that students who studied with meta-tutor did indeed engage in more deep modelling practices. However, when the meta-tutor and tutor were turned off, students tended to revert to shallow modelling. Thus, the next stage of the research is to add an affective agent that will try to persuade students to persist in using the taught strategies even when the meta-tutoring and tutoring have ceased.

KW - Gaming the system

KW - Intelligent tutoring systems

KW - Learning strategies

KW - Meta-tutor

KW - Modelling

UR - http://www.scopus.com/inward/record.url?scp=84897009129&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84897009129&partnerID=8YFLogxK

U2 - 10.1016/j.compedu.2014.02.015

DO - 10.1016/j.compedu.2014.02.015

M3 - Article

VL - 75

SP - 196

EP - 217

JO - Computers and Education

JF - Computers and Education

SN - 0360-1315

ER -