Expertise estimation based on simple multimodal features

Xavier Ochoa, Katherine Chiluiza, Gonzalo Méndez, Gonzalo Luzardo, Bruno Guamán, James Castells

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Multimodal Learning Analytics is a field that studies how to process learning data from dissimilar sources in order to automatically find useful information to give feedback to the learning process. This work processes video, audio and pen strokes information included in the Math Data Corpus, a set of multimodal resources provided to the participants of the Second International Workshop on Multimodal Learning Analytics. The result of this processing is a set of simple features that could discriminate between experts and non-experts in groups of students solving mathematical problems. The main finding is that several of those simple features, namely the percentage of time that the students use the calculator, the speed at which the student writes or draws and the percentage of time that the student mentions numbers or mathematical terms, are good discriminators be- tween experts and non-experts students. Precision levels of 63% are obtained for individual problems and up to 80% when full sessions (aggregation of 16 problems) are analyzed. While the results are specific for the recorded settings, the methodology used to obtain and analyze the features could be used to create discriminations models for other contexts.

Original languageEnglish (US)
Title of host publicationICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction
Pages583-590
Number of pages8
DOIs
StatePublished - Dec 1 2013
Event2013 15th ACM International Conference on Multimodal Interaction, ICMI 2013 - Sydney, NSW, Australia
Duration: Dec 9 2013Dec 13 2013

Other

Other2013 15th ACM International Conference on Multimodal Interaction, ICMI 2013
CountryAustralia
CitySydney, NSW
Period12/9/1312/13/13

Fingerprint

Students
Discriminators
Agglomeration
Feedback
Processing

Keywords

  • math data corpus
  • multimodal learning analytics

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Software

Cite this

Ochoa, X., Chiluiza, K., Méndez, G., Luzardo, G., Guamán, B., & Castells, J. (2013). Expertise estimation based on simple multimodal features. In ICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction (pp. 583-590) https://doi.org/10.1145/2522848.2533789

Expertise estimation based on simple multimodal features. / Ochoa, Xavier; Chiluiza, Katherine; Méndez, Gonzalo; Luzardo, Gonzalo; Guamán, Bruno; Castells, James.

ICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction. 2013. p. 583-590.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ochoa, X, Chiluiza, K, Méndez, G, Luzardo, G, Guamán, B & Castells, J 2013, Expertise estimation based on simple multimodal features. in ICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction. pp. 583-590, 2013 15th ACM International Conference on Multimodal Interaction, ICMI 2013, Sydney, NSW, Australia, 12/9/13. https://doi.org/10.1145/2522848.2533789
Ochoa X, Chiluiza K, Méndez G, Luzardo G, Guamán B, Castells J. Expertise estimation based on simple multimodal features. In ICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction. 2013. p. 583-590 https://doi.org/10.1145/2522848.2533789
Ochoa, Xavier ; Chiluiza, Katherine ; Méndez, Gonzalo ; Luzardo, Gonzalo ; Guamán, Bruno ; Castells, James. / Expertise estimation based on simple multimodal features. ICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction. 2013. pp. 583-590
@inproceedings{0bbcaa3089cf4bff966f166af511f21f,
title = "Expertise estimation based on simple multimodal features",
abstract = "Multimodal Learning Analytics is a field that studies how to process learning data from dissimilar sources in order to automatically find useful information to give feedback to the learning process. This work processes video, audio and pen strokes information included in the Math Data Corpus, a set of multimodal resources provided to the participants of the Second International Workshop on Multimodal Learning Analytics. The result of this processing is a set of simple features that could discriminate between experts and non-experts in groups of students solving mathematical problems. The main finding is that several of those simple features, namely the percentage of time that the students use the calculator, the speed at which the student writes or draws and the percentage of time that the student mentions numbers or mathematical terms, are good discriminators be- tween experts and non-experts students. Precision levels of 63{\%} are obtained for individual problems and up to 80{\%} when full sessions (aggregation of 16 problems) are analyzed. While the results are specific for the recorded settings, the methodology used to obtain and analyze the features could be used to create discriminations models for other contexts.",
keywords = "math data corpus, multimodal learning analytics",
author = "Xavier Ochoa and Katherine Chiluiza and Gonzalo M{\'e}ndez and Gonzalo Luzardo and Bruno Guam{\'a}n and James Castells",
year = "2013",
month = "12",
day = "1",
doi = "10.1145/2522848.2533789",
language = "English (US)",
isbn = "9781450321297",
pages = "583--590",
booktitle = "ICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction",

}

TY - GEN

T1 - Expertise estimation based on simple multimodal features

AU - Ochoa, Xavier

AU - Chiluiza, Katherine

AU - Méndez, Gonzalo

AU - Luzardo, Gonzalo

AU - Guamán, Bruno

AU - Castells, James

PY - 2013/12/1

Y1 - 2013/12/1

N2 - Multimodal Learning Analytics is a field that studies how to process learning data from dissimilar sources in order to automatically find useful information to give feedback to the learning process. This work processes video, audio and pen strokes information included in the Math Data Corpus, a set of multimodal resources provided to the participants of the Second International Workshop on Multimodal Learning Analytics. The result of this processing is a set of simple features that could discriminate between experts and non-experts in groups of students solving mathematical problems. The main finding is that several of those simple features, namely the percentage of time that the students use the calculator, the speed at which the student writes or draws and the percentage of time that the student mentions numbers or mathematical terms, are good discriminators be- tween experts and non-experts students. Precision levels of 63% are obtained for individual problems and up to 80% when full sessions (aggregation of 16 problems) are analyzed. While the results are specific for the recorded settings, the methodology used to obtain and analyze the features could be used to create discriminations models for other contexts.

AB - Multimodal Learning Analytics is a field that studies how to process learning data from dissimilar sources in order to automatically find useful information to give feedback to the learning process. This work processes video, audio and pen strokes information included in the Math Data Corpus, a set of multimodal resources provided to the participants of the Second International Workshop on Multimodal Learning Analytics. The result of this processing is a set of simple features that could discriminate between experts and non-experts in groups of students solving mathematical problems. The main finding is that several of those simple features, namely the percentage of time that the students use the calculator, the speed at which the student writes or draws and the percentage of time that the student mentions numbers or mathematical terms, are good discriminators be- tween experts and non-experts students. Precision levels of 63% are obtained for individual problems and up to 80% when full sessions (aggregation of 16 problems) are analyzed. While the results are specific for the recorded settings, the methodology used to obtain and analyze the features could be used to create discriminations models for other contexts.

KW - math data corpus

KW - multimodal learning analytics

UR - http://www.scopus.com/inward/record.url?scp=84892570670&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84892570670&partnerID=8YFLogxK

U2 - 10.1145/2522848.2533789

DO - 10.1145/2522848.2533789

M3 - Conference contribution

AN - SCOPUS:84892570670

SN - 9781450321297

SP - 583

EP - 590

BT - ICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction

ER -