### Abstract

Multimodal Learning Analytics is a field that studies how to process learning data from dissimilar sources in order to automatically find useful information to give feedback to the learning process. This work processes video, audio and pen strokes information included in the Math Data Corpus, a set of multimodal resources provided to the participants of the Second International Workshop on Multimodal Learning Analytics. The result of this processing is a set of simple features that could discriminate between experts and non-experts in groups of students solving mathematical problems. The main finding is that several of those simple features, namely the percentage of time that the students use the calculator, the speed at which the student writes or draws and the percentage of time that the student mentions numbers or mathematical terms, are good discriminators be- tween experts and non-experts students. Precision levels of 63% are obtained for individual problems and up to 80% when full sessions (aggregation of 16 problems) are analyzed. While the results are specific for the recorded settings, the methodology used to obtain and analyze the features could be used to create discriminations models for other contexts.

Original language | English (US) |
---|---|

Title of host publication | ICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction |

Pages | 583-590 |

Number of pages | 8 |

DOIs | |

State | Published - Dec 1 2013 |

Event | 2013 15th ACM International Conference on Multimodal Interaction, ICMI 2013 - Sydney, NSW, Australia Duration: Dec 9 2013 → Dec 13 2013 |

### Other

Other | 2013 15th ACM International Conference on Multimodal Interaction, ICMI 2013 |
---|---|

Country | Australia |

City | Sydney, NSW |

Period | 12/9/13 → 12/13/13 |

### Fingerprint

### Keywords

- math data corpus
- multimodal learning analytics

### ASJC Scopus subject areas

- Human-Computer Interaction
- Software

### Cite this

*ICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction*(pp. 583-590) https://doi.org/10.1145/2522848.2533789

**Expertise estimation based on simple multimodal features.** / Ochoa, Xavier; Chiluiza, Katherine; Méndez, Gonzalo; Luzardo, Gonzalo; Guamán, Bruno; Castells, James.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

*ICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction.*pp. 583-590, 2013 15th ACM International Conference on Multimodal Interaction, ICMI 2013, Sydney, NSW, Australia, 12/9/13. https://doi.org/10.1145/2522848.2533789

}

TY - GEN

T1 - Expertise estimation based on simple multimodal features

AU - Ochoa, Xavier

AU - Chiluiza, Katherine

AU - Méndez, Gonzalo

AU - Luzardo, Gonzalo

AU - Guamán, Bruno

AU - Castells, James

PY - 2013/12/1

Y1 - 2013/12/1

N2 - Multimodal Learning Analytics is a field that studies how to process learning data from dissimilar sources in order to automatically find useful information to give feedback to the learning process. This work processes video, audio and pen strokes information included in the Math Data Corpus, a set of multimodal resources provided to the participants of the Second International Workshop on Multimodal Learning Analytics. The result of this processing is a set of simple features that could discriminate between experts and non-experts in groups of students solving mathematical problems. The main finding is that several of those simple features, namely the percentage of time that the students use the calculator, the speed at which the student writes or draws and the percentage of time that the student mentions numbers or mathematical terms, are good discriminators be- tween experts and non-experts students. Precision levels of 63% are obtained for individual problems and up to 80% when full sessions (aggregation of 16 problems) are analyzed. While the results are specific for the recorded settings, the methodology used to obtain and analyze the features could be used to create discriminations models for other contexts.

AB - Multimodal Learning Analytics is a field that studies how to process learning data from dissimilar sources in order to automatically find useful information to give feedback to the learning process. This work processes video, audio and pen strokes information included in the Math Data Corpus, a set of multimodal resources provided to the participants of the Second International Workshop on Multimodal Learning Analytics. The result of this processing is a set of simple features that could discriminate between experts and non-experts in groups of students solving mathematical problems. The main finding is that several of those simple features, namely the percentage of time that the students use the calculator, the speed at which the student writes or draws and the percentage of time that the student mentions numbers or mathematical terms, are good discriminators be- tween experts and non-experts students. Precision levels of 63% are obtained for individual problems and up to 80% when full sessions (aggregation of 16 problems) are analyzed. While the results are specific for the recorded settings, the methodology used to obtain and analyze the features could be used to create discriminations models for other contexts.

KW - math data corpus

KW - multimodal learning analytics

UR - http://www.scopus.com/inward/record.url?scp=84892570670&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84892570670&partnerID=8YFLogxK

U2 - 10.1145/2522848.2533789

DO - 10.1145/2522848.2533789

M3 - Conference contribution

AN - SCOPUS:84892570670

SN - 9781450321297

SP - 583

EP - 590

BT - ICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction

ER -