Estimation of presentations skills based on slides and audio features

Gonzalo Luzardo, Bruno Guamán, Katherine Chiluiza, Jaime Castells, Xavier Ochoa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper proposes a simple estimation of the quality of student oral presentations. It is based on the study and analysis of features extracted from the audio and digital slides of 448 presentations. The main goal of this work is to automatically predict the values assigned by professors to different criteria in a presentation evaluation rubric. Ma- chine Learning methods were used to create several models that classify students in two clusters: high and low perform- ers. The models created from slide features were accurate up to 65%. The most relevant features for the slide-base models were: number of words, images, and tables, and the maximum font size. The audio-based models reached up to 69% of accuracy, with pitch and filled pauses related features being the most significant. The relatively high degrees of ac- curacy obtained with these very simple features encourage the development of automatic estimation tools for improving presentation skills.

Original languageEnglish (US)
Title of host publicationMLA 2014 - Proceedings of the 2014 ACM Multimodal Learning Analytics Workshop and Grand Challenge, Co-located with ICMI 2014
PublisherAssociation for Computing Machinery, Inc
Pages37-44
Number of pages8
ISBN (Electronic)9781450304887
DOIs
StatePublished - Jan 1 2014
Event3rd Multimodal Learning Analytics Workshop and Grand Challenges, MLA 2014 - Istanbul, Turkey
Duration: Nov 12 2014Nov 12 2014

Other

Other3rd Multimodal Learning Analytics Workshop and Grand Challenges, MLA 2014
CountryTurkey
CityIstanbul
Period11/12/1411/12/14

Fingerprint

Students
learning method
Learning systems
university teacher
student
evaluation
Values

Keywords

  • Audio features
  • Multimodal Learning Analytics
  • Presentation skills
  • Slides features

ASJC Scopus subject areas

  • Computer Science Applications
  • Education

Cite this

Luzardo, G., Guamán, B., Chiluiza, K., Castells, J., & Ochoa, X. (2014). Estimation of presentations skills based on slides and audio features. In MLA 2014 - Proceedings of the 2014 ACM Multimodal Learning Analytics Workshop and Grand Challenge, Co-located with ICMI 2014 (pp. 37-44). Association for Computing Machinery, Inc. https://doi.org/10.1145/2666633.2666639

Estimation of presentations skills based on slides and audio features. / Luzardo, Gonzalo; Guamán, Bruno; Chiluiza, Katherine; Castells, Jaime; Ochoa, Xavier.

MLA 2014 - Proceedings of the 2014 ACM Multimodal Learning Analytics Workshop and Grand Challenge, Co-located with ICMI 2014. Association for Computing Machinery, Inc, 2014. p. 37-44.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Luzardo, G, Guamán, B, Chiluiza, K, Castells, J & Ochoa, X 2014, Estimation of presentations skills based on slides and audio features. in MLA 2014 - Proceedings of the 2014 ACM Multimodal Learning Analytics Workshop and Grand Challenge, Co-located with ICMI 2014. Association for Computing Machinery, Inc, pp. 37-44, 3rd Multimodal Learning Analytics Workshop and Grand Challenges, MLA 2014, Istanbul, Turkey, 11/12/14. https://doi.org/10.1145/2666633.2666639
Luzardo G, Guamán B, Chiluiza K, Castells J, Ochoa X. Estimation of presentations skills based on slides and audio features. In MLA 2014 - Proceedings of the 2014 ACM Multimodal Learning Analytics Workshop and Grand Challenge, Co-located with ICMI 2014. Association for Computing Machinery, Inc. 2014. p. 37-44 https://doi.org/10.1145/2666633.2666639
Luzardo, Gonzalo ; Guamán, Bruno ; Chiluiza, Katherine ; Castells, Jaime ; Ochoa, Xavier. / Estimation of presentations skills based on slides and audio features. MLA 2014 - Proceedings of the 2014 ACM Multimodal Learning Analytics Workshop and Grand Challenge, Co-located with ICMI 2014. Association for Computing Machinery, Inc, 2014. pp. 37-44
@inproceedings{667e3514957a41c2b9143242292f21a7,
title = "Estimation of presentations skills based on slides and audio features",
abstract = "This paper proposes a simple estimation of the quality of student oral presentations. It is based on the study and analysis of features extracted from the audio and digital slides of 448 presentations. The main goal of this work is to automatically predict the values assigned by professors to different criteria in a presentation evaluation rubric. Ma- chine Learning methods were used to create several models that classify students in two clusters: high and low perform- ers. The models created from slide features were accurate up to 65{\%}. The most relevant features for the slide-base models were: number of words, images, and tables, and the maximum font size. The audio-based models reached up to 69{\%} of accuracy, with pitch and filled pauses related features being the most significant. The relatively high degrees of ac- curacy obtained with these very simple features encourage the development of automatic estimation tools for improving presentation skills.",
keywords = "Audio features, Multimodal Learning Analytics, Presentation skills, Slides features",
author = "Gonzalo Luzardo and Bruno Guam{\'a}n and Katherine Chiluiza and Jaime Castells and Xavier Ochoa",
year = "2014",
month = "1",
day = "1",
doi = "10.1145/2666633.2666639",
language = "English (US)",
pages = "37--44",
booktitle = "MLA 2014 - Proceedings of the 2014 ACM Multimodal Learning Analytics Workshop and Grand Challenge, Co-located with ICMI 2014",
publisher = "Association for Computing Machinery, Inc",

}

TY - GEN

T1 - Estimation of presentations skills based on slides and audio features

AU - Luzardo, Gonzalo

AU - Guamán, Bruno

AU - Chiluiza, Katherine

AU - Castells, Jaime

AU - Ochoa, Xavier

PY - 2014/1/1

Y1 - 2014/1/1

N2 - This paper proposes a simple estimation of the quality of student oral presentations. It is based on the study and analysis of features extracted from the audio and digital slides of 448 presentations. The main goal of this work is to automatically predict the values assigned by professors to different criteria in a presentation evaluation rubric. Ma- chine Learning methods were used to create several models that classify students in two clusters: high and low perform- ers. The models created from slide features were accurate up to 65%. The most relevant features for the slide-base models were: number of words, images, and tables, and the maximum font size. The audio-based models reached up to 69% of accuracy, with pitch and filled pauses related features being the most significant. The relatively high degrees of ac- curacy obtained with these very simple features encourage the development of automatic estimation tools for improving presentation skills.

AB - This paper proposes a simple estimation of the quality of student oral presentations. It is based on the study and analysis of features extracted from the audio and digital slides of 448 presentations. The main goal of this work is to automatically predict the values assigned by professors to different criteria in a presentation evaluation rubric. Ma- chine Learning methods were used to create several models that classify students in two clusters: high and low perform- ers. The models created from slide features were accurate up to 65%. The most relevant features for the slide-base models were: number of words, images, and tables, and the maximum font size. The audio-based models reached up to 69% of accuracy, with pitch and filled pauses related features being the most significant. The relatively high degrees of ac- curacy obtained with these very simple features encourage the development of automatic estimation tools for improving presentation skills.

KW - Audio features

KW - Multimodal Learning Analytics

KW - Presentation skills

KW - Slides features

UR - http://www.scopus.com/inward/record.url?scp=84919394304&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84919394304&partnerID=8YFLogxK

U2 - 10.1145/2666633.2666639

DO - 10.1145/2666633.2666639

M3 - Conference contribution

AN - SCOPUS:84919394304

SP - 37

EP - 44

BT - MLA 2014 - Proceedings of the 2014 ACM Multimodal Learning Analytics Workshop and Grand Challenge, Co-located with ICMI 2014

PB - Association for Computing Machinery, Inc

ER -