Assessing automatic VOT annotation using unimpaired and impaired speech

Esteban Buz, Adam Buchwald, Tzeviya Fuchs, Joseph Keshet

Research output: Contribution to journalArticle

Abstract

Investigating speech processes often involves analysing data gathered by phonetically annotating speech recordings. Yet, the manual annotation of speech can often be resource intensive—requiring substantial time and labour to complete. Recent advances in automatic annotation methods offer a way to reduce these annotation costs by replacing manual annotation. For researchers and clinicians, the viability of automatic methods depends whether one can draw similar conclusions about speech processes from automatically annotated speech as one would from manually annotated speech. Here, we evaluate how well one automatic annotation tool, AutoVOT, can approximate manual annotation. We do so by comparing analyses of automatically and manually annotated speech in two studies. We find that, with some caveats, we are able to draw the same conclusions about speech processes under both annotation methods. The findings suggest that automatic methods may be a viable way to reduce phonetic annotation costs in the right circumstances. We end with some guidelines on if and how well AutoVOT may be able to replace manual annotation in other data sets.

Original languageEnglish (US)
Pages (from-to)624-634
Number of pages11
JournalInternational Journal of Speech-Language Pathology
Volume20
Issue number6
DOIs
StatePublished - Oct 16 2018

Fingerprint

Costs and Cost Analysis
Phonetics
Annotation
Research Personnel
Guidelines
Costs
Datasets
Labor
Clinicians
Resources

Keywords

  • Annotation
  • speech
  • technology

ASJC Scopus subject areas

  • Research and Theory
  • Otorhinolaryngology
  • Language and Linguistics
  • LPN and LVN
  • Speech and Hearing

Cite this

Assessing automatic VOT annotation using unimpaired and impaired speech. / Buz, Esteban; Buchwald, Adam; Fuchs, Tzeviya; Keshet, Joseph.

In: International Journal of Speech-Language Pathology, Vol. 20, No. 6, 16.10.2018, p. 624-634.

Research output: Contribution to journalArticle

Buz, Esteban ; Buchwald, Adam ; Fuchs, Tzeviya ; Keshet, Joseph. / Assessing automatic VOT annotation using unimpaired and impaired speech. In: International Journal of Speech-Language Pathology. 2018 ; Vol. 20, No. 6. pp. 624-634.
@article{bd34229d94414ff5836b44acccc9182e,
title = "Assessing automatic VOT annotation using unimpaired and impaired speech",
abstract = "Investigating speech processes often involves analysing data gathered by phonetically annotating speech recordings. Yet, the manual annotation of speech can often be resource intensive—requiring substantial time and labour to complete. Recent advances in automatic annotation methods offer a way to reduce these annotation costs by replacing manual annotation. For researchers and clinicians, the viability of automatic methods depends whether one can draw similar conclusions about speech processes from automatically annotated speech as one would from manually annotated speech. Here, we evaluate how well one automatic annotation tool, AutoVOT, can approximate manual annotation. We do so by comparing analyses of automatically and manually annotated speech in two studies. We find that, with some caveats, we are able to draw the same conclusions about speech processes under both annotation methods. The findings suggest that automatic methods may be a viable way to reduce phonetic annotation costs in the right circumstances. We end with some guidelines on if and how well AutoVOT may be able to replace manual annotation in other data sets.",
keywords = "Annotation, speech, technology",
author = "Esteban Buz and Adam Buchwald and Tzeviya Fuchs and Joseph Keshet",
year = "2018",
month = "10",
day = "16",
doi = "10.1080/17549507.2018.1490817",
language = "English (US)",
volume = "20",
pages = "624--634",
journal = "International Journal of Speech-Language Pathology",
issn = "1754-9507",
publisher = "Informa Healthcare",
number = "6",

}

TY - JOUR

T1 - Assessing automatic VOT annotation using unimpaired and impaired speech

AU - Buz, Esteban

AU - Buchwald, Adam

AU - Fuchs, Tzeviya

AU - Keshet, Joseph

PY - 2018/10/16

Y1 - 2018/10/16

N2 - Investigating speech processes often involves analysing data gathered by phonetically annotating speech recordings. Yet, the manual annotation of speech can often be resource intensive—requiring substantial time and labour to complete. Recent advances in automatic annotation methods offer a way to reduce these annotation costs by replacing manual annotation. For researchers and clinicians, the viability of automatic methods depends whether one can draw similar conclusions about speech processes from automatically annotated speech as one would from manually annotated speech. Here, we evaluate how well one automatic annotation tool, AutoVOT, can approximate manual annotation. We do so by comparing analyses of automatically and manually annotated speech in two studies. We find that, with some caveats, we are able to draw the same conclusions about speech processes under both annotation methods. The findings suggest that automatic methods may be a viable way to reduce phonetic annotation costs in the right circumstances. We end with some guidelines on if and how well AutoVOT may be able to replace manual annotation in other data sets.

AB - Investigating speech processes often involves analysing data gathered by phonetically annotating speech recordings. Yet, the manual annotation of speech can often be resource intensive—requiring substantial time and labour to complete. Recent advances in automatic annotation methods offer a way to reduce these annotation costs by replacing manual annotation. For researchers and clinicians, the viability of automatic methods depends whether one can draw similar conclusions about speech processes from automatically annotated speech as one would from manually annotated speech. Here, we evaluate how well one automatic annotation tool, AutoVOT, can approximate manual annotation. We do so by comparing analyses of automatically and manually annotated speech in two studies. We find that, with some caveats, we are able to draw the same conclusions about speech processes under both annotation methods. The findings suggest that automatic methods may be a viable way to reduce phonetic annotation costs in the right circumstances. We end with some guidelines on if and how well AutoVOT may be able to replace manual annotation in other data sets.

KW - Annotation

KW - speech

KW - technology

UR - http://www.scopus.com/inward/record.url?scp=85059882169&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85059882169&partnerID=8YFLogxK

U2 - 10.1080/17549507.2018.1490817

DO - 10.1080/17549507.2018.1490817

M3 - Article

VL - 20

SP - 624

EP - 634

JO - International Journal of Speech-Language Pathology

JF - International Journal of Speech-Language Pathology

SN - 1754-9507

IS - 6

ER -