Masked visual analysis

Minimizing type I error in visually guided single-case design for communication disorders

Tara McAllister Byun, Elaine R. Hitchcock, John Ferron

Research output: Contribution to journalArticle

Abstract

Purpose: Single-case experimental designs are widely used to study interventions for communication disorders. Traditionally, single-case experiments follow a responseguided approach, where design decisions during the study are based on participants’ observed patterns of behavior. However, this approach has been criticized for its high rate of Type I error. In masked visual analysis (MVA), responseguided decisions are made by a researcher who is blinded to participants’ identities and treatment assignments. MVA also makes it possible to conduct a hypothesis test assessing the significance of treatment effects. Method: This tutorial describes the principles of MVA including both how experiments can be set up and how results can be used for hypothesis testing. We then report a case study showing how MVA was deployed in a multiplebaseline across-subjects study investigating treatment for residual errors affecting rhotics. Strengths and weaknesses of MVA are discussed. Conclusions: Given their important role in the evidence base that informs clinical decision making, it is critical for singlecase experimental studies to be conducted in a way that allows researchers to draw valid inferences. As a method that can increase the rigor of single-case studies while preserving the benefits of a response-guided approach MVA warrants expanded attention from researchers in communication disorders.

Original languageEnglish (US)
Pages (from-to)1455-1466
Number of pages12
JournalJournal of Speech, Language, and Hearing Research
Volume60
Issue number6
DOIs
StatePublished - 2017

Fingerprint

Communication Disorders
communication disorder
Research Personnel
Decision Support Techniques
Research Design
Therapeutics
hypothesis testing
experiment
Visual Analysis
decision making
evidence

ASJC Scopus subject areas

  • Language and Linguistics
  • Linguistics and Language
  • Speech and Hearing

Cite this

Masked visual analysis : Minimizing type I error in visually guided single-case design for communication disorders. / McAllister Byun, Tara; Hitchcock, Elaine R.; Ferron, John.

In: Journal of Speech, Language, and Hearing Research, Vol. 60, No. 6, 2017, p. 1455-1466.

Research output: Contribution to journalArticle

@article{3c57736fc8604a6f90f272cbd58e7973,
title = "Masked visual analysis: Minimizing type I error in visually guided single-case design for communication disorders",
abstract = "Purpose: Single-case experimental designs are widely used to study interventions for communication disorders. Traditionally, single-case experiments follow a responseguided approach, where design decisions during the study are based on participants’ observed patterns of behavior. However, this approach has been criticized for its high rate of Type I error. In masked visual analysis (MVA), responseguided decisions are made by a researcher who is blinded to participants’ identities and treatment assignments. MVA also makes it possible to conduct a hypothesis test assessing the significance of treatment effects. Method: This tutorial describes the principles of MVA including both how experiments can be set up and how results can be used for hypothesis testing. We then report a case study showing how MVA was deployed in a multiplebaseline across-subjects study investigating treatment for residual errors affecting rhotics. Strengths and weaknesses of MVA are discussed. Conclusions: Given their important role in the evidence base that informs clinical decision making, it is critical for singlecase experimental studies to be conducted in a way that allows researchers to draw valid inferences. As a method that can increase the rigor of single-case studies while preserving the benefits of a response-guided approach MVA warrants expanded attention from researchers in communication disorders.",
author = "{McAllister Byun}, Tara and Hitchcock, {Elaine R.} and John Ferron",
year = "2017",
doi = "10.1044/2017_JSLHR-S-16-0344",
language = "English (US)",
volume = "60",
pages = "1455--1466",
journal = "Journal of Speech, Language, and Hearing Research",
issn = "1092-4388",
publisher = "American Speech-Language-Hearing Association (ASHA)",
number = "6",

}

TY - JOUR

T1 - Masked visual analysis

T2 - Minimizing type I error in visually guided single-case design for communication disorders

AU - McAllister Byun, Tara

AU - Hitchcock, Elaine R.

AU - Ferron, John

PY - 2017

Y1 - 2017

N2 - Purpose: Single-case experimental designs are widely used to study interventions for communication disorders. Traditionally, single-case experiments follow a responseguided approach, where design decisions during the study are based on participants’ observed patterns of behavior. However, this approach has been criticized for its high rate of Type I error. In masked visual analysis (MVA), responseguided decisions are made by a researcher who is blinded to participants’ identities and treatment assignments. MVA also makes it possible to conduct a hypothesis test assessing the significance of treatment effects. Method: This tutorial describes the principles of MVA including both how experiments can be set up and how results can be used for hypothesis testing. We then report a case study showing how MVA was deployed in a multiplebaseline across-subjects study investigating treatment for residual errors affecting rhotics. Strengths and weaknesses of MVA are discussed. Conclusions: Given their important role in the evidence base that informs clinical decision making, it is critical for singlecase experimental studies to be conducted in a way that allows researchers to draw valid inferences. As a method that can increase the rigor of single-case studies while preserving the benefits of a response-guided approach MVA warrants expanded attention from researchers in communication disorders.

AB - Purpose: Single-case experimental designs are widely used to study interventions for communication disorders. Traditionally, single-case experiments follow a responseguided approach, where design decisions during the study are based on participants’ observed patterns of behavior. However, this approach has been criticized for its high rate of Type I error. In masked visual analysis (MVA), responseguided decisions are made by a researcher who is blinded to participants’ identities and treatment assignments. MVA also makes it possible to conduct a hypothesis test assessing the significance of treatment effects. Method: This tutorial describes the principles of MVA including both how experiments can be set up and how results can be used for hypothesis testing. We then report a case study showing how MVA was deployed in a multiplebaseline across-subjects study investigating treatment for residual errors affecting rhotics. Strengths and weaknesses of MVA are discussed. Conclusions: Given their important role in the evidence base that informs clinical decision making, it is critical for singlecase experimental studies to be conducted in a way that allows researchers to draw valid inferences. As a method that can increase the rigor of single-case studies while preserving the benefits of a response-guided approach MVA warrants expanded attention from researchers in communication disorders.

UR - http://www.scopus.com/inward/record.url?scp=85020690710&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85020690710&partnerID=8YFLogxK

U2 - 10.1044/2017_JSLHR-S-16-0344

DO - 10.1044/2017_JSLHR-S-16-0344

M3 - Article

VL - 60

SP - 1455

EP - 1466

JO - Journal of Speech, Language, and Hearing Research

JF - Journal of Speech, Language, and Hearing Research

SN - 1092-4388

IS - 6

ER -