Clinically Significant and Reliable Change: Comparing an Evidence-based Intervention to Usual Care

Maria Michelle Vardanian, Amrita Ramakrishnan, Sarah Peralta, Yasmin Siddiqui, Suniti P. Shah, Elysha Clark-Whitney, Anil Chacko

Research output: Contribution to journalArticle

Abstract

Objectives: Multiple Family Groups (MFG) is an evidence-based behavioral parent training developed with a specific focus on increasing engagement and decreasing treatment barriers for families of children with disruptive behavior problems within high-risk communities. Previous studies have demonstrated the effectiveness of MFG in improving oppositional behavior at the group-level compared to services as usual (SAU). However, information is lacking regarding intervention effectiveness on an individual-level (i.e., clinical significance). Methods: The reliable change index and clinical cutoff score method was utilized to determine whether MFG produced clinically meaningful changes compared to SAU for both child- and parent-level outcomes in a sample of 320 youth aged 7 to 11-years-old. Results: A significantly greater percentage of children in the MFG group experienced clinically meaningful change in problem behaviors compared to the SAU group, (p = 0.003, 95% [CI]: 1.610–18.481). A significantly greater number of parents in MFG also demonstrated clinically meaningful change in parental experience of stress compared to SAU, (p = 0.01, 95% [CI]: 1.255–14.704). Conclusions: Findings suggested clinically significant and reliable improvements in child problem behaviors and decreases in parental perceived stress for families in MFG compared to SAU. Nevertheless, analyses demonstrated that both MFG and SAU resulted in few families obtaining clinically significant or reliable change in their functioning. Ongoing assessments and deeper understanding of intervention effect are needed to better service families in need. Both group- and individual-level comparisons should be considered when examining the effects of a treatment as they may provide a nuanced understanding of evidence-based interventions.

Original languageEnglish (US)
JournalJournal of Child and Family Studies
DOIs
StateAccepted/In press - Jan 1 2019

Fingerprint

evidence
Group
parents
parents training
Child Behavior
Parents
Therapeutics
community
Problem Behavior
experience

Keywords

  • Behavioral parent training
  • Child functioning
  • Clinical significance
  • Disruptive behavior disorders
  • Usual care

ASJC Scopus subject areas

  • Developmental and Educational Psychology
  • Life-span and Life-course Studies

Cite this

Clinically Significant and Reliable Change : Comparing an Evidence-based Intervention to Usual Care. / Vardanian, Maria Michelle; Ramakrishnan, Amrita; Peralta, Sarah; Siddiqui, Yasmin; Shah, Suniti P.; Clark-Whitney, Elysha; Chacko, Anil.

In: Journal of Child and Family Studies, 01.01.2019.

Research output: Contribution to journalArticle

Vardanian, Maria Michelle ; Ramakrishnan, Amrita ; Peralta, Sarah ; Siddiqui, Yasmin ; Shah, Suniti P. ; Clark-Whitney, Elysha ; Chacko, Anil. / Clinically Significant and Reliable Change : Comparing an Evidence-based Intervention to Usual Care. In: Journal of Child and Family Studies. 2019.
@article{f1964f19c40c4fc0b8be660a2e8fc165,
title = "Clinically Significant and Reliable Change: Comparing an Evidence-based Intervention to Usual Care",
abstract = "Objectives: Multiple Family Groups (MFG) is an evidence-based behavioral parent training developed with a specific focus on increasing engagement and decreasing treatment barriers for families of children with disruptive behavior problems within high-risk communities. Previous studies have demonstrated the effectiveness of MFG in improving oppositional behavior at the group-level compared to services as usual (SAU). However, information is lacking regarding intervention effectiveness on an individual-level (i.e., clinical significance). Methods: The reliable change index and clinical cutoff score method was utilized to determine whether MFG produced clinically meaningful changes compared to SAU for both child- and parent-level outcomes in a sample of 320 youth aged 7 to 11-years-old. Results: A significantly greater percentage of children in the MFG group experienced clinically meaningful change in problem behaviors compared to the SAU group, (p = 0.003, 95{\%} [CI]: 1.610–18.481). A significantly greater number of parents in MFG also demonstrated clinically meaningful change in parental experience of stress compared to SAU, (p = 0.01, 95{\%} [CI]: 1.255–14.704). Conclusions: Findings suggested clinically significant and reliable improvements in child problem behaviors and decreases in parental perceived stress for families in MFG compared to SAU. Nevertheless, analyses demonstrated that both MFG and SAU resulted in few families obtaining clinically significant or reliable change in their functioning. Ongoing assessments and deeper understanding of intervention effect are needed to better service families in need. Both group- and individual-level comparisons should be considered when examining the effects of a treatment as they may provide a nuanced understanding of evidence-based interventions.",
keywords = "Behavioral parent training, Child functioning, Clinical significance, Disruptive behavior disorders, Usual care",
author = "Vardanian, {Maria Michelle} and Amrita Ramakrishnan and Sarah Peralta and Yasmin Siddiqui and Shah, {Suniti P.} and Elysha Clark-Whitney and Anil Chacko",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/s10826-019-01621-3",
language = "English (US)",
journal = "Journal of Child and Family Studies",
issn = "1062-1024",
publisher = "Springer New York",

}

TY - JOUR

T1 - Clinically Significant and Reliable Change

T2 - Comparing an Evidence-based Intervention to Usual Care

AU - Vardanian, Maria Michelle

AU - Ramakrishnan, Amrita

AU - Peralta, Sarah

AU - Siddiqui, Yasmin

AU - Shah, Suniti P.

AU - Clark-Whitney, Elysha

AU - Chacko, Anil

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Objectives: Multiple Family Groups (MFG) is an evidence-based behavioral parent training developed with a specific focus on increasing engagement and decreasing treatment barriers for families of children with disruptive behavior problems within high-risk communities. Previous studies have demonstrated the effectiveness of MFG in improving oppositional behavior at the group-level compared to services as usual (SAU). However, information is lacking regarding intervention effectiveness on an individual-level (i.e., clinical significance). Methods: The reliable change index and clinical cutoff score method was utilized to determine whether MFG produced clinically meaningful changes compared to SAU for both child- and parent-level outcomes in a sample of 320 youth aged 7 to 11-years-old. Results: A significantly greater percentage of children in the MFG group experienced clinically meaningful change in problem behaviors compared to the SAU group, (p = 0.003, 95% [CI]: 1.610–18.481). A significantly greater number of parents in MFG also demonstrated clinically meaningful change in parental experience of stress compared to SAU, (p = 0.01, 95% [CI]: 1.255–14.704). Conclusions: Findings suggested clinically significant and reliable improvements in child problem behaviors and decreases in parental perceived stress for families in MFG compared to SAU. Nevertheless, analyses demonstrated that both MFG and SAU resulted in few families obtaining clinically significant or reliable change in their functioning. Ongoing assessments and deeper understanding of intervention effect are needed to better service families in need. Both group- and individual-level comparisons should be considered when examining the effects of a treatment as they may provide a nuanced understanding of evidence-based interventions.

AB - Objectives: Multiple Family Groups (MFG) is an evidence-based behavioral parent training developed with a specific focus on increasing engagement and decreasing treatment barriers for families of children with disruptive behavior problems within high-risk communities. Previous studies have demonstrated the effectiveness of MFG in improving oppositional behavior at the group-level compared to services as usual (SAU). However, information is lacking regarding intervention effectiveness on an individual-level (i.e., clinical significance). Methods: The reliable change index and clinical cutoff score method was utilized to determine whether MFG produced clinically meaningful changes compared to SAU for both child- and parent-level outcomes in a sample of 320 youth aged 7 to 11-years-old. Results: A significantly greater percentage of children in the MFG group experienced clinically meaningful change in problem behaviors compared to the SAU group, (p = 0.003, 95% [CI]: 1.610–18.481). A significantly greater number of parents in MFG also demonstrated clinically meaningful change in parental experience of stress compared to SAU, (p = 0.01, 95% [CI]: 1.255–14.704). Conclusions: Findings suggested clinically significant and reliable improvements in child problem behaviors and decreases in parental perceived stress for families in MFG compared to SAU. Nevertheless, analyses demonstrated that both MFG and SAU resulted in few families obtaining clinically significant or reliable change in their functioning. Ongoing assessments and deeper understanding of intervention effect are needed to better service families in need. Both group- and individual-level comparisons should be considered when examining the effects of a treatment as they may provide a nuanced understanding of evidence-based interventions.

KW - Behavioral parent training

KW - Child functioning

KW - Clinical significance

KW - Disruptive behavior disorders

KW - Usual care

UR - http://www.scopus.com/inward/record.url?scp=85074537956&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85074537956&partnerID=8YFLogxK

U2 - 10.1007/s10826-019-01621-3

DO - 10.1007/s10826-019-01621-3

M3 - Article

AN - SCOPUS:85074537956

JO - Journal of Child and Family Studies

JF - Journal of Child and Family Studies

SN - 1062-1024

ER -