Training Models for Implementing Evidence-Based Psychological Treatment: A Cluster-Randomized Trial in College Counseling Centers

Denise E. Wilfley, W. Stewart Agras, Ellen E. Fitzsimmons-Craft, Cara Bohon, Dawn M. Eichen, R. Robinson Welch, Booil Jo, Ramesh Raghavan, Enola K. Proctor, G. Terence Wilson

    Research output: Contribution to journalArticle

    Abstract

    Importance: Progress has been made in establishing evidence-based treatments for psychiatric disorders, but these are not often delivered in routine settings. A scalable solution for training clinicians in evidence-based treatments is needed. Objective: To compare 2 methods of training college (university) counseling center therapists to treat psychiatric disorders using interpersonal psychotherapy. The hypothesis was that the train-the-trainer condition would demonstrate superior implementation outcomes vs the expert condition. Moderating factors were also explored. Design, Setting, and Participants: This cluster-randomized trial was conducted from October 2012 to December 2017 in 24 college counseling centers across the United States. Therapist participants were recruited from enrolled centers, and student patients with symptoms of depression and eating disorders were recruited by therapists. Data were analyzed from 184 enrolled therapists. Interventions: Counseling centers were randomized to the expert condition, which involved a workshop and 12 months of follow-up consultation, or the train-the-trainer condition, in which a staff member from the counseling center was coached to train other staff members. Main Outcomes and Measures: The main outcome was therapist fidelity (adherence and competence) to interpersonal psychotherapy, as assessed via audio recordings of therapy sessions. Therapist knowledge of interpersonal psychotherapy was a secondary outcome. Result: A total of 184 therapists (mean [SD] age, 41.9 [10.6] years; 140 female [76.1%]; 142 white [77.2%]) were included. Both the train-the-trainer-condition and expert-condition groups showed significant within-group improvement for adherence to interpersonal psychotherapy (change: 0.233 [95% CI, 0.192-0.274] and 0.190 [0.145-0.235], respectively; both P <.001), with large effect sizes (1.64 [95% CI, 1.35-1.93] and 1.34 [95% CI, 1.02-1.66], respectively) and no significant difference between conditions. Both groups also showed significant within-group improvement in interpersonal therapy competence (change: 0.179 [95% CI, 0.132-0.226] and 0.106 [0.059-0.153], respectively; both P <.001), with a large effect size for the train-the-trainer condition (1.16 [95% CI, 0.85-1.46]; P <.001) and a significant difference between groups favoring the train-the-trainer condition (effect size, 0.47 [95% CI, 0.05-0.89]; P =.03). Knowledge of interpersonal psychotherapy improved significantly within both groups (effect sizes: Train-the-trainer, 0.64 [95% CI, 0.28-0.99]; P =.005; expert, 0.69 [95% CI, 0.38-1.01]; P <.001), with no significant difference between groups. The significant moderating factors were job satisfaction for adherence (b, 0.120 [95% CI, 0.001-0.24]; P =.048) and competence (b, 0.133 [95% CI, 0.001-0.27]; P =.048), and frequency of clinical supervision for competence (b, 0.05 [95% CI, 0.004-0.09]; P =.03). Conclusions and Relevance: Results demonstrate that the train-the-trainer model produced training outcomes comparable with the expert model for adherence and was superior on competence. Given its potential capability to train more therapists over time, it has the potential to facilitate widespread dissemination of evidence-based treatments. Trial Registration: ClinicalTrials.gov Identifier: NCT02079142.

    Original languageEnglish (US)
    JournalJAMA Psychiatry
    DOIs
    StateAccepted/In press - Jan 1 2019

    Fingerprint

    Psychotherapy
    Counseling
    Mental Competency
    Psychology
    Psychiatry
    Therapeutics
    Clinical Competence
    Job Satisfaction
    Referral and Consultation
    Outcome Assessment (Health Care)
    Depression
    Students
    Education

    ASJC Scopus subject areas

    • Psychiatry and Mental health

    Cite this

    Wilfley, D. E., Agras, W. S., Fitzsimmons-Craft, E. E., Bohon, C., Eichen, D. M., Welch, R. R., ... Wilson, G. T. (Accepted/In press). Training Models for Implementing Evidence-Based Psychological Treatment: A Cluster-Randomized Trial in College Counseling Centers. JAMA Psychiatry. https://doi.org/10.1001/jamapsychiatry.2019.3483

    Training Models for Implementing Evidence-Based Psychological Treatment : A Cluster-Randomized Trial in College Counseling Centers. / Wilfley, Denise E.; Agras, W. Stewart; Fitzsimmons-Craft, Ellen E.; Bohon, Cara; Eichen, Dawn M.; Welch, R. Robinson; Jo, Booil; Raghavan, Ramesh; Proctor, Enola K.; Wilson, G. Terence.

    In: JAMA Psychiatry, 01.01.2019.

    Research output: Contribution to journalArticle

    Wilfley, DE, Agras, WS, Fitzsimmons-Craft, EE, Bohon, C, Eichen, DM, Welch, RR, Jo, B, Raghavan, R, Proctor, EK & Wilson, GT 2019, 'Training Models for Implementing Evidence-Based Psychological Treatment: A Cluster-Randomized Trial in College Counseling Centers', JAMA Psychiatry. https://doi.org/10.1001/jamapsychiatry.2019.3483
    Wilfley, Denise E. ; Agras, W. Stewart ; Fitzsimmons-Craft, Ellen E. ; Bohon, Cara ; Eichen, Dawn M. ; Welch, R. Robinson ; Jo, Booil ; Raghavan, Ramesh ; Proctor, Enola K. ; Wilson, G. Terence. / Training Models for Implementing Evidence-Based Psychological Treatment : A Cluster-Randomized Trial in College Counseling Centers. In: JAMA Psychiatry. 2019.
    @article{16990d5e72ca498e81351b238e847afa,
    title = "Training Models for Implementing Evidence-Based Psychological Treatment: A Cluster-Randomized Trial in College Counseling Centers",
    abstract = "Importance: Progress has been made in establishing evidence-based treatments for psychiatric disorders, but these are not often delivered in routine settings. A scalable solution for training clinicians in evidence-based treatments is needed. Objective: To compare 2 methods of training college (university) counseling center therapists to treat psychiatric disorders using interpersonal psychotherapy. The hypothesis was that the train-the-trainer condition would demonstrate superior implementation outcomes vs the expert condition. Moderating factors were also explored. Design, Setting, and Participants: This cluster-randomized trial was conducted from October 2012 to December 2017 in 24 college counseling centers across the United States. Therapist participants were recruited from enrolled centers, and student patients with symptoms of depression and eating disorders were recruited by therapists. Data were analyzed from 184 enrolled therapists. Interventions: Counseling centers were randomized to the expert condition, which involved a workshop and 12 months of follow-up consultation, or the train-the-trainer condition, in which a staff member from the counseling center was coached to train other staff members. Main Outcomes and Measures: The main outcome was therapist fidelity (adherence and competence) to interpersonal psychotherapy, as assessed via audio recordings of therapy sessions. Therapist knowledge of interpersonal psychotherapy was a secondary outcome. Result: A total of 184 therapists (mean [SD] age, 41.9 [10.6] years; 140 female [76.1{\%}]; 142 white [77.2{\%}]) were included. Both the train-the-trainer-condition and expert-condition groups showed significant within-group improvement for adherence to interpersonal psychotherapy (change: 0.233 [95{\%} CI, 0.192-0.274] and 0.190 [0.145-0.235], respectively; both P <.001), with large effect sizes (1.64 [95{\%} CI, 1.35-1.93] and 1.34 [95{\%} CI, 1.02-1.66], respectively) and no significant difference between conditions. Both groups also showed significant within-group improvement in interpersonal therapy competence (change: 0.179 [95{\%} CI, 0.132-0.226] and 0.106 [0.059-0.153], respectively; both P <.001), with a large effect size for the train-the-trainer condition (1.16 [95{\%} CI, 0.85-1.46]; P <.001) and a significant difference between groups favoring the train-the-trainer condition (effect size, 0.47 [95{\%} CI, 0.05-0.89]; P =.03). Knowledge of interpersonal psychotherapy improved significantly within both groups (effect sizes: Train-the-trainer, 0.64 [95{\%} CI, 0.28-0.99]; P =.005; expert, 0.69 [95{\%} CI, 0.38-1.01]; P <.001), with no significant difference between groups. The significant moderating factors were job satisfaction for adherence (b, 0.120 [95{\%} CI, 0.001-0.24]; P =.048) and competence (b, 0.133 [95{\%} CI, 0.001-0.27]; P =.048), and frequency of clinical supervision for competence (b, 0.05 [95{\%} CI, 0.004-0.09]; P =.03). Conclusions and Relevance: Results demonstrate that the train-the-trainer model produced training outcomes comparable with the expert model for adherence and was superior on competence. Given its potential capability to train more therapists over time, it has the potential to facilitate widespread dissemination of evidence-based treatments. Trial Registration: ClinicalTrials.gov Identifier: NCT02079142.",
    author = "Wilfley, {Denise E.} and Agras, {W. Stewart} and Fitzsimmons-Craft, {Ellen E.} and Cara Bohon and Eichen, {Dawn M.} and Welch, {R. Robinson} and Booil Jo and Ramesh Raghavan and Proctor, {Enola K.} and Wilson, {G. Terence}",
    year = "2019",
    month = "1",
    day = "1",
    doi = "10.1001/jamapsychiatry.2019.3483",
    language = "English (US)",
    journal = "JAMA Psychiatry",
    issn = "2168-622X",
    publisher = "American Medical Association",

    }

    TY - JOUR

    T1 - Training Models for Implementing Evidence-Based Psychological Treatment

    T2 - A Cluster-Randomized Trial in College Counseling Centers

    AU - Wilfley, Denise E.

    AU - Agras, W. Stewart

    AU - Fitzsimmons-Craft, Ellen E.

    AU - Bohon, Cara

    AU - Eichen, Dawn M.

    AU - Welch, R. Robinson

    AU - Jo, Booil

    AU - Raghavan, Ramesh

    AU - Proctor, Enola K.

    AU - Wilson, G. Terence

    PY - 2019/1/1

    Y1 - 2019/1/1

    N2 - Importance: Progress has been made in establishing evidence-based treatments for psychiatric disorders, but these are not often delivered in routine settings. A scalable solution for training clinicians in evidence-based treatments is needed. Objective: To compare 2 methods of training college (university) counseling center therapists to treat psychiatric disorders using interpersonal psychotherapy. The hypothesis was that the train-the-trainer condition would demonstrate superior implementation outcomes vs the expert condition. Moderating factors were also explored. Design, Setting, and Participants: This cluster-randomized trial was conducted from October 2012 to December 2017 in 24 college counseling centers across the United States. Therapist participants were recruited from enrolled centers, and student patients with symptoms of depression and eating disorders were recruited by therapists. Data were analyzed from 184 enrolled therapists. Interventions: Counseling centers were randomized to the expert condition, which involved a workshop and 12 months of follow-up consultation, or the train-the-trainer condition, in which a staff member from the counseling center was coached to train other staff members. Main Outcomes and Measures: The main outcome was therapist fidelity (adherence and competence) to interpersonal psychotherapy, as assessed via audio recordings of therapy sessions. Therapist knowledge of interpersonal psychotherapy was a secondary outcome. Result: A total of 184 therapists (mean [SD] age, 41.9 [10.6] years; 140 female [76.1%]; 142 white [77.2%]) were included. Both the train-the-trainer-condition and expert-condition groups showed significant within-group improvement for adherence to interpersonal psychotherapy (change: 0.233 [95% CI, 0.192-0.274] and 0.190 [0.145-0.235], respectively; both P <.001), with large effect sizes (1.64 [95% CI, 1.35-1.93] and 1.34 [95% CI, 1.02-1.66], respectively) and no significant difference between conditions. Both groups also showed significant within-group improvement in interpersonal therapy competence (change: 0.179 [95% CI, 0.132-0.226] and 0.106 [0.059-0.153], respectively; both P <.001), with a large effect size for the train-the-trainer condition (1.16 [95% CI, 0.85-1.46]; P <.001) and a significant difference between groups favoring the train-the-trainer condition (effect size, 0.47 [95% CI, 0.05-0.89]; P =.03). Knowledge of interpersonal psychotherapy improved significantly within both groups (effect sizes: Train-the-trainer, 0.64 [95% CI, 0.28-0.99]; P =.005; expert, 0.69 [95% CI, 0.38-1.01]; P <.001), with no significant difference between groups. The significant moderating factors were job satisfaction for adherence (b, 0.120 [95% CI, 0.001-0.24]; P =.048) and competence (b, 0.133 [95% CI, 0.001-0.27]; P =.048), and frequency of clinical supervision for competence (b, 0.05 [95% CI, 0.004-0.09]; P =.03). Conclusions and Relevance: Results demonstrate that the train-the-trainer model produced training outcomes comparable with the expert model for adherence and was superior on competence. Given its potential capability to train more therapists over time, it has the potential to facilitate widespread dissemination of evidence-based treatments. Trial Registration: ClinicalTrials.gov Identifier: NCT02079142.

    AB - Importance: Progress has been made in establishing evidence-based treatments for psychiatric disorders, but these are not often delivered in routine settings. A scalable solution for training clinicians in evidence-based treatments is needed. Objective: To compare 2 methods of training college (university) counseling center therapists to treat psychiatric disorders using interpersonal psychotherapy. The hypothesis was that the train-the-trainer condition would demonstrate superior implementation outcomes vs the expert condition. Moderating factors were also explored. Design, Setting, and Participants: This cluster-randomized trial was conducted from October 2012 to December 2017 in 24 college counseling centers across the United States. Therapist participants were recruited from enrolled centers, and student patients with symptoms of depression and eating disorders were recruited by therapists. Data were analyzed from 184 enrolled therapists. Interventions: Counseling centers were randomized to the expert condition, which involved a workshop and 12 months of follow-up consultation, or the train-the-trainer condition, in which a staff member from the counseling center was coached to train other staff members. Main Outcomes and Measures: The main outcome was therapist fidelity (adherence and competence) to interpersonal psychotherapy, as assessed via audio recordings of therapy sessions. Therapist knowledge of interpersonal psychotherapy was a secondary outcome. Result: A total of 184 therapists (mean [SD] age, 41.9 [10.6] years; 140 female [76.1%]; 142 white [77.2%]) were included. Both the train-the-trainer-condition and expert-condition groups showed significant within-group improvement for adherence to interpersonal psychotherapy (change: 0.233 [95% CI, 0.192-0.274] and 0.190 [0.145-0.235], respectively; both P <.001), with large effect sizes (1.64 [95% CI, 1.35-1.93] and 1.34 [95% CI, 1.02-1.66], respectively) and no significant difference between conditions. Both groups also showed significant within-group improvement in interpersonal therapy competence (change: 0.179 [95% CI, 0.132-0.226] and 0.106 [0.059-0.153], respectively; both P <.001), with a large effect size for the train-the-trainer condition (1.16 [95% CI, 0.85-1.46]; P <.001) and a significant difference between groups favoring the train-the-trainer condition (effect size, 0.47 [95% CI, 0.05-0.89]; P =.03). Knowledge of interpersonal psychotherapy improved significantly within both groups (effect sizes: Train-the-trainer, 0.64 [95% CI, 0.28-0.99]; P =.005; expert, 0.69 [95% CI, 0.38-1.01]; P <.001), with no significant difference between groups. The significant moderating factors were job satisfaction for adherence (b, 0.120 [95% CI, 0.001-0.24]; P =.048) and competence (b, 0.133 [95% CI, 0.001-0.27]; P =.048), and frequency of clinical supervision for competence (b, 0.05 [95% CI, 0.004-0.09]; P =.03). Conclusions and Relevance: Results demonstrate that the train-the-trainer model produced training outcomes comparable with the expert model for adherence and was superior on competence. Given its potential capability to train more therapists over time, it has the potential to facilitate widespread dissemination of evidence-based treatments. Trial Registration: ClinicalTrials.gov Identifier: NCT02079142.

    UR - http://www.scopus.com/inward/record.url?scp=85074886593&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85074886593&partnerID=8YFLogxK

    U2 - 10.1001/jamapsychiatry.2019.3483

    DO - 10.1001/jamapsychiatry.2019.3483

    M3 - Article

    C2 - 31693069

    AN - SCOPUS:85074886593

    JO - JAMA Psychiatry

    JF - JAMA Psychiatry

    SN - 2168-622X

    ER -