The Congenital Heart Technical Skill Study

Rationale and Design

Congenital Heart Technical Skill Study

Research output: Contribution to journalArticle

Abstract

BACKGROUND:: We report the rationale and design for a peer-evaluation protocol of attending congenital heart surgeon technical skill using direct video observation. METHODS:: All surgeons contributing data to The Society of Thoracic Surgeons-Congenital Heart Surgery Database (STS-CHSD) are invited to submit videos of themselves operating, to rate peers, or both. Surgeons may submit Norwood procedures, complete atrioventricular canal repairs, and/or arterial switch operations. A HIPPA-compliant website allows secure transmission/evaluation. Videos are anonymously rated using a modified Objective Structured Assessment of Technical Skills score. Ratings are linked to five years of contemporaneous outcome data from the STS-CHSD and surgeon questionnaires. The primary outcome is a composite for major morbidity/mortality. RESULTS:: Two hundred seventy-six surgeons from 113 centers are eligible for participation: 83 (30%) surgeons from 53 (45%) centers have agreed to participate, with recruitment ongoing. These surgeons vary considerably in years of experience and outcomes. Participants, both early and late in their careers, describe the process as "very rewarding" and "less time consuming than anticipated." An initial subset of 10 videos demonstrated excellent interrater reliability (interclass correlation = 0.85). CONCLUSIONS:: This study proposes to evaluate the technical skills of attending pediatric cardiothoracic surgeons by video observation and peer-review. It is notable that over a quarter of congenital heart surgeons, across a range of experiences, from almost half of United States centers have already agreed to participate. This study also creates a mechanism for peer feedback; we hypothesize that feedback could yield broad and meaningful quality improvement.

Original languageEnglish (US)
Pages (from-to)137-144
Number of pages8
JournalWorld journal for pediatric & congenital heart surgery
Volume10
Issue number2
DOIs
StatePublished - Mar 1 2019

Fingerprint

Thoracic Surgery
Norwood Procedures
Observation
Surgeons
Databases
Peer Review
Quality Improvement
Thorax
Pediatrics
Morbidity
Mortality
Surveys and Questionnaires
Complete atrioventricular septal defect
Arterial Switch Operation

Keywords

  • congenital heart surgery
  • outcomes

ASJC Scopus subject areas

  • Medicine(all)

Cite this

The Congenital Heart Technical Skill Study : Rationale and Design. / Congenital Heart Technical Skill Study.

In: World journal for pediatric & congenital heart surgery, Vol. 10, No. 2, 01.03.2019, p. 137-144.

Research output: Contribution to journalArticle

Congenital Heart Technical Skill Study. / The Congenital Heart Technical Skill Study : Rationale and Design. In: World journal for pediatric & congenital heart surgery. 2019 ; Vol. 10, No. 2. pp. 137-144.
@article{2bd9a39dd4c74fbe9b8c82608be5cc89,
title = "The Congenital Heart Technical Skill Study: Rationale and Design",
abstract = "BACKGROUND:: We report the rationale and design for a peer-evaluation protocol of attending congenital heart surgeon technical skill using direct video observation. METHODS:: All surgeons contributing data to The Society of Thoracic Surgeons-Congenital Heart Surgery Database (STS-CHSD) are invited to submit videos of themselves operating, to rate peers, or both. Surgeons may submit Norwood procedures, complete atrioventricular canal repairs, and/or arterial switch operations. A HIPPA-compliant website allows secure transmission/evaluation. Videos are anonymously rated using a modified Objective Structured Assessment of Technical Skills score. Ratings are linked to five years of contemporaneous outcome data from the STS-CHSD and surgeon questionnaires. The primary outcome is a composite for major morbidity/mortality. RESULTS:: Two hundred seventy-six surgeons from 113 centers are eligible for participation: 83 (30{\%}) surgeons from 53 (45{\%}) centers have agreed to participate, with recruitment ongoing. These surgeons vary considerably in years of experience and outcomes. Participants, both early and late in their careers, describe the process as {"}very rewarding{"} and {"}less time consuming than anticipated.{"} An initial subset of 10 videos demonstrated excellent interrater reliability (interclass correlation = 0.85). CONCLUSIONS:: This study proposes to evaluate the technical skills of attending pediatric cardiothoracic surgeons by video observation and peer-review. It is notable that over a quarter of congenital heart surgeons, across a range of experiences, from almost half of United States centers have already agreed to participate. This study also creates a mechanism for peer feedback; we hypothesize that feedback could yield broad and meaningful quality improvement.",
keywords = "congenital heart surgery, outcomes",
author = "{Congenital Heart Technical Skill Study} and Anderson, {Brett R.} and Kumar, {S. Ram} and Danielle Gottlieb-Sen and Liava'a, {Matthew H.} and Hill, {Kevin D.} and Jacobs, {Jeffrey P.} and Moga, {Francis X.} and Overman, {David M.} and Newburger, {Jane W.} and Sharon Glied and Bacha, {Emile A.}",
year = "2019",
month = "3",
day = "1",
doi = "10.1177/2150135118822689",
language = "English (US)",
volume = "10",
pages = "137--144",
journal = "World journal for pediatric & congenital heart surgery",
issn = "2150-1351",
publisher = "Sage Periodicals Press",
number = "2",

}

TY - JOUR

T1 - The Congenital Heart Technical Skill Study

T2 - Rationale and Design

AU - Congenital Heart Technical Skill Study

AU - Anderson, Brett R.

AU - Kumar, S. Ram

AU - Gottlieb-Sen, Danielle

AU - Liava'a, Matthew H.

AU - Hill, Kevin D.

AU - Jacobs, Jeffrey P.

AU - Moga, Francis X.

AU - Overman, David M.

AU - Newburger, Jane W.

AU - Glied, Sharon

AU - Bacha, Emile A.

PY - 2019/3/1

Y1 - 2019/3/1

N2 - BACKGROUND:: We report the rationale and design for a peer-evaluation protocol of attending congenital heart surgeon technical skill using direct video observation. METHODS:: All surgeons contributing data to The Society of Thoracic Surgeons-Congenital Heart Surgery Database (STS-CHSD) are invited to submit videos of themselves operating, to rate peers, or both. Surgeons may submit Norwood procedures, complete atrioventricular canal repairs, and/or arterial switch operations. A HIPPA-compliant website allows secure transmission/evaluation. Videos are anonymously rated using a modified Objective Structured Assessment of Technical Skills score. Ratings are linked to five years of contemporaneous outcome data from the STS-CHSD and surgeon questionnaires. The primary outcome is a composite for major morbidity/mortality. RESULTS:: Two hundred seventy-six surgeons from 113 centers are eligible for participation: 83 (30%) surgeons from 53 (45%) centers have agreed to participate, with recruitment ongoing. These surgeons vary considerably in years of experience and outcomes. Participants, both early and late in their careers, describe the process as "very rewarding" and "less time consuming than anticipated." An initial subset of 10 videos demonstrated excellent interrater reliability (interclass correlation = 0.85). CONCLUSIONS:: This study proposes to evaluate the technical skills of attending pediatric cardiothoracic surgeons by video observation and peer-review. It is notable that over a quarter of congenital heart surgeons, across a range of experiences, from almost half of United States centers have already agreed to participate. This study also creates a mechanism for peer feedback; we hypothesize that feedback could yield broad and meaningful quality improvement.

AB - BACKGROUND:: We report the rationale and design for a peer-evaluation protocol of attending congenital heart surgeon technical skill using direct video observation. METHODS:: All surgeons contributing data to The Society of Thoracic Surgeons-Congenital Heart Surgery Database (STS-CHSD) are invited to submit videos of themselves operating, to rate peers, or both. Surgeons may submit Norwood procedures, complete atrioventricular canal repairs, and/or arterial switch operations. A HIPPA-compliant website allows secure transmission/evaluation. Videos are anonymously rated using a modified Objective Structured Assessment of Technical Skills score. Ratings are linked to five years of contemporaneous outcome data from the STS-CHSD and surgeon questionnaires. The primary outcome is a composite for major morbidity/mortality. RESULTS:: Two hundred seventy-six surgeons from 113 centers are eligible for participation: 83 (30%) surgeons from 53 (45%) centers have agreed to participate, with recruitment ongoing. These surgeons vary considerably in years of experience and outcomes. Participants, both early and late in their careers, describe the process as "very rewarding" and "less time consuming than anticipated." An initial subset of 10 videos demonstrated excellent interrater reliability (interclass correlation = 0.85). CONCLUSIONS:: This study proposes to evaluate the technical skills of attending pediatric cardiothoracic surgeons by video observation and peer-review. It is notable that over a quarter of congenital heart surgeons, across a range of experiences, from almost half of United States centers have already agreed to participate. This study also creates a mechanism for peer feedback; we hypothesize that feedback could yield broad and meaningful quality improvement.

KW - congenital heart surgery

KW - outcomes

UR - http://www.scopus.com/inward/record.url?scp=85062633970&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062633970&partnerID=8YFLogxK

U2 - 10.1177/2150135118822689

DO - 10.1177/2150135118822689

M3 - Article

VL - 10

SP - 137

EP - 144

JO - World journal for pediatric & congenital heart surgery

JF - World journal for pediatric & congenital heart surgery

SN - 2150-1351

IS - 2

ER -