The DTI Challenge

Toward Standardized Evaluation of Diffusion Tensor Imaging Tractography for Neurosurgery

Sonia Pujol, William Wells, Carlo Pierpaoli, Caroline Brun, James Gee, Guang Cheng, Baba Vemuri, Olivier Commowick, Sylvain Prima, Aymeric Stamm, Maged Goubran, Ali Khan, Terry Peters, Peter Neher, Klaus H. Maier-Hein, Yundi Shi, Antonio Tristan-Vega, Gopalkrishna Veni, Ross Whitaker, Martin Styner & 9 others Carl Fredrik Westin, Sylvain Gouttard, Isaiah Norton, Laurent Chauvin, Hatsuho Mamata, Guido Gerig, Arya Nabavi, Alexandra Golby, Ron Kikinis

    Research output: Contribution to journalArticle

    Abstract

    Diffusion tensor imaging (DTI) tractography reconstruction of white matter pathways can help guide brain tumor resection. However, DTI tracts are complex mathematical objects and the validity of tractography-derived information in clinical settings has yet to be fully established. To address this issue, we initiated the DTI Challenge, an international working group of clinicians and scientists whose goal was to provide standardized evaluation of tractography methods for neurosurgery. The purpose of this empirical study was to evaluate different tractography techniques in the first DTI Challenge workshop. Eight international teams from leading institutions reconstructed the pyramidal tract in four neurosurgical cases presenting with a glioma near the motor cortex. Tractography methods included deterministic, probabilistic, filtered, and global approaches. Standardized evaluation of the tracts consisted in the qualitative review of the pyramidal pathways by a panel of neurosurgeons and DTI experts and the quantitative evaluation of the degree of agreement among methods. RESULTS: The evaluation of tractography reconstructions showed a great interalgorithm variability. Although most methods found projections of the pyramidal tract from the medial portion of the motor strip, only a few algorithms could trace the lateral projections from the hand, face, and tongue area. In addition, the structure of disagreement among methods was similar across hemispheres despite the anatomical distortions caused by pathological tissues. The DTI Challenge provides a benchmark for the standardized evaluation of tractography methods on neurosurgical data. This study suggests that there are still limitations to the clinical use of tractography for neurosurgical decision making.

    Original languageEnglish (US)
    Pages (from-to)875-882
    Number of pages8
    JournalJournal of Neuroimaging
    Volume25
    Issue number6
    DOIs
    StatePublished - Nov 1 2015

    Fingerprint

    Diffusion Tensor Imaging
    Neurosurgery
    Pyramidal Tracts
    Motor Cortex
    Benchmarking
    Tongue
    Brain Neoplasms
    Glioma
    Decision Making
    Hand
    Education

    Keywords

    • Brain gliomas
    • Diffusion MRI
    • Diffusion tensor imaging (DTI)
    • Neurosurgery
    • Tractography

    ASJC Scopus subject areas

    • Radiology Nuclear Medicine and imaging
    • Clinical Neurology

    Cite this

    Pujol, S., Wells, W., Pierpaoli, C., Brun, C., Gee, J., Cheng, G., ... Kikinis, R. (2015). The DTI Challenge: Toward Standardized Evaluation of Diffusion Tensor Imaging Tractography for Neurosurgery. Journal of Neuroimaging, 25(6), 875-882. https://doi.org/10.1111/jon.12283

    The DTI Challenge : Toward Standardized Evaluation of Diffusion Tensor Imaging Tractography for Neurosurgery. / Pujol, Sonia; Wells, William; Pierpaoli, Carlo; Brun, Caroline; Gee, James; Cheng, Guang; Vemuri, Baba; Commowick, Olivier; Prima, Sylvain; Stamm, Aymeric; Goubran, Maged; Khan, Ali; Peters, Terry; Neher, Peter; Maier-Hein, Klaus H.; Shi, Yundi; Tristan-Vega, Antonio; Veni, Gopalkrishna; Whitaker, Ross; Styner, Martin; Westin, Carl Fredrik; Gouttard, Sylvain; Norton, Isaiah; Chauvin, Laurent; Mamata, Hatsuho; Gerig, Guido; Nabavi, Arya; Golby, Alexandra; Kikinis, Ron.

    In: Journal of Neuroimaging, Vol. 25, No. 6, 01.11.2015, p. 875-882.

    Research output: Contribution to journalArticle

    Pujol, S, Wells, W, Pierpaoli, C, Brun, C, Gee, J, Cheng, G, Vemuri, B, Commowick, O, Prima, S, Stamm, A, Goubran, M, Khan, A, Peters, T, Neher, P, Maier-Hein, KH, Shi, Y, Tristan-Vega, A, Veni, G, Whitaker, R, Styner, M, Westin, CF, Gouttard, S, Norton, I, Chauvin, L, Mamata, H, Gerig, G, Nabavi, A, Golby, A & Kikinis, R 2015, 'The DTI Challenge: Toward Standardized Evaluation of Diffusion Tensor Imaging Tractography for Neurosurgery', Journal of Neuroimaging, vol. 25, no. 6, pp. 875-882. https://doi.org/10.1111/jon.12283
    Pujol, Sonia ; Wells, William ; Pierpaoli, Carlo ; Brun, Caroline ; Gee, James ; Cheng, Guang ; Vemuri, Baba ; Commowick, Olivier ; Prima, Sylvain ; Stamm, Aymeric ; Goubran, Maged ; Khan, Ali ; Peters, Terry ; Neher, Peter ; Maier-Hein, Klaus H. ; Shi, Yundi ; Tristan-Vega, Antonio ; Veni, Gopalkrishna ; Whitaker, Ross ; Styner, Martin ; Westin, Carl Fredrik ; Gouttard, Sylvain ; Norton, Isaiah ; Chauvin, Laurent ; Mamata, Hatsuho ; Gerig, Guido ; Nabavi, Arya ; Golby, Alexandra ; Kikinis, Ron. / The DTI Challenge : Toward Standardized Evaluation of Diffusion Tensor Imaging Tractography for Neurosurgery. In: Journal of Neuroimaging. 2015 ; Vol. 25, No. 6. pp. 875-882.
    @article{1dcac9d79d014ef3ae84901dcb17e318,
    title = "The DTI Challenge: Toward Standardized Evaluation of Diffusion Tensor Imaging Tractography for Neurosurgery",
    abstract = "Diffusion tensor imaging (DTI) tractography reconstruction of white matter pathways can help guide brain tumor resection. However, DTI tracts are complex mathematical objects and the validity of tractography-derived information in clinical settings has yet to be fully established. To address this issue, we initiated the DTI Challenge, an international working group of clinicians and scientists whose goal was to provide standardized evaluation of tractography methods for neurosurgery. The purpose of this empirical study was to evaluate different tractography techniques in the first DTI Challenge workshop. Eight international teams from leading institutions reconstructed the pyramidal tract in four neurosurgical cases presenting with a glioma near the motor cortex. Tractography methods included deterministic, probabilistic, filtered, and global approaches. Standardized evaluation of the tracts consisted in the qualitative review of the pyramidal pathways by a panel of neurosurgeons and DTI experts and the quantitative evaluation of the degree of agreement among methods. RESULTS: The evaluation of tractography reconstructions showed a great interalgorithm variability. Although most methods found projections of the pyramidal tract from the medial portion of the motor strip, only a few algorithms could trace the lateral projections from the hand, face, and tongue area. In addition, the structure of disagreement among methods was similar across hemispheres despite the anatomical distortions caused by pathological tissues. The DTI Challenge provides a benchmark for the standardized evaluation of tractography methods on neurosurgical data. This study suggests that there are still limitations to the clinical use of tractography for neurosurgical decision making.",
    keywords = "Brain gliomas, Diffusion MRI, Diffusion tensor imaging (DTI), Neurosurgery, Tractography",
    author = "Sonia Pujol and William Wells and Carlo Pierpaoli and Caroline Brun and James Gee and Guang Cheng and Baba Vemuri and Olivier Commowick and Sylvain Prima and Aymeric Stamm and Maged Goubran and Ali Khan and Terry Peters and Peter Neher and Maier-Hein, {Klaus H.} and Yundi Shi and Antonio Tristan-Vega and Gopalkrishna Veni and Ross Whitaker and Martin Styner and Westin, {Carl Fredrik} and Sylvain Gouttard and Isaiah Norton and Laurent Chauvin and Hatsuho Mamata and Guido Gerig and Arya Nabavi and Alexandra Golby and Ron Kikinis",
    year = "2015",
    month = "11",
    day = "1",
    doi = "10.1111/jon.12283",
    language = "English (US)",
    volume = "25",
    pages = "875--882",
    journal = "Journal of Neuroimaging",
    issn = "1051-2284",
    publisher = "Wiley-Blackwell",
    number = "6",

    }

    TY - JOUR

    T1 - The DTI Challenge

    T2 - Toward Standardized Evaluation of Diffusion Tensor Imaging Tractography for Neurosurgery

    AU - Pujol, Sonia

    AU - Wells, William

    AU - Pierpaoli, Carlo

    AU - Brun, Caroline

    AU - Gee, James

    AU - Cheng, Guang

    AU - Vemuri, Baba

    AU - Commowick, Olivier

    AU - Prima, Sylvain

    AU - Stamm, Aymeric

    AU - Goubran, Maged

    AU - Khan, Ali

    AU - Peters, Terry

    AU - Neher, Peter

    AU - Maier-Hein, Klaus H.

    AU - Shi, Yundi

    AU - Tristan-Vega, Antonio

    AU - Veni, Gopalkrishna

    AU - Whitaker, Ross

    AU - Styner, Martin

    AU - Westin, Carl Fredrik

    AU - Gouttard, Sylvain

    AU - Norton, Isaiah

    AU - Chauvin, Laurent

    AU - Mamata, Hatsuho

    AU - Gerig, Guido

    AU - Nabavi, Arya

    AU - Golby, Alexandra

    AU - Kikinis, Ron

    PY - 2015/11/1

    Y1 - 2015/11/1

    N2 - Diffusion tensor imaging (DTI) tractography reconstruction of white matter pathways can help guide brain tumor resection. However, DTI tracts are complex mathematical objects and the validity of tractography-derived information in clinical settings has yet to be fully established. To address this issue, we initiated the DTI Challenge, an international working group of clinicians and scientists whose goal was to provide standardized evaluation of tractography methods for neurosurgery. The purpose of this empirical study was to evaluate different tractography techniques in the first DTI Challenge workshop. Eight international teams from leading institutions reconstructed the pyramidal tract in four neurosurgical cases presenting with a glioma near the motor cortex. Tractography methods included deterministic, probabilistic, filtered, and global approaches. Standardized evaluation of the tracts consisted in the qualitative review of the pyramidal pathways by a panel of neurosurgeons and DTI experts and the quantitative evaluation of the degree of agreement among methods. RESULTS: The evaluation of tractography reconstructions showed a great interalgorithm variability. Although most methods found projections of the pyramidal tract from the medial portion of the motor strip, only a few algorithms could trace the lateral projections from the hand, face, and tongue area. In addition, the structure of disagreement among methods was similar across hemispheres despite the anatomical distortions caused by pathological tissues. The DTI Challenge provides a benchmark for the standardized evaluation of tractography methods on neurosurgical data. This study suggests that there are still limitations to the clinical use of tractography for neurosurgical decision making.

    AB - Diffusion tensor imaging (DTI) tractography reconstruction of white matter pathways can help guide brain tumor resection. However, DTI tracts are complex mathematical objects and the validity of tractography-derived information in clinical settings has yet to be fully established. To address this issue, we initiated the DTI Challenge, an international working group of clinicians and scientists whose goal was to provide standardized evaluation of tractography methods for neurosurgery. The purpose of this empirical study was to evaluate different tractography techniques in the first DTI Challenge workshop. Eight international teams from leading institutions reconstructed the pyramidal tract in four neurosurgical cases presenting with a glioma near the motor cortex. Tractography methods included deterministic, probabilistic, filtered, and global approaches. Standardized evaluation of the tracts consisted in the qualitative review of the pyramidal pathways by a panel of neurosurgeons and DTI experts and the quantitative evaluation of the degree of agreement among methods. RESULTS: The evaluation of tractography reconstructions showed a great interalgorithm variability. Although most methods found projections of the pyramidal tract from the medial portion of the motor strip, only a few algorithms could trace the lateral projections from the hand, face, and tongue area. In addition, the structure of disagreement among methods was similar across hemispheres despite the anatomical distortions caused by pathological tissues. The DTI Challenge provides a benchmark for the standardized evaluation of tractography methods on neurosurgical data. This study suggests that there are still limitations to the clinical use of tractography for neurosurgical decision making.

    KW - Brain gliomas

    KW - Diffusion MRI

    KW - Diffusion tensor imaging (DTI)

    KW - Neurosurgery

    KW - Tractography

    UR - http://www.scopus.com/inward/record.url?scp=84944512101&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84944512101&partnerID=8YFLogxK

    U2 - 10.1111/jon.12283

    DO - 10.1111/jon.12283

    M3 - Article

    VL - 25

    SP - 875

    EP - 882

    JO - Journal of Neuroimaging

    JF - Journal of Neuroimaging

    SN - 1051-2284

    IS - 6

    ER -