Multi-site validation of image analysis methods - Assessing intra and inter-site variability

Martin A. Styner, H. Cecil Charles, Jin Park, Guido Gerig

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    In this work, we present a unique set of 3D MRI brain data that is appropriate for testing the intra and inter-site variability of image analysis methods. A single subject was scanned two times within a 24 hour time window each at five different MR sites over a period of six weeks using GE and Phillips 1.5 T scanners. The imaging protocol included T1 weighted, Proton Density and T2 weighted images. We applied three quantitative image analysis methods and analyzed their results via the coefficients of variability (COV) and the intra correlation coefficient. The tested methods include two multi-channel tissue segmentation techniques based on an anatomically guided manual seeding and an atlas-based seeding. The third tested method was a single-channel semi-automatic segmentation of the hippocampus. The results show that the outcome of image analysis methods varies significantly for images from different sites and scanners. With the exception of total brain volume, which shows consistent low variability across all images, the COV's were clearly larger between sites than within sites. Also, the COV's between sites with different scanner types are slightly larger than between sites with the same scanner type. The presented existence of a significant inter-site variability requires adaptations in image methods to produce repeatable measurements. This is especially of importance in multi-site clinical research.

    Original languageEnglish (US)
    Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
    EditorsM. Sonka, J. Michael Fitzpatrick
    Pages278-286
    Number of pages9
    Volume4684 I
    DOIs
    StatePublished - 2002
    EventMedical Imaging 2002: Image Processing - San Diego, CA, United States
    Duration: Feb 24 2002Feb 28 2002

    Other

    OtherMedical Imaging 2002: Image Processing
    CountryUnited States
    CitySan Diego, CA
    Period2/24/022/28/02

    Fingerprint

    image analysis
    Image analysis
    scanners
    Brain
    inoculation
    brain
    hippocampus
    Magnetic resonance imaging
    Protons
    correlation coefficients
    Tissue
    Imaging techniques
    Testing
    coefficients

    Keywords

    • MRI
    • Multi-site
    • Quantitative Image Analysis
    • Reliability
    • Validation

    ASJC Scopus subject areas

    • Electrical and Electronic Engineering
    • Condensed Matter Physics

    Cite this

    Styner, M. A., Charles, H. C., Park, J., & Gerig, G. (2002). Multi-site validation of image analysis methods - Assessing intra and inter-site variability. In M. Sonka, & J. Michael Fitzpatrick (Eds.), Proceedings of SPIE - The International Society for Optical Engineering (Vol. 4684 I, pp. 278-286) https://doi.org/10.1117/12.467167

    Multi-site validation of image analysis methods - Assessing intra and inter-site variability. / Styner, Martin A.; Charles, H. Cecil; Park, Jin; Gerig, Guido.

    Proceedings of SPIE - The International Society for Optical Engineering. ed. / M. Sonka; J. Michael Fitzpatrick. Vol. 4684 I 2002. p. 278-286.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Styner, MA, Charles, HC, Park, J & Gerig, G 2002, Multi-site validation of image analysis methods - Assessing intra and inter-site variability. in M Sonka & J Michael Fitzpatrick (eds), Proceedings of SPIE - The International Society for Optical Engineering. vol. 4684 I, pp. 278-286, Medical Imaging 2002: Image Processing, San Diego, CA, United States, 2/24/02. https://doi.org/10.1117/12.467167
    Styner MA, Charles HC, Park J, Gerig G. Multi-site validation of image analysis methods - Assessing intra and inter-site variability. In Sonka M, Michael Fitzpatrick J, editors, Proceedings of SPIE - The International Society for Optical Engineering. Vol. 4684 I. 2002. p. 278-286 https://doi.org/10.1117/12.467167
    Styner, Martin A. ; Charles, H. Cecil ; Park, Jin ; Gerig, Guido. / Multi-site validation of image analysis methods - Assessing intra and inter-site variability. Proceedings of SPIE - The International Society for Optical Engineering. editor / M. Sonka ; J. Michael Fitzpatrick. Vol. 4684 I 2002. pp. 278-286
    @inproceedings{4fb49df38628471589e73fa24a126111,
    title = "Multi-site validation of image analysis methods - Assessing intra and inter-site variability",
    abstract = "In this work, we present a unique set of 3D MRI brain data that is appropriate for testing the intra and inter-site variability of image analysis methods. A single subject was scanned two times within a 24 hour time window each at five different MR sites over a period of six weeks using GE and Phillips 1.5 T scanners. The imaging protocol included T1 weighted, Proton Density and T2 weighted images. We applied three quantitative image analysis methods and analyzed their results via the coefficients of variability (COV) and the intra correlation coefficient. The tested methods include two multi-channel tissue segmentation techniques based on an anatomically guided manual seeding and an atlas-based seeding. The third tested method was a single-channel semi-automatic segmentation of the hippocampus. The results show that the outcome of image analysis methods varies significantly for images from different sites and scanners. With the exception of total brain volume, which shows consistent low variability across all images, the COV's were clearly larger between sites than within sites. Also, the COV's between sites with different scanner types are slightly larger than between sites with the same scanner type. The presented existence of a significant inter-site variability requires adaptations in image methods to produce repeatable measurements. This is especially of importance in multi-site clinical research.",
    keywords = "MRI, Multi-site, Quantitative Image Analysis, Reliability, Validation",
    author = "Styner, {Martin A.} and Charles, {H. Cecil} and Jin Park and Guido Gerig",
    year = "2002",
    doi = "10.1117/12.467167",
    language = "English (US)",
    volume = "4684 I",
    pages = "278--286",
    editor = "M. Sonka and {Michael Fitzpatrick}, J.",
    booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",

    }

    TY - GEN

    T1 - Multi-site validation of image analysis methods - Assessing intra and inter-site variability

    AU - Styner, Martin A.

    AU - Charles, H. Cecil

    AU - Park, Jin

    AU - Gerig, Guido

    PY - 2002

    Y1 - 2002

    N2 - In this work, we present a unique set of 3D MRI brain data that is appropriate for testing the intra and inter-site variability of image analysis methods. A single subject was scanned two times within a 24 hour time window each at five different MR sites over a period of six weeks using GE and Phillips 1.5 T scanners. The imaging protocol included T1 weighted, Proton Density and T2 weighted images. We applied three quantitative image analysis methods and analyzed their results via the coefficients of variability (COV) and the intra correlation coefficient. The tested methods include two multi-channel tissue segmentation techniques based on an anatomically guided manual seeding and an atlas-based seeding. The third tested method was a single-channel semi-automatic segmentation of the hippocampus. The results show that the outcome of image analysis methods varies significantly for images from different sites and scanners. With the exception of total brain volume, which shows consistent low variability across all images, the COV's were clearly larger between sites than within sites. Also, the COV's between sites with different scanner types are slightly larger than between sites with the same scanner type. The presented existence of a significant inter-site variability requires adaptations in image methods to produce repeatable measurements. This is especially of importance in multi-site clinical research.

    AB - In this work, we present a unique set of 3D MRI brain data that is appropriate for testing the intra and inter-site variability of image analysis methods. A single subject was scanned two times within a 24 hour time window each at five different MR sites over a period of six weeks using GE and Phillips 1.5 T scanners. The imaging protocol included T1 weighted, Proton Density and T2 weighted images. We applied three quantitative image analysis methods and analyzed their results via the coefficients of variability (COV) and the intra correlation coefficient. The tested methods include two multi-channel tissue segmentation techniques based on an anatomically guided manual seeding and an atlas-based seeding. The third tested method was a single-channel semi-automatic segmentation of the hippocampus. The results show that the outcome of image analysis methods varies significantly for images from different sites and scanners. With the exception of total brain volume, which shows consistent low variability across all images, the COV's were clearly larger between sites than within sites. Also, the COV's between sites with different scanner types are slightly larger than between sites with the same scanner type. The presented existence of a significant inter-site variability requires adaptations in image methods to produce repeatable measurements. This is especially of importance in multi-site clinical research.

    KW - MRI

    KW - Multi-site

    KW - Quantitative Image Analysis

    KW - Reliability

    KW - Validation

    UR - http://www.scopus.com/inward/record.url?scp=0036033733&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=0036033733&partnerID=8YFLogxK

    U2 - 10.1117/12.467167

    DO - 10.1117/12.467167

    M3 - Conference contribution

    AN - SCOPUS:0036033733

    VL - 4684 I

    SP - 278

    EP - 286

    BT - Proceedings of SPIE - The International Society for Optical Engineering

    A2 - Sonka, M.

    A2 - Michael Fitzpatrick, J.

    ER -