Exploring genetic data across individuals: Design and evaluation of a novel comparative report tool

Lauren Westendorf, Orit Shaer, Christina Pollalis, Clarissa Verish, Oded Nov, Mad Price Ball

    Research output: Contribution to journalArticle

    Abstract

    Background: The growth in the availability of personal genomic data to nonexperts poses multiple challenges to human-computer interaction research; data are highly sensitive, complex, and have health implications for individuals and families. However, there has been little research on how nonexpert users explore their genomic data. Objective: We focus on how to support nonexperts in exploring and comparing their own personal genomic report with those of other people. We designed and evaluated CrossGenomics, a novel tool for comparing personal genetic reports, which enables exploration of shared and unshared genetic variants. Focusing on communicating comparative impact, rarity, and certainty, we evaluated alternative novel interactive prototypes. Methods: We conducted 3 user studies. The first focuses on assessing the usability and understandability of a prototype that facilitates the comparison of reports from 2 family members. Following a design iteration, we studied how various prototypes support the comparison of genetic reports of a 4-person family. Finally, we evaluated the needs of early adopters-people who share their genetic reports publicly for comparing their genetic reports with that of others. Results: In the first study, sunburst- and Venn-based comparisons of two genomes led to significantly higher domain comprehension, compared with the linear comparison and with the commonly used tabular format. However, results show gaps between objective and subjective comprehension, as sunburst users reported significantly lower perceived understanding and higher levels of confusion than the users of the tabular report. In the second study, users who were allowed to switch between the different comparison views presented higher comprehension levels, as well as more complex reasoning than users who were limited to a single comparison view. In the third study, 35% (17/49) reported learning something new from comparing their own data with another person's data. Users indicated that filtering and toggling between comparison views were the most useful features. Conclusions: Our findings (1) highlight features and visualizations that show strengths in facilitating user comprehension of genomic data, (2) demonstrate the value of affording users the flexibility to examine the same report using multiple views, and (3) emphasize users' needs in comparison of genomic data. We conclude with design implications for engaging nonexperts with complex multidimensional genomic data.

    Original languageEnglish (US)
    Article numbere10297
    JournalJournal of Medical Internet Research
    Volume20
    Issue number9
    DOIs
    StatePublished - Sep 1 2018

    Fingerprint

    Confusion
    Research
    Learning
    Genome
    Health
    Growth

    Keywords

    • Consumer health informatics
    • Genomics

    ASJC Scopus subject areas

    • Health Informatics

    Cite this

    Exploring genetic data across individuals : Design and evaluation of a novel comparative report tool. / Westendorf, Lauren; Shaer, Orit; Pollalis, Christina; Verish, Clarissa; Nov, Oded; Ball, Mad Price.

    In: Journal of Medical Internet Research, Vol. 20, No. 9, e10297, 01.09.2018.

    Research output: Contribution to journalArticle

    Westendorf, Lauren ; Shaer, Orit ; Pollalis, Christina ; Verish, Clarissa ; Nov, Oded ; Ball, Mad Price. / Exploring genetic data across individuals : Design and evaluation of a novel comparative report tool. In: Journal of Medical Internet Research. 2018 ; Vol. 20, No. 9.
    @article{3b2280a9457a40899c34ebcef0a98005,
    title = "Exploring genetic data across individuals: Design and evaluation of a novel comparative report tool",
    abstract = "Background: The growth in the availability of personal genomic data to nonexperts poses multiple challenges to human-computer interaction research; data are highly sensitive, complex, and have health implications for individuals and families. However, there has been little research on how nonexpert users explore their genomic data. Objective: We focus on how to support nonexperts in exploring and comparing their own personal genomic report with those of other people. We designed and evaluated CrossGenomics, a novel tool for comparing personal genetic reports, which enables exploration of shared and unshared genetic variants. Focusing on communicating comparative impact, rarity, and certainty, we evaluated alternative novel interactive prototypes. Methods: We conducted 3 user studies. The first focuses on assessing the usability and understandability of a prototype that facilitates the comparison of reports from 2 family members. Following a design iteration, we studied how various prototypes support the comparison of genetic reports of a 4-person family. Finally, we evaluated the needs of early adopters-people who share their genetic reports publicly for comparing their genetic reports with that of others. Results: In the first study, sunburst- and Venn-based comparisons of two genomes led to significantly higher domain comprehension, compared with the linear comparison and with the commonly used tabular format. However, results show gaps between objective and subjective comprehension, as sunburst users reported significantly lower perceived understanding and higher levels of confusion than the users of the tabular report. In the second study, users who were allowed to switch between the different comparison views presented higher comprehension levels, as well as more complex reasoning than users who were limited to a single comparison view. In the third study, 35{\%} (17/49) reported learning something new from comparing their own data with another person's data. Users indicated that filtering and toggling between comparison views were the most useful features. Conclusions: Our findings (1) highlight features and visualizations that show strengths in facilitating user comprehension of genomic data, (2) demonstrate the value of affording users the flexibility to examine the same report using multiple views, and (3) emphasize users' needs in comparison of genomic data. We conclude with design implications for engaging nonexperts with complex multidimensional genomic data.",
    keywords = "Consumer health informatics, Genomics",
    author = "Lauren Westendorf and Orit Shaer and Christina Pollalis and Clarissa Verish and Oded Nov and Ball, {Mad Price}",
    year = "2018",
    month = "9",
    day = "1",
    doi = "10.2196/10297",
    language = "English (US)",
    volume = "20",
    journal = "Journal of Medical Internet Research",
    issn = "1439-4456",
    publisher = "Journal of medical Internet Research",
    number = "9",

    }

    TY - JOUR

    T1 - Exploring genetic data across individuals

    T2 - Design and evaluation of a novel comparative report tool

    AU - Westendorf, Lauren

    AU - Shaer, Orit

    AU - Pollalis, Christina

    AU - Verish, Clarissa

    AU - Nov, Oded

    AU - Ball, Mad Price

    PY - 2018/9/1

    Y1 - 2018/9/1

    N2 - Background: The growth in the availability of personal genomic data to nonexperts poses multiple challenges to human-computer interaction research; data are highly sensitive, complex, and have health implications for individuals and families. However, there has been little research on how nonexpert users explore their genomic data. Objective: We focus on how to support nonexperts in exploring and comparing their own personal genomic report with those of other people. We designed and evaluated CrossGenomics, a novel tool for comparing personal genetic reports, which enables exploration of shared and unshared genetic variants. Focusing on communicating comparative impact, rarity, and certainty, we evaluated alternative novel interactive prototypes. Methods: We conducted 3 user studies. The first focuses on assessing the usability and understandability of a prototype that facilitates the comparison of reports from 2 family members. Following a design iteration, we studied how various prototypes support the comparison of genetic reports of a 4-person family. Finally, we evaluated the needs of early adopters-people who share their genetic reports publicly for comparing their genetic reports with that of others. Results: In the first study, sunburst- and Venn-based comparisons of two genomes led to significantly higher domain comprehension, compared with the linear comparison and with the commonly used tabular format. However, results show gaps between objective and subjective comprehension, as sunburst users reported significantly lower perceived understanding and higher levels of confusion than the users of the tabular report. In the second study, users who were allowed to switch between the different comparison views presented higher comprehension levels, as well as more complex reasoning than users who were limited to a single comparison view. In the third study, 35% (17/49) reported learning something new from comparing their own data with another person's data. Users indicated that filtering and toggling between comparison views were the most useful features. Conclusions: Our findings (1) highlight features and visualizations that show strengths in facilitating user comprehension of genomic data, (2) demonstrate the value of affording users the flexibility to examine the same report using multiple views, and (3) emphasize users' needs in comparison of genomic data. We conclude with design implications for engaging nonexperts with complex multidimensional genomic data.

    AB - Background: The growth in the availability of personal genomic data to nonexperts poses multiple challenges to human-computer interaction research; data are highly sensitive, complex, and have health implications for individuals and families. However, there has been little research on how nonexpert users explore their genomic data. Objective: We focus on how to support nonexperts in exploring and comparing their own personal genomic report with those of other people. We designed and evaluated CrossGenomics, a novel tool for comparing personal genetic reports, which enables exploration of shared and unshared genetic variants. Focusing on communicating comparative impact, rarity, and certainty, we evaluated alternative novel interactive prototypes. Methods: We conducted 3 user studies. The first focuses on assessing the usability and understandability of a prototype that facilitates the comparison of reports from 2 family members. Following a design iteration, we studied how various prototypes support the comparison of genetic reports of a 4-person family. Finally, we evaluated the needs of early adopters-people who share their genetic reports publicly for comparing their genetic reports with that of others. Results: In the first study, sunburst- and Venn-based comparisons of two genomes led to significantly higher domain comprehension, compared with the linear comparison and with the commonly used tabular format. However, results show gaps between objective and subjective comprehension, as sunburst users reported significantly lower perceived understanding and higher levels of confusion than the users of the tabular report. In the second study, users who were allowed to switch between the different comparison views presented higher comprehension levels, as well as more complex reasoning than users who were limited to a single comparison view. In the third study, 35% (17/49) reported learning something new from comparing their own data with another person's data. Users indicated that filtering and toggling between comparison views were the most useful features. Conclusions: Our findings (1) highlight features and visualizations that show strengths in facilitating user comprehension of genomic data, (2) demonstrate the value of affording users the flexibility to examine the same report using multiple views, and (3) emphasize users' needs in comparison of genomic data. We conclude with design implications for engaging nonexperts with complex multidimensional genomic data.

    KW - Consumer health informatics

    KW - Genomics

    UR - http://www.scopus.com/inward/record.url?scp=85054230251&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85054230251&partnerID=8YFLogxK

    U2 - 10.2196/10297

    DO - 10.2196/10297

    M3 - Article

    C2 - 30249582

    AN - SCOPUS:85054230251

    VL - 20

    JO - Journal of Medical Internet Research

    JF - Journal of Medical Internet Research

    SN - 1439-4456

    IS - 9

    M1 - e10297

    ER -