Informing the design of direct-to-consumer interactive personal genomics reports

Orit Shaer, Oded Nov, Johanna Okerlund, Martina Balestra, Elizabeth Stowell, Laura Ascher, Joanna Bi, Claire Schlenker, Madeleine Ball

    Research output: Contribution to journalArticle

    Abstract

    Background: In recent years, people who sought direct-to-consumer genetic testing services have been increasingly confronted with an unprecedented amount of personal genomic information, which influences their decisions, emotional state, and well-being. However, these users of direct-to-consumer genetic services, who vary in their education and interests, frequently have little relevant experience or tools for understanding, reasoning about, and interacting with their personal genomic data. Online interactive techniques can play a central role in making personal genomic data useful for these users. Objective: We sought to (1) identify the needs of diverse users as they make sense of their personal genomic data, (2) consequently develop effective interactive visualizations of genomic trait data to address these users' needs, and (3) evaluate the effectiveness of the developed visualizations in facilitating comprehension. Methods: The first two user studies, conducted with 63 volunteers in the Personal Genome Project and with 36 personal genomic users who participated in a design workshop, respectively, employed surveys and interviews to identify the needs and expectations of diverse users. Building on the two initial studies, the third study was conducted with 730 Amazon Mechanical Turk users and employed a controlled experimental design to examine the effectiveness of different design interventions on user comprehension. Results: The first two studies identified searching, comparing, sharing, and organizing data as fundamental to users' understanding of personal genomic data. The third study demonstrated that interactive and visual design interventions could improve the understandability of personal genomic reports for consumers. In particular, results showed that a new interactive bubble chart visualization designed for the study resulted in the highest comprehension scores, as well as the highest perceived comprehension scores. These scores were significantly higher than scores received using the industry standard tabular reports currently used for communicating personal genomic information. Conclusions: Drawing on multiple research methods and populations, the findings of the studies reported in this paper offer deep understanding of users' needs and practices, and demonstrate that interactive online design interventions can improve the understandability of personal genomic reports for consumers. We discuss implications for designers and researchers.

    Original languageEnglish (US)
    Pages (from-to)e146
    JournalJournal of Medical Internet Research
    Volume17
    Issue number6
    DOIs
    StatePublished - Jun 1 2015

    Fingerprint

    Genomics
    Genetic Services
    Education
    Information Dissemination
    Genetic Testing
    Volunteers
    Industry
    Research Design
    Research Personnel
    Genome
    Interviews
    Research
    Population

    Keywords

    • Direct-to-consumer genetic testing
    • Genetic testing
    • Genomics
    • Interactive visualizations
    • Personal electronic health records

    ASJC Scopus subject areas

    • Health Informatics

    Cite this

    Shaer, O., Nov, O., Okerlund, J., Balestra, M., Stowell, E., Ascher, L., ... Ball, M. (2015). Informing the design of direct-to-consumer interactive personal genomics reports. Journal of Medical Internet Research, 17(6), e146. https://doi.org/10.2196/jmir.4415

    Informing the design of direct-to-consumer interactive personal genomics reports. / Shaer, Orit; Nov, Oded; Okerlund, Johanna; Balestra, Martina; Stowell, Elizabeth; Ascher, Laura; Bi, Joanna; Schlenker, Claire; Ball, Madeleine.

    In: Journal of Medical Internet Research, Vol. 17, No. 6, 01.06.2015, p. e146.

    Research output: Contribution to journalArticle

    Shaer, O, Nov, O, Okerlund, J, Balestra, M, Stowell, E, Ascher, L, Bi, J, Schlenker, C & Ball, M 2015, 'Informing the design of direct-to-consumer interactive personal genomics reports', Journal of Medical Internet Research, vol. 17, no. 6, pp. e146. https://doi.org/10.2196/jmir.4415
    Shaer, Orit ; Nov, Oded ; Okerlund, Johanna ; Balestra, Martina ; Stowell, Elizabeth ; Ascher, Laura ; Bi, Joanna ; Schlenker, Claire ; Ball, Madeleine. / Informing the design of direct-to-consumer interactive personal genomics reports. In: Journal of Medical Internet Research. 2015 ; Vol. 17, No. 6. pp. e146.
    @article{d02307d6f3e046eca074c33437b2e57a,
    title = "Informing the design of direct-to-consumer interactive personal genomics reports",
    abstract = "Background: In recent years, people who sought direct-to-consumer genetic testing services have been increasingly confronted with an unprecedented amount of personal genomic information, which influences their decisions, emotional state, and well-being. However, these users of direct-to-consumer genetic services, who vary in their education and interests, frequently have little relevant experience or tools for understanding, reasoning about, and interacting with their personal genomic data. Online interactive techniques can play a central role in making personal genomic data useful for these users. Objective: We sought to (1) identify the needs of diverse users as they make sense of their personal genomic data, (2) consequently develop effective interactive visualizations of genomic trait data to address these users' needs, and (3) evaluate the effectiveness of the developed visualizations in facilitating comprehension. Methods: The first two user studies, conducted with 63 volunteers in the Personal Genome Project and with 36 personal genomic users who participated in a design workshop, respectively, employed surveys and interviews to identify the needs and expectations of diverse users. Building on the two initial studies, the third study was conducted with 730 Amazon Mechanical Turk users and employed a controlled experimental design to examine the effectiveness of different design interventions on user comprehension. Results: The first two studies identified searching, comparing, sharing, and organizing data as fundamental to users' understanding of personal genomic data. The third study demonstrated that interactive and visual design interventions could improve the understandability of personal genomic reports for consumers. In particular, results showed that a new interactive bubble chart visualization designed for the study resulted in the highest comprehension scores, as well as the highest perceived comprehension scores. These scores were significantly higher than scores received using the industry standard tabular reports currently used for communicating personal genomic information. Conclusions: Drawing on multiple research methods and populations, the findings of the studies reported in this paper offer deep understanding of users' needs and practices, and demonstrate that interactive online design interventions can improve the understandability of personal genomic reports for consumers. We discuss implications for designers and researchers.",
    keywords = "Direct-to-consumer genetic testing, Genetic testing, Genomics, Interactive visualizations, Personal electronic health records",
    author = "Orit Shaer and Oded Nov and Johanna Okerlund and Martina Balestra and Elizabeth Stowell and Laura Ascher and Joanna Bi and Claire Schlenker and Madeleine Ball",
    year = "2015",
    month = "6",
    day = "1",
    doi = "10.2196/jmir.4415",
    language = "English (US)",
    volume = "17",
    pages = "e146",
    journal = "Journal of Medical Internet Research",
    issn = "1439-4456",
    publisher = "Journal of medical Internet Research",
    number = "6",

    }

    TY - JOUR

    T1 - Informing the design of direct-to-consumer interactive personal genomics reports

    AU - Shaer, Orit

    AU - Nov, Oded

    AU - Okerlund, Johanna

    AU - Balestra, Martina

    AU - Stowell, Elizabeth

    AU - Ascher, Laura

    AU - Bi, Joanna

    AU - Schlenker, Claire

    AU - Ball, Madeleine

    PY - 2015/6/1

    Y1 - 2015/6/1

    N2 - Background: In recent years, people who sought direct-to-consumer genetic testing services have been increasingly confronted with an unprecedented amount of personal genomic information, which influences their decisions, emotional state, and well-being. However, these users of direct-to-consumer genetic services, who vary in their education and interests, frequently have little relevant experience or tools for understanding, reasoning about, and interacting with their personal genomic data. Online interactive techniques can play a central role in making personal genomic data useful for these users. Objective: We sought to (1) identify the needs of diverse users as they make sense of their personal genomic data, (2) consequently develop effective interactive visualizations of genomic trait data to address these users' needs, and (3) evaluate the effectiveness of the developed visualizations in facilitating comprehension. Methods: The first two user studies, conducted with 63 volunteers in the Personal Genome Project and with 36 personal genomic users who participated in a design workshop, respectively, employed surveys and interviews to identify the needs and expectations of diverse users. Building on the two initial studies, the third study was conducted with 730 Amazon Mechanical Turk users and employed a controlled experimental design to examine the effectiveness of different design interventions on user comprehension. Results: The first two studies identified searching, comparing, sharing, and organizing data as fundamental to users' understanding of personal genomic data. The third study demonstrated that interactive and visual design interventions could improve the understandability of personal genomic reports for consumers. In particular, results showed that a new interactive bubble chart visualization designed for the study resulted in the highest comprehension scores, as well as the highest perceived comprehension scores. These scores were significantly higher than scores received using the industry standard tabular reports currently used for communicating personal genomic information. Conclusions: Drawing on multiple research methods and populations, the findings of the studies reported in this paper offer deep understanding of users' needs and practices, and demonstrate that interactive online design interventions can improve the understandability of personal genomic reports for consumers. We discuss implications for designers and researchers.

    AB - Background: In recent years, people who sought direct-to-consumer genetic testing services have been increasingly confronted with an unprecedented amount of personal genomic information, which influences their decisions, emotional state, and well-being. However, these users of direct-to-consumer genetic services, who vary in their education and interests, frequently have little relevant experience or tools for understanding, reasoning about, and interacting with their personal genomic data. Online interactive techniques can play a central role in making personal genomic data useful for these users. Objective: We sought to (1) identify the needs of diverse users as they make sense of their personal genomic data, (2) consequently develop effective interactive visualizations of genomic trait data to address these users' needs, and (3) evaluate the effectiveness of the developed visualizations in facilitating comprehension. Methods: The first two user studies, conducted with 63 volunteers in the Personal Genome Project and with 36 personal genomic users who participated in a design workshop, respectively, employed surveys and interviews to identify the needs and expectations of diverse users. Building on the two initial studies, the third study was conducted with 730 Amazon Mechanical Turk users and employed a controlled experimental design to examine the effectiveness of different design interventions on user comprehension. Results: The first two studies identified searching, comparing, sharing, and organizing data as fundamental to users' understanding of personal genomic data. The third study demonstrated that interactive and visual design interventions could improve the understandability of personal genomic reports for consumers. In particular, results showed that a new interactive bubble chart visualization designed for the study resulted in the highest comprehension scores, as well as the highest perceived comprehension scores. These scores were significantly higher than scores received using the industry standard tabular reports currently used for communicating personal genomic information. Conclusions: Drawing on multiple research methods and populations, the findings of the studies reported in this paper offer deep understanding of users' needs and practices, and demonstrate that interactive online design interventions can improve the understandability of personal genomic reports for consumers. We discuss implications for designers and researchers.

    KW - Direct-to-consumer genetic testing

    KW - Genetic testing

    KW - Genomics

    KW - Interactive visualizations

    KW - Personal electronic health records

    UR - http://www.scopus.com/inward/record.url?scp=84936762693&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84936762693&partnerID=8YFLogxK

    U2 - 10.2196/jmir.4415

    DO - 10.2196/jmir.4415

    M3 - Article

    VL - 17

    SP - e146

    JO - Journal of Medical Internet Research

    JF - Journal of Medical Internet Research

    SN - 1439-4456

    IS - 6

    ER -