How deceptive are deceptive visualizations? An empirical analysis of common distortion techniques

Anshul Vikram Pandey, Katharina Rall, Margaret Satterthwaite, Oded Nov, Enrico Bertini

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    In this paper, we present an empirical analysis of deceptive visualizations. We start with an in-depth analysis of what deception means in the context of data visualization, and categorize deceptive visualizations based on the type of deception they lead to. We identify popular distortion techniques and the type of visualizations those distortions can be applied to, and formalize why deception occurs with those distortions. We create four deceptive visualizations using the selected distortion techniques, and run a crowdsourced user study to identify the deceptiveness of those visualizations. We then present the findings of our study and show how deceptive each of these visual distortion techniques are, and for what kind of questions the misinterpretation occurs. We also analyze individual differences among participants and present the effect of some of those variables on participants' responses. This paper presents a first step in empirically studying deceptive visualizations, and will pave the way for more research in this direction.

    Original languageEnglish (US)
    Title of host publicationCHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems: Crossings
    PublisherAssociation for Computing Machinery
    Pages1469-1478
    Number of pages10
    Volume2015-April
    ISBN (Print)9781450331456
    DOIs
    StatePublished - Apr 18 2015
    Event33rd Annual CHI Conference on Human Factors in Computing Systems, CHI 2015 - Seoul, Korea, Republic of
    Duration: Apr 18 2015Apr 23 2015

    Other

    Other33rd Annual CHI Conference on Human Factors in Computing Systems, CHI 2015
    CountryKorea, Republic of
    CitySeoul
    Period4/18/154/23/15

    Fingerprint

    Visualization
    Data visualization

    Keywords

    • Deceptive visualization
    • Empirical analysis
    • Evaluation

    ASJC Scopus subject areas

    • Human-Computer Interaction
    • Computer Graphics and Computer-Aided Design
    • Software

    Cite this

    Pandey, A. V., Rall, K., Satterthwaite, M., Nov, O., & Bertini, E. (2015). How deceptive are deceptive visualizations? An empirical analysis of common distortion techniques. In CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems: Crossings (Vol. 2015-April, pp. 1469-1478). Association for Computing Machinery. https://doi.org/10.1145/2702123.2702608

    How deceptive are deceptive visualizations? An empirical analysis of common distortion techniques. / Pandey, Anshul Vikram; Rall, Katharina; Satterthwaite, Margaret; Nov, Oded; Bertini, Enrico.

    CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems: Crossings. Vol. 2015-April Association for Computing Machinery, 2015. p. 1469-1478.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Pandey, AV, Rall, K, Satterthwaite, M, Nov, O & Bertini, E 2015, How deceptive are deceptive visualizations? An empirical analysis of common distortion techniques. in CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems: Crossings. vol. 2015-April, Association for Computing Machinery, pp. 1469-1478, 33rd Annual CHI Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Korea, Republic of, 4/18/15. https://doi.org/10.1145/2702123.2702608
    Pandey AV, Rall K, Satterthwaite M, Nov O, Bertini E. How deceptive are deceptive visualizations? An empirical analysis of common distortion techniques. In CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems: Crossings. Vol. 2015-April. Association for Computing Machinery. 2015. p. 1469-1478 https://doi.org/10.1145/2702123.2702608
    Pandey, Anshul Vikram ; Rall, Katharina ; Satterthwaite, Margaret ; Nov, Oded ; Bertini, Enrico. / How deceptive are deceptive visualizations? An empirical analysis of common distortion techniques. CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems: Crossings. Vol. 2015-April Association for Computing Machinery, 2015. pp. 1469-1478
    @inproceedings{a3e82303fd1a458a81806e82005bfece,
    title = "How deceptive are deceptive visualizations?: An empirical analysis of common distortion techniques",
    abstract = "In this paper, we present an empirical analysis of deceptive visualizations. We start with an in-depth analysis of what deception means in the context of data visualization, and categorize deceptive visualizations based on the type of deception they lead to. We identify popular distortion techniques and the type of visualizations those distortions can be applied to, and formalize why deception occurs with those distortions. We create four deceptive visualizations using the selected distortion techniques, and run a crowdsourced user study to identify the deceptiveness of those visualizations. We then present the findings of our study and show how deceptive each of these visual distortion techniques are, and for what kind of questions the misinterpretation occurs. We also analyze individual differences among participants and present the effect of some of those variables on participants' responses. This paper presents a first step in empirically studying deceptive visualizations, and will pave the way for more research in this direction.",
    keywords = "Deceptive visualization, Empirical analysis, Evaluation",
    author = "Pandey, {Anshul Vikram} and Katharina Rall and Margaret Satterthwaite and Oded Nov and Enrico Bertini",
    year = "2015",
    month = "4",
    day = "18",
    doi = "10.1145/2702123.2702608",
    language = "English (US)",
    isbn = "9781450331456",
    volume = "2015-April",
    pages = "1469--1478",
    booktitle = "CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems: Crossings",
    publisher = "Association for Computing Machinery",

    }

    TY - GEN

    T1 - How deceptive are deceptive visualizations?

    T2 - An empirical analysis of common distortion techniques

    AU - Pandey, Anshul Vikram

    AU - Rall, Katharina

    AU - Satterthwaite, Margaret

    AU - Nov, Oded

    AU - Bertini, Enrico

    PY - 2015/4/18

    Y1 - 2015/4/18

    N2 - In this paper, we present an empirical analysis of deceptive visualizations. We start with an in-depth analysis of what deception means in the context of data visualization, and categorize deceptive visualizations based on the type of deception they lead to. We identify popular distortion techniques and the type of visualizations those distortions can be applied to, and formalize why deception occurs with those distortions. We create four deceptive visualizations using the selected distortion techniques, and run a crowdsourced user study to identify the deceptiveness of those visualizations. We then present the findings of our study and show how deceptive each of these visual distortion techniques are, and for what kind of questions the misinterpretation occurs. We also analyze individual differences among participants and present the effect of some of those variables on participants' responses. This paper presents a first step in empirically studying deceptive visualizations, and will pave the way for more research in this direction.

    AB - In this paper, we present an empirical analysis of deceptive visualizations. We start with an in-depth analysis of what deception means in the context of data visualization, and categorize deceptive visualizations based on the type of deception they lead to. We identify popular distortion techniques and the type of visualizations those distortions can be applied to, and formalize why deception occurs with those distortions. We create four deceptive visualizations using the selected distortion techniques, and run a crowdsourced user study to identify the deceptiveness of those visualizations. We then present the findings of our study and show how deceptive each of these visual distortion techniques are, and for what kind of questions the misinterpretation occurs. We also analyze individual differences among participants and present the effect of some of those variables on participants' responses. This paper presents a first step in empirically studying deceptive visualizations, and will pave the way for more research in this direction.

    KW - Deceptive visualization

    KW - Empirical analysis

    KW - Evaluation

    UR - http://www.scopus.com/inward/record.url?scp=84951096830&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84951096830&partnerID=8YFLogxK

    U2 - 10.1145/2702123.2702608

    DO - 10.1145/2702123.2702608

    M3 - Conference contribution

    AN - SCOPUS:84951096830

    SN - 9781450331456

    VL - 2015-April

    SP - 1469

    EP - 1478

    BT - CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems: Crossings

    PB - Association for Computing Machinery

    ER -