Pixelated image abstraction with integrated user constraints

Timothy Gerstner, Doug Decarlo, Marc Alexa, Adam Finkelstein, Yotam Gingold, Andrew Nealen

    Research output: Contribution to journalArticle

    Abstract

    We present an automatic method that can be used to abstract high resolution images into very low resolution outputs with reduced color palettes in the style of pixel art. Our method simultaneously solves for a mapping of features and a reduced palette needed to construct the output image. The results are an approximation to the results generated by pixel artists. We compare our method against the results of two naive methods common to image manipulation programs, as well as the hand-crafted work of pixel artists. Through a formal user study and interviews with expert pixel artists we show that our results offer an improvement over the naive methods. By integrating a set of manual controls into our algorithm, we give users the ability to add constraints and incorporate their own choices into the iterative process.

    Original languageEnglish (US)
    Pages (from-to)333-347
    Number of pages15
    JournalComputers and Graphics (Pergamon)
    Volume37
    Issue number5
    DOIs
    StatePublished - 2013

    Fingerprint

    Pixels
    Manual control
    Optical resolving power
    Image resolution
    Color

    Keywords

    • Color quantization
    • Image abstraction
    • Image segmentation
    • Non-photorealistic rendering
    • Pixel art

    ASJC Scopus subject areas

    • Computer Graphics and Computer-Aided Design
    • Human-Computer Interaction
    • Engineering(all)

    Cite this

    Gerstner, T., Decarlo, D., Alexa, M., Finkelstein, A., Gingold, Y., & Nealen, A. (2013). Pixelated image abstraction with integrated user constraints. Computers and Graphics (Pergamon), 37(5), 333-347. https://doi.org/10.1016/j.cag.2012.12.007

    Pixelated image abstraction with integrated user constraints. / Gerstner, Timothy; Decarlo, Doug; Alexa, Marc; Finkelstein, Adam; Gingold, Yotam; Nealen, Andrew.

    In: Computers and Graphics (Pergamon), Vol. 37, No. 5, 2013, p. 333-347.

    Research output: Contribution to journalArticle

    Gerstner, T, Decarlo, D, Alexa, M, Finkelstein, A, Gingold, Y & Nealen, A 2013, 'Pixelated image abstraction with integrated user constraints', Computers and Graphics (Pergamon), vol. 37, no. 5, pp. 333-347. https://doi.org/10.1016/j.cag.2012.12.007
    Gerstner T, Decarlo D, Alexa M, Finkelstein A, Gingold Y, Nealen A. Pixelated image abstraction with integrated user constraints. Computers and Graphics (Pergamon). 2013;37(5):333-347. https://doi.org/10.1016/j.cag.2012.12.007
    Gerstner, Timothy ; Decarlo, Doug ; Alexa, Marc ; Finkelstein, Adam ; Gingold, Yotam ; Nealen, Andrew. / Pixelated image abstraction with integrated user constraints. In: Computers and Graphics (Pergamon). 2013 ; Vol. 37, No. 5. pp. 333-347.
    @article{70370dff636c47489ca52e76e868fc79,
    title = "Pixelated image abstraction with integrated user constraints",
    abstract = "We present an automatic method that can be used to abstract high resolution images into very low resolution outputs with reduced color palettes in the style of pixel art. Our method simultaneously solves for a mapping of features and a reduced palette needed to construct the output image. The results are an approximation to the results generated by pixel artists. We compare our method against the results of two naive methods common to image manipulation programs, as well as the hand-crafted work of pixel artists. Through a formal user study and interviews with expert pixel artists we show that our results offer an improvement over the naive methods. By integrating a set of manual controls into our algorithm, we give users the ability to add constraints and incorporate their own choices into the iterative process.",
    keywords = "Color quantization, Image abstraction, Image segmentation, Non-photorealistic rendering, Pixel art",
    author = "Timothy Gerstner and Doug Decarlo and Marc Alexa and Adam Finkelstein and Yotam Gingold and Andrew Nealen",
    year = "2013",
    doi = "10.1016/j.cag.2012.12.007",
    language = "English (US)",
    volume = "37",
    pages = "333--347",
    journal = "Computers and Graphics",
    issn = "0097-8493",
    publisher = "Elsevier Limited",
    number = "5",

    }

    TY - JOUR

    T1 - Pixelated image abstraction with integrated user constraints

    AU - Gerstner, Timothy

    AU - Decarlo, Doug

    AU - Alexa, Marc

    AU - Finkelstein, Adam

    AU - Gingold, Yotam

    AU - Nealen, Andrew

    PY - 2013

    Y1 - 2013

    N2 - We present an automatic method that can be used to abstract high resolution images into very low resolution outputs with reduced color palettes in the style of pixel art. Our method simultaneously solves for a mapping of features and a reduced palette needed to construct the output image. The results are an approximation to the results generated by pixel artists. We compare our method against the results of two naive methods common to image manipulation programs, as well as the hand-crafted work of pixel artists. Through a formal user study and interviews with expert pixel artists we show that our results offer an improvement over the naive methods. By integrating a set of manual controls into our algorithm, we give users the ability to add constraints and incorporate their own choices into the iterative process.

    AB - We present an automatic method that can be used to abstract high resolution images into very low resolution outputs with reduced color palettes in the style of pixel art. Our method simultaneously solves for a mapping of features and a reduced palette needed to construct the output image. The results are an approximation to the results generated by pixel artists. We compare our method against the results of two naive methods common to image manipulation programs, as well as the hand-crafted work of pixel artists. Through a formal user study and interviews with expert pixel artists we show that our results offer an improvement over the naive methods. By integrating a set of manual controls into our algorithm, we give users the ability to add constraints and incorporate their own choices into the iterative process.

    KW - Color quantization

    KW - Image abstraction

    KW - Image segmentation

    KW - Non-photorealistic rendering

    KW - Pixel art

    UR - http://www.scopus.com/inward/record.url?scp=84876575584&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84876575584&partnerID=8YFLogxK

    U2 - 10.1016/j.cag.2012.12.007

    DO - 10.1016/j.cag.2012.12.007

    M3 - Article

    VL - 37

    SP - 333

    EP - 347

    JO - Computers and Graphics

    JF - Computers and Graphics

    SN - 0097-8493

    IS - 5

    ER -