Painterly rendering for video and interaction

Aaron Hertzmann, Kenneth Perlin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present new methods for painterly video processing. Based on our earlier still image processing technique, we "paint over" successive frames of animation, applying paint only in regions where the source video is changing. Image regions with minimal changes, such as due to video noise, are also left alone, using a simple difference masking technique. Optionally, brush strokes may be warped between frames using computed or procedural optical flow. These methods produce video with a novel visual style distinct from previously demonstrated algorithms. Without optical flow, the video gives the effect of a painting that has been repeatedly updated and photographed, similar to paint-on-glass animation. We feel that this gives a subjective impression of the work of a human hand. With optical flow, the painting surface flows and deforms to follow the shape of the world. We have constructed an interactive painting exhibit, in which a painting is continually updated. Viewers have found this to be a compelling experience, suggesting the promise of non-photorealistic rendering for creating compelling interactive visual experiences.

Original languageEnglish (US)
Title of host publicationProceedings first International Symposium on Non Photorealistic Animation and Rendering
EditorsS.N. Spencer, S.N. Spencer
Pages7-12
Number of pages6
StatePublished - 2000
EventProceedings First International Symposium on Non Photorealistic Animation and Rendering - Annecy, France
Duration: Jun 5 2000Jun 7 2000

Other

OtherProceedings First International Symposium on Non Photorealistic Animation and Rendering
CountryFrance
CityAnnecy
Period6/5/006/7/00

Fingerprint

Painting
Optical flows
Paint
Animation
Brushes
Image processing
Glass
Processing

Keywords

  • Animation
  • Non-photorealistic rendering
  • Painterly rendering
  • Video processing

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Hertzmann, A., & Perlin, K. (2000). Painterly rendering for video and interaction. In S. N. Spencer, & S. N. Spencer (Eds.), Proceedings first International Symposium on Non Photorealistic Animation and Rendering (pp. 7-12)

Painterly rendering for video and interaction. / Hertzmann, Aaron; Perlin, Kenneth.

Proceedings first International Symposium on Non Photorealistic Animation and Rendering. ed. / S.N. Spencer; S.N. Spencer. 2000. p. 7-12.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hertzmann, A & Perlin, K 2000, Painterly rendering for video and interaction. in SN Spencer & SN Spencer (eds), Proceedings first International Symposium on Non Photorealistic Animation and Rendering. pp. 7-12, Proceedings First International Symposium on Non Photorealistic Animation and Rendering, Annecy, France, 6/5/00.
Hertzmann A, Perlin K. Painterly rendering for video and interaction. In Spencer SN, Spencer SN, editors, Proceedings first International Symposium on Non Photorealistic Animation and Rendering. 2000. p. 7-12
Hertzmann, Aaron ; Perlin, Kenneth. / Painterly rendering for video and interaction. Proceedings first International Symposium on Non Photorealistic Animation and Rendering. editor / S.N. Spencer ; S.N. Spencer. 2000. pp. 7-12
@inproceedings{437e69b551a0420abd45fe2f443fdc0a,
title = "Painterly rendering for video and interaction",
abstract = "We present new methods for painterly video processing. Based on our earlier still image processing technique, we {"}paint over{"} successive frames of animation, applying paint only in regions where the source video is changing. Image regions with minimal changes, such as due to video noise, are also left alone, using a simple difference masking technique. Optionally, brush strokes may be warped between frames using computed or procedural optical flow. These methods produce video with a novel visual style distinct from previously demonstrated algorithms. Without optical flow, the video gives the effect of a painting that has been repeatedly updated and photographed, similar to paint-on-glass animation. We feel that this gives a subjective impression of the work of a human hand. With optical flow, the painting surface flows and deforms to follow the shape of the world. We have constructed an interactive painting exhibit, in which a painting is continually updated. Viewers have found this to be a compelling experience, suggesting the promise of non-photorealistic rendering for creating compelling interactive visual experiences.",
keywords = "Animation, Non-photorealistic rendering, Painterly rendering, Video processing",
author = "Aaron Hertzmann and Kenneth Perlin",
year = "2000",
language = "English (US)",
isbn = "1581132778",
pages = "7--12",
editor = "S.N. Spencer and S.N. Spencer",
booktitle = "Proceedings first International Symposium on Non Photorealistic Animation and Rendering",

}

TY - GEN

T1 - Painterly rendering for video and interaction

AU - Hertzmann, Aaron

AU - Perlin, Kenneth

PY - 2000

Y1 - 2000

N2 - We present new methods for painterly video processing. Based on our earlier still image processing technique, we "paint over" successive frames of animation, applying paint only in regions where the source video is changing. Image regions with minimal changes, such as due to video noise, are also left alone, using a simple difference masking technique. Optionally, brush strokes may be warped between frames using computed or procedural optical flow. These methods produce video with a novel visual style distinct from previously demonstrated algorithms. Without optical flow, the video gives the effect of a painting that has been repeatedly updated and photographed, similar to paint-on-glass animation. We feel that this gives a subjective impression of the work of a human hand. With optical flow, the painting surface flows and deforms to follow the shape of the world. We have constructed an interactive painting exhibit, in which a painting is continually updated. Viewers have found this to be a compelling experience, suggesting the promise of non-photorealistic rendering for creating compelling interactive visual experiences.

AB - We present new methods for painterly video processing. Based on our earlier still image processing technique, we "paint over" successive frames of animation, applying paint only in regions where the source video is changing. Image regions with minimal changes, such as due to video noise, are also left alone, using a simple difference masking technique. Optionally, brush strokes may be warped between frames using computed or procedural optical flow. These methods produce video with a novel visual style distinct from previously demonstrated algorithms. Without optical flow, the video gives the effect of a painting that has been repeatedly updated and photographed, similar to paint-on-glass animation. We feel that this gives a subjective impression of the work of a human hand. With optical flow, the painting surface flows and deforms to follow the shape of the world. We have constructed an interactive painting exhibit, in which a painting is continually updated. Viewers have found this to be a compelling experience, suggesting the promise of non-photorealistic rendering for creating compelling interactive visual experiences.

KW - Animation

KW - Non-photorealistic rendering

KW - Painterly rendering

KW - Video processing

UR - http://www.scopus.com/inward/record.url?scp=0034592580&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0034592580&partnerID=8YFLogxK

M3 - Conference contribution

SN - 1581132778

SP - 7

EP - 12

BT - Proceedings first International Symposium on Non Photorealistic Animation and Rendering

A2 - Spencer, S.N.

A2 - Spencer, S.N.

ER -