Facial expression transfer with input-output Temporal Restricted Boltzmann Machines

Matthew D. Zeiler, Graham W. Taylor, Leonid Sigal, Iain Matthews, Rob Fergus

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present a type of Temporal Restricted Boltzmann Machine that defines a probability distribution over an output sequence conditional on an input sequence. It shares the desirable properties of RBMs: efficient exact inference, an exponentially more expressive latent state than HMMs, and the ability to model nonlinear structure and dynamics. We apply our model to a challenging real-world graphics problem: facial expression transfer. Our results demonstrate improved performance over several baselines modeling high-dimensional 2D and 3D data.

Original languageEnglish (US)
Title of host publicationAdvances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011
StatePublished - 2011
Event25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011 - Granada, Spain
Duration: Dec 12 2011Dec 14 2011

Other

Other25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011
CountrySpain
CityGranada
Period12/12/1112/14/11

Fingerprint

Probability distributions

ASJC Scopus subject areas

  • Information Systems

Cite this

Zeiler, M. D., Taylor, G. W., Sigal, L., Matthews, I., & Fergus, R. (2011). Facial expression transfer with input-output Temporal Restricted Boltzmann Machines. In Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011

Facial expression transfer with input-output Temporal Restricted Boltzmann Machines. / Zeiler, Matthew D.; Taylor, Graham W.; Sigal, Leonid; Matthews, Iain; Fergus, Rob.

Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011. 2011.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Zeiler, MD, Taylor, GW, Sigal, L, Matthews, I & Fergus, R 2011, Facial expression transfer with input-output Temporal Restricted Boltzmann Machines. in Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011. 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011, Granada, Spain, 12/12/11.
Zeiler MD, Taylor GW, Sigal L, Matthews I, Fergus R. Facial expression transfer with input-output Temporal Restricted Boltzmann Machines. In Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011. 2011
Zeiler, Matthew D. ; Taylor, Graham W. ; Sigal, Leonid ; Matthews, Iain ; Fergus, Rob. / Facial expression transfer with input-output Temporal Restricted Boltzmann Machines. Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011. 2011.
@inproceedings{a24e09aca12f4a10ae015f548916fad5,
title = "Facial expression transfer with input-output Temporal Restricted Boltzmann Machines",
abstract = "We present a type of Temporal Restricted Boltzmann Machine that defines a probability distribution over an output sequence conditional on an input sequence. It shares the desirable properties of RBMs: efficient exact inference, an exponentially more expressive latent state than HMMs, and the ability to model nonlinear structure and dynamics. We apply our model to a challenging real-world graphics problem: facial expression transfer. Our results demonstrate improved performance over several baselines modeling high-dimensional 2D and 3D data.",
author = "Zeiler, {Matthew D.} and Taylor, {Graham W.} and Leonid Sigal and Iain Matthews and Rob Fergus",
year = "2011",
language = "English (US)",
isbn = "9781618395993",
booktitle = "Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011",

}

TY - GEN

T1 - Facial expression transfer with input-output Temporal Restricted Boltzmann Machines

AU - Zeiler, Matthew D.

AU - Taylor, Graham W.

AU - Sigal, Leonid

AU - Matthews, Iain

AU - Fergus, Rob

PY - 2011

Y1 - 2011

N2 - We present a type of Temporal Restricted Boltzmann Machine that defines a probability distribution over an output sequence conditional on an input sequence. It shares the desirable properties of RBMs: efficient exact inference, an exponentially more expressive latent state than HMMs, and the ability to model nonlinear structure and dynamics. We apply our model to a challenging real-world graphics problem: facial expression transfer. Our results demonstrate improved performance over several baselines modeling high-dimensional 2D and 3D data.

AB - We present a type of Temporal Restricted Boltzmann Machine that defines a probability distribution over an output sequence conditional on an input sequence. It shares the desirable properties of RBMs: efficient exact inference, an exponentially more expressive latent state than HMMs, and the ability to model nonlinear structure and dynamics. We apply our model to a challenging real-world graphics problem: facial expression transfer. Our results demonstrate improved performance over several baselines modeling high-dimensional 2D and 3D data.

UR - http://www.scopus.com/inward/record.url?scp=84860646071&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84860646071&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9781618395993

BT - Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011

ER -