Robust Physics-based Motion Retargeting with Realistic Body Shapes

Mazen Al Borno, Ludovic Righetti, Michael J. Black, Scott L. Delp, Eugene Fiume, Javier Romero

Research output: Contribution to journalArticle

Abstract

Motion capture is often retargeted to new, and sometimes drastically different, characters. When the characters take on realistic human shapes, however, we become more sensitive to the motion looking right. This means adapting it to be consistent with the physical constraints imposed by different body shapes. We show how to take realistic 3D human shapes, approximate them using a simplified representation, and animate them so that they move realistically using physically-based retargeting. We develop a novel spacetime optimization approach that learns and robustly adapts physical controllers to new bodies and constraints. The approach automatically adapts the motion of the mocap subject to the body shape of a target subject. This motion respects the physical properties of the new body and every body shape results in a different and appropriate movement. This makes it easy to create a varied set of motions from a single mocap sequence by simply varying the characters. In an interactive environment, successful retargeting requires adapting the motion to unexpected external forces. We achieve robustness to such forces using a novel LQR-tree formulation. We show that the simulated motions look appropriate to each character's anatomy and their actions are robust to perturbations.

Original languageEnglish (US)
Pages (from-to)81-92
Number of pages12
JournalComputer Graphics Forum
Volume37
Issue number8
DOIs
StatePublished - Dec 1 2018

Fingerprint

Physics
Physical properties
Controllers

Keywords

  • CCS Concepts
  • Physical simulation
  • •Computing methodologies → Animation

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design

Cite this

Al Borno, M., Righetti, L., Black, M. J., Delp, S. L., Fiume, E., & Romero, J. (2018). Robust Physics-based Motion Retargeting with Realistic Body Shapes. Computer Graphics Forum, 37(8), 81-92. https://doi.org/10.1111/cgf.13514

Robust Physics-based Motion Retargeting with Realistic Body Shapes. / Al Borno, Mazen; Righetti, Ludovic; Black, Michael J.; Delp, Scott L.; Fiume, Eugene; Romero, Javier.

In: Computer Graphics Forum, Vol. 37, No. 8, 01.12.2018, p. 81-92.

Research output: Contribution to journalArticle

Al Borno, M, Righetti, L, Black, MJ, Delp, SL, Fiume, E & Romero, J 2018, 'Robust Physics-based Motion Retargeting with Realistic Body Shapes', Computer Graphics Forum, vol. 37, no. 8, pp. 81-92. https://doi.org/10.1111/cgf.13514
Al Borno, Mazen ; Righetti, Ludovic ; Black, Michael J. ; Delp, Scott L. ; Fiume, Eugene ; Romero, Javier. / Robust Physics-based Motion Retargeting with Realistic Body Shapes. In: Computer Graphics Forum. 2018 ; Vol. 37, No. 8. pp. 81-92.
@article{cf85af6ddb604134b6bddae5b5b5b813,
title = "Robust Physics-based Motion Retargeting with Realistic Body Shapes",
abstract = "Motion capture is often retargeted to new, and sometimes drastically different, characters. When the characters take on realistic human shapes, however, we become more sensitive to the motion looking right. This means adapting it to be consistent with the physical constraints imposed by different body shapes. We show how to take realistic 3D human shapes, approximate them using a simplified representation, and animate them so that they move realistically using physically-based retargeting. We develop a novel spacetime optimization approach that learns and robustly adapts physical controllers to new bodies and constraints. The approach automatically adapts the motion of the mocap subject to the body shape of a target subject. This motion respects the physical properties of the new body and every body shape results in a different and appropriate movement. This makes it easy to create a varied set of motions from a single mocap sequence by simply varying the characters. In an interactive environment, successful retargeting requires adapting the motion to unexpected external forces. We achieve robustness to such forces using a novel LQR-tree formulation. We show that the simulated motions look appropriate to each character's anatomy and their actions are robust to perturbations.",
keywords = "CCS Concepts, Physical simulation, •Computing methodologies → Animation",
author = "{Al Borno}, Mazen and Ludovic Righetti and Black, {Michael J.} and Delp, {Scott L.} and Eugene Fiume and Javier Romero",
year = "2018",
month = "12",
day = "1",
doi = "10.1111/cgf.13514",
language = "English (US)",
volume = "37",
pages = "81--92",
journal = "Computer Graphics Forum",
issn = "0167-7055",
publisher = "Wiley-Blackwell",
number = "8",

}

TY - JOUR

T1 - Robust Physics-based Motion Retargeting with Realistic Body Shapes

AU - Al Borno, Mazen

AU - Righetti, Ludovic

AU - Black, Michael J.

AU - Delp, Scott L.

AU - Fiume, Eugene

AU - Romero, Javier

PY - 2018/12/1

Y1 - 2018/12/1

N2 - Motion capture is often retargeted to new, and sometimes drastically different, characters. When the characters take on realistic human shapes, however, we become more sensitive to the motion looking right. This means adapting it to be consistent with the physical constraints imposed by different body shapes. We show how to take realistic 3D human shapes, approximate them using a simplified representation, and animate them so that they move realistically using physically-based retargeting. We develop a novel spacetime optimization approach that learns and robustly adapts physical controllers to new bodies and constraints. The approach automatically adapts the motion of the mocap subject to the body shape of a target subject. This motion respects the physical properties of the new body and every body shape results in a different and appropriate movement. This makes it easy to create a varied set of motions from a single mocap sequence by simply varying the characters. In an interactive environment, successful retargeting requires adapting the motion to unexpected external forces. We achieve robustness to such forces using a novel LQR-tree formulation. We show that the simulated motions look appropriate to each character's anatomy and their actions are robust to perturbations.

AB - Motion capture is often retargeted to new, and sometimes drastically different, characters. When the characters take on realistic human shapes, however, we become more sensitive to the motion looking right. This means adapting it to be consistent with the physical constraints imposed by different body shapes. We show how to take realistic 3D human shapes, approximate them using a simplified representation, and animate them so that they move realistically using physically-based retargeting. We develop a novel spacetime optimization approach that learns and robustly adapts physical controllers to new bodies and constraints. The approach automatically adapts the motion of the mocap subject to the body shape of a target subject. This motion respects the physical properties of the new body and every body shape results in a different and appropriate movement. This makes it easy to create a varied set of motions from a single mocap sequence by simply varying the characters. In an interactive environment, successful retargeting requires adapting the motion to unexpected external forces. We achieve robustness to such forces using a novel LQR-tree formulation. We show that the simulated motions look appropriate to each character's anatomy and their actions are robust to perturbations.

KW - CCS Concepts

KW - Physical simulation

KW - •Computing methodologies → Animation

UR - http://www.scopus.com/inward/record.url?scp=85053282118&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85053282118&partnerID=8YFLogxK

U2 - 10.1111/cgf.13514

DO - 10.1111/cgf.13514

M3 - Article

VL - 37

SP - 81

EP - 92

JO - Computer Graphics Forum

JF - Computer Graphics Forum

SN - 0167-7055

IS - 8

ER -