Deformation capture via soft and stretchable sensor arrays

Oliver Glauser, Daniele Panozzo, Otmar Hilliges, Olga Sorkine-Hornung

Research output: Contribution to journalArticle

Abstract

We propose a hardware and software pipeline to fabricate flexible wearable sensors and use them to capture deformations without line-of-sight. Our first contribution is a low-cost fabrication pipeline to embed multiple aligned conductive layers with complex geometries into silicone compounds. Overlapping conductive areas from separate layers form local capacitors that measure dense area changes. Contrary to existing fabrication methods, the proposed technique only requires hardware that is readily available in modern fablabs. While area measurements alone are not enough to reconstruct the full 3D deformation of a surface, they become sufficient when paired with a data-driven prior. A novel semi-automatic tracking algorithm, based on an elastic surface geometry deformation, allows us to capture ground-truth data with an optical mocap system, even under heavy occlusions or partially unobservable markers. The resulting dataset is used to train a regressor based on deep neural networks, directly mapping the area readings to global positions of surface vertices. We demonstrate the flexibility and accuracy of the proposed hardware and software in a series of controlled experiments and design a prototype of wearable wrist, elbow, and biceps sensors, which do not require line-of-sight and can be worn below regular clothing.

Original languageEnglish (US)
Article number16
JournalACM Transactions on Graphics
Volume38
Issue number2
DOIs
StatePublished - Apr 1 2019

Fingerprint

Sensor arrays
Hardware
Pipelines
Fabrication
Geometry
Optical systems
Silicones
Capacitors
Sensors
Costs
Experiments

Keywords

  • Capacitive
  • Deformation capture
  • Sensor array
  • Stretchable

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design

Cite this

Deformation capture via soft and stretchable sensor arrays. / Glauser, Oliver; Panozzo, Daniele; Hilliges, Otmar; Sorkine-Hornung, Olga.

In: ACM Transactions on Graphics, Vol. 38, No. 2, 16, 01.04.2019.

Research output: Contribution to journalArticle

Glauser, Oliver ; Panozzo, Daniele ; Hilliges, Otmar ; Sorkine-Hornung, Olga. / Deformation capture via soft and stretchable sensor arrays. In: ACM Transactions on Graphics. 2019 ; Vol. 38, No. 2.
@article{02e78e73ae564f698d0795a39b1e8e26,
title = "Deformation capture via soft and stretchable sensor arrays",
abstract = "We propose a hardware and software pipeline to fabricate flexible wearable sensors and use them to capture deformations without line-of-sight. Our first contribution is a low-cost fabrication pipeline to embed multiple aligned conductive layers with complex geometries into silicone compounds. Overlapping conductive areas from separate layers form local capacitors that measure dense area changes. Contrary to existing fabrication methods, the proposed technique only requires hardware that is readily available in modern fablabs. While area measurements alone are not enough to reconstruct the full 3D deformation of a surface, they become sufficient when paired with a data-driven prior. A novel semi-automatic tracking algorithm, based on an elastic surface geometry deformation, allows us to capture ground-truth data with an optical mocap system, even under heavy occlusions or partially unobservable markers. The resulting dataset is used to train a regressor based on deep neural networks, directly mapping the area readings to global positions of surface vertices. We demonstrate the flexibility and accuracy of the proposed hardware and software in a series of controlled experiments and design a prototype of wearable wrist, elbow, and biceps sensors, which do not require line-of-sight and can be worn below regular clothing.",
keywords = "Capacitive, Deformation capture, Sensor array, Stretchable",
author = "Oliver Glauser and Daniele Panozzo and Otmar Hilliges and Olga Sorkine-Hornung",
year = "2019",
month = "4",
day = "1",
doi = "10.1145/3311972",
language = "English (US)",
volume = "38",
journal = "ACM Transactions on Graphics",
issn = "0730-0301",
publisher = "Association for Computing Machinery (ACM)",
number = "2",

}

TY - JOUR

T1 - Deformation capture via soft and stretchable sensor arrays

AU - Glauser, Oliver

AU - Panozzo, Daniele

AU - Hilliges, Otmar

AU - Sorkine-Hornung, Olga

PY - 2019/4/1

Y1 - 2019/4/1

N2 - We propose a hardware and software pipeline to fabricate flexible wearable sensors and use them to capture deformations without line-of-sight. Our first contribution is a low-cost fabrication pipeline to embed multiple aligned conductive layers with complex geometries into silicone compounds. Overlapping conductive areas from separate layers form local capacitors that measure dense area changes. Contrary to existing fabrication methods, the proposed technique only requires hardware that is readily available in modern fablabs. While area measurements alone are not enough to reconstruct the full 3D deformation of a surface, they become sufficient when paired with a data-driven prior. A novel semi-automatic tracking algorithm, based on an elastic surface geometry deformation, allows us to capture ground-truth data with an optical mocap system, even under heavy occlusions or partially unobservable markers. The resulting dataset is used to train a regressor based on deep neural networks, directly mapping the area readings to global positions of surface vertices. We demonstrate the flexibility and accuracy of the proposed hardware and software in a series of controlled experiments and design a prototype of wearable wrist, elbow, and biceps sensors, which do not require line-of-sight and can be worn below regular clothing.

AB - We propose a hardware and software pipeline to fabricate flexible wearable sensors and use them to capture deformations without line-of-sight. Our first contribution is a low-cost fabrication pipeline to embed multiple aligned conductive layers with complex geometries into silicone compounds. Overlapping conductive areas from separate layers form local capacitors that measure dense area changes. Contrary to existing fabrication methods, the proposed technique only requires hardware that is readily available in modern fablabs. While area measurements alone are not enough to reconstruct the full 3D deformation of a surface, they become sufficient when paired with a data-driven prior. A novel semi-automatic tracking algorithm, based on an elastic surface geometry deformation, allows us to capture ground-truth data with an optical mocap system, even under heavy occlusions or partially unobservable markers. The resulting dataset is used to train a regressor based on deep neural networks, directly mapping the area readings to global positions of surface vertices. We demonstrate the flexibility and accuracy of the proposed hardware and software in a series of controlled experiments and design a prototype of wearable wrist, elbow, and biceps sensors, which do not require line-of-sight and can be worn below regular clothing.

KW - Capacitive

KW - Deformation capture

KW - Sensor array

KW - Stretchable

UR - http://www.scopus.com/inward/record.url?scp=85065774574&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065774574&partnerID=8YFLogxK

U2 - 10.1145/3311972

DO - 10.1145/3311972

M3 - Article

AN - SCOPUS:85065774574

VL - 38

JO - ACM Transactions on Graphics

JF - ACM Transactions on Graphics

SN - 0730-0301

IS - 2

M1 - 16

ER -