The perceptive workbench: Computer-vision-based gesture tracking, object tracking, and 3D reconstruction for augmented desks

Thad Starner, Bastian Leibe, David Minnen, Tracy Westyn, Amy Hurst, Justin Weeks

Research output: Contribution to journalArticle

Abstract

The Perceptive Workbench endeavors to create a spontaneous and unimpeded interface between the physical and virtual worlds. Its vision-based methods for interaction constitute an alternative to wired input devices and tethered tracking. Objects are recognized and tracked when placed on the display surface. By using multiple infrared light sources, the object's 3-D shape can be captured and inserted into the virtual interface. This ability permits spontaneity, since either preloaded objects or those objects selected at run-time by the user can become physical icons. Integrated into the same vision-based interface is the ability to identify 3-D hand position, pointing direction, and sweeping arm gestures. Such gestures can enhance selection, manipulation, and navigation tasks. The Perceptive Workbench has been used for a variety of applications, including augmented reality gaming and terrain navigation. This paper focuses on the techniques used in implementing the Perceptive Workbench and the system's performance.

Original languageEnglish (US)
Pages (from-to)59-71
Number of pages13
JournalMachine Vision and Applications
Volume14
Issue number1
DOIs
StatePublished - Dec 1 2003

Fingerprint

Computer vision
Navigation
Augmented reality
Light sources
Display devices
Infrared radiation

Keywords

  • 3-D object reconstruction
  • Computer vision
  • Gesture
  • Tracking
  • Virtual reality

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Cite this

The perceptive workbench : Computer-vision-based gesture tracking, object tracking, and 3D reconstruction for augmented desks. / Starner, Thad; Leibe, Bastian; Minnen, David; Westyn, Tracy; Hurst, Amy; Weeks, Justin.

In: Machine Vision and Applications, Vol. 14, No. 1, 01.12.2003, p. 59-71.

Research output: Contribution to journalArticle

Starner, Thad ; Leibe, Bastian ; Minnen, David ; Westyn, Tracy ; Hurst, Amy ; Weeks, Justin. / The perceptive workbench : Computer-vision-based gesture tracking, object tracking, and 3D reconstruction for augmented desks. In: Machine Vision and Applications. 2003 ; Vol. 14, No. 1. pp. 59-71.
@article{4d8e96b330314265a300e1468908a3b6,
title = "The perceptive workbench: Computer-vision-based gesture tracking, object tracking, and 3D reconstruction for augmented desks",
abstract = "The Perceptive Workbench endeavors to create a spontaneous and unimpeded interface between the physical and virtual worlds. Its vision-based methods for interaction constitute an alternative to wired input devices and tethered tracking. Objects are recognized and tracked when placed on the display surface. By using multiple infrared light sources, the object's 3-D shape can be captured and inserted into the virtual interface. This ability permits spontaneity, since either preloaded objects or those objects selected at run-time by the user can become physical icons. Integrated into the same vision-based interface is the ability to identify 3-D hand position, pointing direction, and sweeping arm gestures. Such gestures can enhance selection, manipulation, and navigation tasks. The Perceptive Workbench has been used for a variety of applications, including augmented reality gaming and terrain navigation. This paper focuses on the techniques used in implementing the Perceptive Workbench and the system's performance.",
keywords = "3-D object reconstruction, Computer vision, Gesture, Tracking, Virtual reality",
author = "Thad Starner and Bastian Leibe and David Minnen and Tracy Westyn and Amy Hurst and Justin Weeks",
year = "2003",
month = "12",
day = "1",
doi = "10.1007/s00138-002-0096-8",
language = "English (US)",
volume = "14",
pages = "59--71",
journal = "Machine Vision and Applications",
issn = "0932-8092",
publisher = "Springer Verlag",
number = "1",

}

TY - JOUR

T1 - The perceptive workbench

T2 - Computer-vision-based gesture tracking, object tracking, and 3D reconstruction for augmented desks

AU - Starner, Thad

AU - Leibe, Bastian

AU - Minnen, David

AU - Westyn, Tracy

AU - Hurst, Amy

AU - Weeks, Justin

PY - 2003/12/1

Y1 - 2003/12/1

N2 - The Perceptive Workbench endeavors to create a spontaneous and unimpeded interface between the physical and virtual worlds. Its vision-based methods for interaction constitute an alternative to wired input devices and tethered tracking. Objects are recognized and tracked when placed on the display surface. By using multiple infrared light sources, the object's 3-D shape can be captured and inserted into the virtual interface. This ability permits spontaneity, since either preloaded objects or those objects selected at run-time by the user can become physical icons. Integrated into the same vision-based interface is the ability to identify 3-D hand position, pointing direction, and sweeping arm gestures. Such gestures can enhance selection, manipulation, and navigation tasks. The Perceptive Workbench has been used for a variety of applications, including augmented reality gaming and terrain navigation. This paper focuses on the techniques used in implementing the Perceptive Workbench and the system's performance.

AB - The Perceptive Workbench endeavors to create a spontaneous and unimpeded interface between the physical and virtual worlds. Its vision-based methods for interaction constitute an alternative to wired input devices and tethered tracking. Objects are recognized and tracked when placed on the display surface. By using multiple infrared light sources, the object's 3-D shape can be captured and inserted into the virtual interface. This ability permits spontaneity, since either preloaded objects or those objects selected at run-time by the user can become physical icons. Integrated into the same vision-based interface is the ability to identify 3-D hand position, pointing direction, and sweeping arm gestures. Such gestures can enhance selection, manipulation, and navigation tasks. The Perceptive Workbench has been used for a variety of applications, including augmented reality gaming and terrain navigation. This paper focuses on the techniques used in implementing the Perceptive Workbench and the system's performance.

KW - 3-D object reconstruction

KW - Computer vision

KW - Gesture

KW - Tracking

KW - Virtual reality

UR - http://www.scopus.com/inward/record.url?scp=4544285478&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=4544285478&partnerID=8YFLogxK

U2 - 10.1007/s00138-002-0096-8

DO - 10.1007/s00138-002-0096-8

M3 - Article

AN - SCOPUS:4544285478

VL - 14

SP - 59

EP - 71

JO - Machine Vision and Applications

JF - Machine Vision and Applications

SN - 0932-8092

IS - 1

ER -