Camera marker networks for articulated machine pose estimation

Chen Feng, Vineet R. Kamat, Hubo Cai

Research output: Contribution to journalArticle

Abstract

The pose of an articulated machine includes the position and orientation of not only the machine base (e.g., tracks or wheels), but also its major articulated components (e.g., stick and bucket). To automatically estimate this pose is a crucial component of technical innovations aimed at improving both safety and productivity in many construction tasks. Based on computer vision, an automatic observation and analysis platform using a network of cameras and markers is designed to enable such a capability for articulated machines. To model such a complex system, a theoretical framework termed camera marker network is proposed. A graph abstraction of such a network is developed to both systematically manage observations and constraints, and efficiently find the optimal solution. An uncertainty analysis without time-consuming simulation enables optimization of network configurations to reduce estimation uncertainty, leading to several empirical rules for better camera calibration and pose estimation. Through extensive uncertainty analyses and field experiments, this approach is shown to achieve centimeter level bucket depth tracking accuracy from as far as 15 m away with only two ordinary cameras (1.1 megapixels each) and a few markers, providing a flexible and cost-efficient alternative to other commercial products that use infrastructure dependent sensors like GPS. A working prototype has been tested on several active construction sites confirming the method's effectiveness.

Original languageEnglish (US)
Pages (from-to)148-160
Number of pages13
JournalAutomation in Construction
Volume96
DOIs
StatePublished - Dec 1 2018

Fingerprint

Cameras
Uncertainty analysis
Computer vision
Global positioning system
Large scale systems
Wheels
Innovation
Productivity
Calibration
Sensors
Costs
Experiments
Uncertainty

Keywords

  • Camera
  • Error analysis
  • Excavator pose estimation
  • Marker
  • Structure-from-motion

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Civil and Structural Engineering
  • Building and Construction

Cite this

Camera marker networks for articulated machine pose estimation. / Feng, Chen; Kamat, Vineet R.; Cai, Hubo.

In: Automation in Construction, Vol. 96, 01.12.2018, p. 148-160.

Research output: Contribution to journalArticle

Feng, Chen ; Kamat, Vineet R. ; Cai, Hubo. / Camera marker networks for articulated machine pose estimation. In: Automation in Construction. 2018 ; Vol. 96. pp. 148-160.
@article{70605707ce564d8993d0d4fe75d483fd,
title = "Camera marker networks for articulated machine pose estimation",
abstract = "The pose of an articulated machine includes the position and orientation of not only the machine base (e.g., tracks or wheels), but also its major articulated components (e.g., stick and bucket). To automatically estimate this pose is a crucial component of technical innovations aimed at improving both safety and productivity in many construction tasks. Based on computer vision, an automatic observation and analysis platform using a network of cameras and markers is designed to enable such a capability for articulated machines. To model such a complex system, a theoretical framework termed camera marker network is proposed. A graph abstraction of such a network is developed to both systematically manage observations and constraints, and efficiently find the optimal solution. An uncertainty analysis without time-consuming simulation enables optimization of network configurations to reduce estimation uncertainty, leading to several empirical rules for better camera calibration and pose estimation. Through extensive uncertainty analyses and field experiments, this approach is shown to achieve centimeter level bucket depth tracking accuracy from as far as 15 m away with only two ordinary cameras (1.1 megapixels each) and a few markers, providing a flexible and cost-efficient alternative to other commercial products that use infrastructure dependent sensors like GPS. A working prototype has been tested on several active construction sites confirming the method's effectiveness.",
keywords = "Camera, Error analysis, Excavator pose estimation, Marker, Structure-from-motion",
author = "Chen Feng and Kamat, {Vineet R.} and Hubo Cai",
year = "2018",
month = "12",
day = "1",
doi = "10.1016/j.autcon.2018.09.004",
language = "English (US)",
volume = "96",
pages = "148--160",
journal = "Automation in Construction",
issn = "0926-5805",
publisher = "Elsevier",

}

TY - JOUR

T1 - Camera marker networks for articulated machine pose estimation

AU - Feng, Chen

AU - Kamat, Vineet R.

AU - Cai, Hubo

PY - 2018/12/1

Y1 - 2018/12/1

N2 - The pose of an articulated machine includes the position and orientation of not only the machine base (e.g., tracks or wheels), but also its major articulated components (e.g., stick and bucket). To automatically estimate this pose is a crucial component of technical innovations aimed at improving both safety and productivity in many construction tasks. Based on computer vision, an automatic observation and analysis platform using a network of cameras and markers is designed to enable such a capability for articulated machines. To model such a complex system, a theoretical framework termed camera marker network is proposed. A graph abstraction of such a network is developed to both systematically manage observations and constraints, and efficiently find the optimal solution. An uncertainty analysis without time-consuming simulation enables optimization of network configurations to reduce estimation uncertainty, leading to several empirical rules for better camera calibration and pose estimation. Through extensive uncertainty analyses and field experiments, this approach is shown to achieve centimeter level bucket depth tracking accuracy from as far as 15 m away with only two ordinary cameras (1.1 megapixels each) and a few markers, providing a flexible and cost-efficient alternative to other commercial products that use infrastructure dependent sensors like GPS. A working prototype has been tested on several active construction sites confirming the method's effectiveness.

AB - The pose of an articulated machine includes the position and orientation of not only the machine base (e.g., tracks or wheels), but also its major articulated components (e.g., stick and bucket). To automatically estimate this pose is a crucial component of technical innovations aimed at improving both safety and productivity in many construction tasks. Based on computer vision, an automatic observation and analysis platform using a network of cameras and markers is designed to enable such a capability for articulated machines. To model such a complex system, a theoretical framework termed camera marker network is proposed. A graph abstraction of such a network is developed to both systematically manage observations and constraints, and efficiently find the optimal solution. An uncertainty analysis without time-consuming simulation enables optimization of network configurations to reduce estimation uncertainty, leading to several empirical rules for better camera calibration and pose estimation. Through extensive uncertainty analyses and field experiments, this approach is shown to achieve centimeter level bucket depth tracking accuracy from as far as 15 m away with only two ordinary cameras (1.1 megapixels each) and a few markers, providing a flexible and cost-efficient alternative to other commercial products that use infrastructure dependent sensors like GPS. A working prototype has been tested on several active construction sites confirming the method's effectiveness.

KW - Camera

KW - Error analysis

KW - Excavator pose estimation

KW - Marker

KW - Structure-from-motion

UR - http://www.scopus.com/inward/record.url?scp=85053477592&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85053477592&partnerID=8YFLogxK

U2 - 10.1016/j.autcon.2018.09.004

DO - 10.1016/j.autcon.2018.09.004

M3 - Article

VL - 96

SP - 148

EP - 160

JO - Automation in Construction

JF - Automation in Construction

SN - 0926-5805

ER -