Towards autonomous robotic in-situ assembly on unstructured construction sites using monocular vision

Chen Feng, Y. Xiao, A. Willette, W. McGee, V. R. Kamat

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Unlike robotics in the manufacturing industry, on-site construction robotics has to consider and address two unique challenges: 1) the rugged, evolving, and unstructured environment of typical work sites; 2) the reversed spatial relationship between the product and the manipulator, i.e. the manipulator has to travel to and localize itself at the work face, rather than a partially complete product arriving at an anchored manipulator. The presented research designed and implemented algorithms that address these challenges and enable autonomous robotic assembly of freeform modular structures on construction sites. Building on the authors' previous work in computer-vision-based pose estimation, the designed algorithms enable a mobile robotic manipulator to: 1) autonomously identify and grasp prismatic building components (e.g., bricks, blocks) that are typically non-unique and arbitrarily stored on-site; and 2) assemble these components into pre-designed modular structures. The algorithms use a single camera and a visual marker-based metrology to rapidly establish local reference frames and to detect staged building components. Based on the design of the structure being assembled, the algorithms automatically determine the assembly sequence. Implemented using a 7-axis KUKA KR100 robotic manipulator, the presented robotic system has successfully assembled various structures autonomously as shown in Figure 1, demonstrating the designed algorithms' effectiveness in autonomous on-site construction robotics applications.

Original languageEnglish (US)
Title of host publication31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014 - Proceedings
EditorsQuang Ha, Ali Akbarnezhad, Xuesong Shen
PublisherUniversity of Technology Sydney
Pages163-170
Number of pages8
ISBN (Electronic)9780646597119
StatePublished - Jan 1 2014
Event31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014 - Sydney, Australia
Duration: Jul 9 2014Jul 11 2014

Other

Other31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014
CountryAustralia
CitySydney
Period7/9/147/11/14

Fingerprint

Robotics
Manipulators
Robotic assembly
Brick
Computer vision
Cameras
Industry

Keywords

  • Autonomous assembly
  • Modular construction
  • On-site construction robotics
  • Pose estimation

ASJC Scopus subject areas

  • Artificial Intelligence
  • Hardware and Architecture
  • Civil and Structural Engineering
  • Building and Construction

Cite this

Feng, C., Xiao, Y., Willette, A., McGee, W., & Kamat, V. R. (2014). Towards autonomous robotic in-situ assembly on unstructured construction sites using monocular vision. In Q. Ha, A. Akbarnezhad, & X. Shen (Eds.), 31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014 - Proceedings (pp. 163-170). University of Technology Sydney.

Towards autonomous robotic in-situ assembly on unstructured construction sites using monocular vision. / Feng, Chen; Xiao, Y.; Willette, A.; McGee, W.; Kamat, V. R.

31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014 - Proceedings. ed. / Quang Ha; Ali Akbarnezhad; Xuesong Shen. University of Technology Sydney, 2014. p. 163-170.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Feng, C, Xiao, Y, Willette, A, McGee, W & Kamat, VR 2014, Towards autonomous robotic in-situ assembly on unstructured construction sites using monocular vision. in Q Ha, A Akbarnezhad & X Shen (eds), 31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014 - Proceedings. University of Technology Sydney, pp. 163-170, 31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014, Sydney, Australia, 7/9/14.
Feng C, Xiao Y, Willette A, McGee W, Kamat VR. Towards autonomous robotic in-situ assembly on unstructured construction sites using monocular vision. In Ha Q, Akbarnezhad A, Shen X, editors, 31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014 - Proceedings. University of Technology Sydney. 2014. p. 163-170
Feng, Chen ; Xiao, Y. ; Willette, A. ; McGee, W. ; Kamat, V. R. / Towards autonomous robotic in-situ assembly on unstructured construction sites using monocular vision. 31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014 - Proceedings. editor / Quang Ha ; Ali Akbarnezhad ; Xuesong Shen. University of Technology Sydney, 2014. pp. 163-170
@inproceedings{43a752f477cd4c07b54ff57440daad41,
title = "Towards autonomous robotic in-situ assembly on unstructured construction sites using monocular vision",
abstract = "Unlike robotics in the manufacturing industry, on-site construction robotics has to consider and address two unique challenges: 1) the rugged, evolving, and unstructured environment of typical work sites; 2) the reversed spatial relationship between the product and the manipulator, i.e. the manipulator has to travel to and localize itself at the work face, rather than a partially complete product arriving at an anchored manipulator. The presented research designed and implemented algorithms that address these challenges and enable autonomous robotic assembly of freeform modular structures on construction sites. Building on the authors' previous work in computer-vision-based pose estimation, the designed algorithms enable a mobile robotic manipulator to: 1) autonomously identify and grasp prismatic building components (e.g., bricks, blocks) that are typically non-unique and arbitrarily stored on-site; and 2) assemble these components into pre-designed modular structures. The algorithms use a single camera and a visual marker-based metrology to rapidly establish local reference frames and to detect staged building components. Based on the design of the structure being assembled, the algorithms automatically determine the assembly sequence. Implemented using a 7-axis KUKA KR100 robotic manipulator, the presented robotic system has successfully assembled various structures autonomously as shown in Figure 1, demonstrating the designed algorithms' effectiveness in autonomous on-site construction robotics applications.",
keywords = "Autonomous assembly, Modular construction, On-site construction robotics, Pose estimation",
author = "Chen Feng and Y. Xiao and A. Willette and W. McGee and Kamat, {V. R.}",
year = "2014",
month = "1",
day = "1",
language = "English (US)",
pages = "163--170",
editor = "Quang Ha and Ali Akbarnezhad and Xuesong Shen",
booktitle = "31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014 - Proceedings",
publisher = "University of Technology Sydney",

}

TY - GEN

T1 - Towards autonomous robotic in-situ assembly on unstructured construction sites using monocular vision

AU - Feng, Chen

AU - Xiao, Y.

AU - Willette, A.

AU - McGee, W.

AU - Kamat, V. R.

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Unlike robotics in the manufacturing industry, on-site construction robotics has to consider and address two unique challenges: 1) the rugged, evolving, and unstructured environment of typical work sites; 2) the reversed spatial relationship between the product and the manipulator, i.e. the manipulator has to travel to and localize itself at the work face, rather than a partially complete product arriving at an anchored manipulator. The presented research designed and implemented algorithms that address these challenges and enable autonomous robotic assembly of freeform modular structures on construction sites. Building on the authors' previous work in computer-vision-based pose estimation, the designed algorithms enable a mobile robotic manipulator to: 1) autonomously identify and grasp prismatic building components (e.g., bricks, blocks) that are typically non-unique and arbitrarily stored on-site; and 2) assemble these components into pre-designed modular structures. The algorithms use a single camera and a visual marker-based metrology to rapidly establish local reference frames and to detect staged building components. Based on the design of the structure being assembled, the algorithms automatically determine the assembly sequence. Implemented using a 7-axis KUKA KR100 robotic manipulator, the presented robotic system has successfully assembled various structures autonomously as shown in Figure 1, demonstrating the designed algorithms' effectiveness in autonomous on-site construction robotics applications.

AB - Unlike robotics in the manufacturing industry, on-site construction robotics has to consider and address two unique challenges: 1) the rugged, evolving, and unstructured environment of typical work sites; 2) the reversed spatial relationship between the product and the manipulator, i.e. the manipulator has to travel to and localize itself at the work face, rather than a partially complete product arriving at an anchored manipulator. The presented research designed and implemented algorithms that address these challenges and enable autonomous robotic assembly of freeform modular structures on construction sites. Building on the authors' previous work in computer-vision-based pose estimation, the designed algorithms enable a mobile robotic manipulator to: 1) autonomously identify and grasp prismatic building components (e.g., bricks, blocks) that are typically non-unique and arbitrarily stored on-site; and 2) assemble these components into pre-designed modular structures. The algorithms use a single camera and a visual marker-based metrology to rapidly establish local reference frames and to detect staged building components. Based on the design of the structure being assembled, the algorithms automatically determine the assembly sequence. Implemented using a 7-axis KUKA KR100 robotic manipulator, the presented robotic system has successfully assembled various structures autonomously as shown in Figure 1, demonstrating the designed algorithms' effectiveness in autonomous on-site construction robotics applications.

KW - Autonomous assembly

KW - Modular construction

KW - On-site construction robotics

KW - Pose estimation

UR - http://www.scopus.com/inward/record.url?scp=84912525512&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84912525512&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84912525512

SP - 163

EP - 170

BT - 31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014 - Proceedings

A2 - Ha, Quang

A2 - Akbarnezhad, Ali

A2 - Shen, Xuesong

PB - University of Technology Sydney

ER -