Towards mobile projective AR for construction co-robots

Siyuan Xiang, Ruoyu Wang, Chen Feng

Research output: Contribution to conferencePaper

Abstract

The construction industry has been suffering from both low labor productivity growth and safety issues, due to the increasing project site complexities and the lack of skilled labors. As a potential technical solution, Augmented Reality (AR) has been studied to reduce the cognitive workloads in construction job sites by visualizing task-related information in the direct context of the workspace and operations. Instead of using helmets/goggles that may decrease users’ field of views, we advocate mobile projectors for AR (MPAR), and propose a camera-projector system to ensure consistent AR projection even if the projectors may change poses when installed on mobile platforms such as human workers or even construction collaborative robots (co-robot). By obtaining the projector’s pose relative to the projection plane (e.g., a wall or panel on construction site) via composing a series of homography transformations in this system, we could determine how to warp virtual information (images or 3D models) for desired projections, no matter whether human observers’ head poses are needed. We demonstrate the effectiveness of the method using two construction AR applications: displaying occluded as-planned or as-built facility information behind a mock-up wall.

Original languageEnglish (US)
Pages1106-1113
Number of pages8
StatePublished - Jan 1 2019
Event36th International Symposium on Automation and Robotics in Construction, ISARC 2019 - Banff, Canada
Duration: May 21 2019May 24 2019

Conference

Conference36th International Symposium on Automation and Robotics in Construction, ISARC 2019
CountryCanada
CityBanff
Period5/21/195/24/19

Fingerprint

Augmented reality
Robots
Goggles
Personnel
Construction industry
Productivity
Cameras

Keywords

  • Camera-projector system
  • Mobile co-robots
  • Pose estimation
  • Projector-based AR

ASJC Scopus subject areas

  • Artificial Intelligence
  • Building and Construction
  • Human-Computer Interaction

Cite this

Xiang, S., Wang, R., & Feng, C. (2019). Towards mobile projective AR for construction co-robots. 1106-1113. Paper presented at 36th International Symposium on Automation and Robotics in Construction, ISARC 2019, Banff, Canada.

Towards mobile projective AR for construction co-robots. / Xiang, Siyuan; Wang, Ruoyu; Feng, Chen.

2019. 1106-1113 Paper presented at 36th International Symposium on Automation and Robotics in Construction, ISARC 2019, Banff, Canada.

Research output: Contribution to conferencePaper

Xiang, S, Wang, R & Feng, C 2019, 'Towards mobile projective AR for construction co-robots', Paper presented at 36th International Symposium on Automation and Robotics in Construction, ISARC 2019, Banff, Canada, 5/21/19 - 5/24/19 pp. 1106-1113.
Xiang S, Wang R, Feng C. Towards mobile projective AR for construction co-robots. 2019. Paper presented at 36th International Symposium on Automation and Robotics in Construction, ISARC 2019, Banff, Canada.
Xiang, Siyuan ; Wang, Ruoyu ; Feng, Chen. / Towards mobile projective AR for construction co-robots. Paper presented at 36th International Symposium on Automation and Robotics in Construction, ISARC 2019, Banff, Canada.8 p.
@conference{24ee9323b12f49a18070b2c09e908e3d,
title = "Towards mobile projective AR for construction co-robots",
abstract = "The construction industry has been suffering from both low labor productivity growth and safety issues, due to the increasing project site complexities and the lack of skilled labors. As a potential technical solution, Augmented Reality (AR) has been studied to reduce the cognitive workloads in construction job sites by visualizing task-related information in the direct context of the workspace and operations. Instead of using helmets/goggles that may decrease users’ field of views, we advocate mobile projectors for AR (MPAR), and propose a camera-projector system to ensure consistent AR projection even if the projectors may change poses when installed on mobile platforms such as human workers or even construction collaborative robots (co-robot). By obtaining the projector’s pose relative to the projection plane (e.g., a wall or panel on construction site) via composing a series of homography transformations in this system, we could determine how to warp virtual information (images or 3D models) for desired projections, no matter whether human observers’ head poses are needed. We demonstrate the effectiveness of the method using two construction AR applications: displaying occluded as-planned or as-built facility information behind a mock-up wall.",
keywords = "Camera-projector system, Mobile co-robots, Pose estimation, Projector-based AR",
author = "Siyuan Xiang and Ruoyu Wang and Chen Feng",
year = "2019",
month = "1",
day = "1",
language = "English (US)",
pages = "1106--1113",
note = "36th International Symposium on Automation and Robotics in Construction, ISARC 2019 ; Conference date: 21-05-2019 Through 24-05-2019",

}

TY - CONF

T1 - Towards mobile projective AR for construction co-robots

AU - Xiang, Siyuan

AU - Wang, Ruoyu

AU - Feng, Chen

PY - 2019/1/1

Y1 - 2019/1/1

N2 - The construction industry has been suffering from both low labor productivity growth and safety issues, due to the increasing project site complexities and the lack of skilled labors. As a potential technical solution, Augmented Reality (AR) has been studied to reduce the cognitive workloads in construction job sites by visualizing task-related information in the direct context of the workspace and operations. Instead of using helmets/goggles that may decrease users’ field of views, we advocate mobile projectors for AR (MPAR), and propose a camera-projector system to ensure consistent AR projection even if the projectors may change poses when installed on mobile platforms such as human workers or even construction collaborative robots (co-robot). By obtaining the projector’s pose relative to the projection plane (e.g., a wall or panel on construction site) via composing a series of homography transformations in this system, we could determine how to warp virtual information (images or 3D models) for desired projections, no matter whether human observers’ head poses are needed. We demonstrate the effectiveness of the method using two construction AR applications: displaying occluded as-planned or as-built facility information behind a mock-up wall.

AB - The construction industry has been suffering from both low labor productivity growth and safety issues, due to the increasing project site complexities and the lack of skilled labors. As a potential technical solution, Augmented Reality (AR) has been studied to reduce the cognitive workloads in construction job sites by visualizing task-related information in the direct context of the workspace and operations. Instead of using helmets/goggles that may decrease users’ field of views, we advocate mobile projectors for AR (MPAR), and propose a camera-projector system to ensure consistent AR projection even if the projectors may change poses when installed on mobile platforms such as human workers or even construction collaborative robots (co-robot). By obtaining the projector’s pose relative to the projection plane (e.g., a wall or panel on construction site) via composing a series of homography transformations in this system, we could determine how to warp virtual information (images or 3D models) for desired projections, no matter whether human observers’ head poses are needed. We demonstrate the effectiveness of the method using two construction AR applications: displaying occluded as-planned or as-built facility information behind a mock-up wall.

KW - Camera-projector system

KW - Mobile co-robots

KW - Pose estimation

KW - Projector-based AR

UR - http://www.scopus.com/inward/record.url?scp=85071471526&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85071471526&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:85071471526

SP - 1106

EP - 1113

ER -