An Occupancy Grid Mapping enhanced visual SLAM for real-time locating applications in indoor GPS-denied environments

Lichao Xu, Chen Feng, Vineet R. Kamat, Carol C. Menassa

Research output: Contribution to journalArticle

Abstract

Current Real-Time Locating Systems (RTLS)typically deployed in indoor built environments are generally based on wireless technologies, fixed cameras, or Lidar-based Simultaneous Localization and Mapping (SLAM), which generally suffer from the drawbacks of low accuracy, reliance on existing infrastructures that may be not available in the deployed environments, labor-intensive environment instrumentation, or economic infeasibility for wide deployment. By improving an ORB RGB-D SLAM with Occupancy Grid Mapping, this paper proposes a new indoor RTLS that can be readily adapted and deployed for a broad range of indoor locating applications while overcoming the limitations faced by current solutions. In addition to the sparse feature map that is maintained by ORB SLAM itself, a new 2D mapping module is developed to build and maintain an additional 2D Occupancy Grid Map (OGM). The 2D OGM is built with the 3D camera poses estimated by Visual SLAM (vSLAM)and laser scans extracted from the point cloud observed by the camera from those poses. In addition, the Robot Operating System (ROS)visualization tools are used to overlay real-time current camera poses and observations (virtual laser scans)on the OGM. This approach not only provides more intuitive pose information to users and allows them to interact with the system, but also enables path planning and continuous navigation, which cannot be implemented directly on vSLAM's original feature map. The localization accuracy of the proposed system is experimentally evaluated with a set of visual landmarks that are installed in a large-scale building environment. The achieved marker position measurement accuracy ranges from 0.039 m to 0.186 m and the marker distance measurement accuracy ranges from 0.018 m to 0.235 m, proving the method's feasibility and applicability in providing real-time and accurate localization for a wide range of applications within constructed facilities and the built environment. Three examples are provided to highlight such potential applications, including path planning and real-time navigation, geo-tagged date collection and location-aware point cloud updating.

Original languageEnglish (US)
Pages (from-to)230-245
Number of pages16
JournalAutomation in Construction
Volume104
DOIs
StatePublished - Aug 1 2019

Fingerprint

Global positioning system
Cameras
Motion planning
Navigation
Position measurement
Distance measurement
Lasers
Optical radar
Visualization
Personnel
Robots
Economics

Keywords

  • Geo-tagged data collection
  • Navigation
  • Occupancy Grid Map (OGM)
  • Path planning
  • Point cloud
  • Real-time locating system (RTLS)
  • Simultaneous Localization and Mapping (SLAM)
  • Visual SLAM (vSLAM)

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Civil and Structural Engineering
  • Building and Construction

Cite this

An Occupancy Grid Mapping enhanced visual SLAM for real-time locating applications in indoor GPS-denied environments. / Xu, Lichao; Feng, Chen; Kamat, Vineet R.; Menassa, Carol C.

In: Automation in Construction, Vol. 104, 01.08.2019, p. 230-245.

Research output: Contribution to journalArticle

@article{7b0a1e741740476dac5bb482f3c50cda,
title = "An Occupancy Grid Mapping enhanced visual SLAM for real-time locating applications in indoor GPS-denied environments",
abstract = "Current Real-Time Locating Systems (RTLS)typically deployed in indoor built environments are generally based on wireless technologies, fixed cameras, or Lidar-based Simultaneous Localization and Mapping (SLAM), which generally suffer from the drawbacks of low accuracy, reliance on existing infrastructures that may be not available in the deployed environments, labor-intensive environment instrumentation, or economic infeasibility for wide deployment. By improving an ORB RGB-D SLAM with Occupancy Grid Mapping, this paper proposes a new indoor RTLS that can be readily adapted and deployed for a broad range of indoor locating applications while overcoming the limitations faced by current solutions. In addition to the sparse feature map that is maintained by ORB SLAM itself, a new 2D mapping module is developed to build and maintain an additional 2D Occupancy Grid Map (OGM). The 2D OGM is built with the 3D camera poses estimated by Visual SLAM (vSLAM)and laser scans extracted from the point cloud observed by the camera from those poses. In addition, the Robot Operating System (ROS)visualization tools are used to overlay real-time current camera poses and observations (virtual laser scans)on the OGM. This approach not only provides more intuitive pose information to users and allows them to interact with the system, but also enables path planning and continuous navigation, which cannot be implemented directly on vSLAM's original feature map. The localization accuracy of the proposed system is experimentally evaluated with a set of visual landmarks that are installed in a large-scale building environment. The achieved marker position measurement accuracy ranges from 0.039 m to 0.186 m and the marker distance measurement accuracy ranges from 0.018 m to 0.235 m, proving the method's feasibility and applicability in providing real-time and accurate localization for a wide range of applications within constructed facilities and the built environment. Three examples are provided to highlight such potential applications, including path planning and real-time navigation, geo-tagged date collection and location-aware point cloud updating.",
keywords = "Geo-tagged data collection, Navigation, Occupancy Grid Map (OGM), Path planning, Point cloud, Real-time locating system (RTLS), Simultaneous Localization and Mapping (SLAM), Visual SLAM (vSLAM)",
author = "Lichao Xu and Chen Feng and Kamat, {Vineet R.} and Menassa, {Carol C.}",
year = "2019",
month = "8",
day = "1",
doi = "10.1016/j.autcon.2019.04.011",
language = "English (US)",
volume = "104",
pages = "230--245",
journal = "Automation in Construction",
issn = "0926-5805",
publisher = "Elsevier",

}

TY - JOUR

T1 - An Occupancy Grid Mapping enhanced visual SLAM for real-time locating applications in indoor GPS-denied environments

AU - Xu, Lichao

AU - Feng, Chen

AU - Kamat, Vineet R.

AU - Menassa, Carol C.

PY - 2019/8/1

Y1 - 2019/8/1

N2 - Current Real-Time Locating Systems (RTLS)typically deployed in indoor built environments are generally based on wireless technologies, fixed cameras, or Lidar-based Simultaneous Localization and Mapping (SLAM), which generally suffer from the drawbacks of low accuracy, reliance on existing infrastructures that may be not available in the deployed environments, labor-intensive environment instrumentation, or economic infeasibility for wide deployment. By improving an ORB RGB-D SLAM with Occupancy Grid Mapping, this paper proposes a new indoor RTLS that can be readily adapted and deployed for a broad range of indoor locating applications while overcoming the limitations faced by current solutions. In addition to the sparse feature map that is maintained by ORB SLAM itself, a new 2D mapping module is developed to build and maintain an additional 2D Occupancy Grid Map (OGM). The 2D OGM is built with the 3D camera poses estimated by Visual SLAM (vSLAM)and laser scans extracted from the point cloud observed by the camera from those poses. In addition, the Robot Operating System (ROS)visualization tools are used to overlay real-time current camera poses and observations (virtual laser scans)on the OGM. This approach not only provides more intuitive pose information to users and allows them to interact with the system, but also enables path planning and continuous navigation, which cannot be implemented directly on vSLAM's original feature map. The localization accuracy of the proposed system is experimentally evaluated with a set of visual landmarks that are installed in a large-scale building environment. The achieved marker position measurement accuracy ranges from 0.039 m to 0.186 m and the marker distance measurement accuracy ranges from 0.018 m to 0.235 m, proving the method's feasibility and applicability in providing real-time and accurate localization for a wide range of applications within constructed facilities and the built environment. Three examples are provided to highlight such potential applications, including path planning and real-time navigation, geo-tagged date collection and location-aware point cloud updating.

AB - Current Real-Time Locating Systems (RTLS)typically deployed in indoor built environments are generally based on wireless technologies, fixed cameras, or Lidar-based Simultaneous Localization and Mapping (SLAM), which generally suffer from the drawbacks of low accuracy, reliance on existing infrastructures that may be not available in the deployed environments, labor-intensive environment instrumentation, or economic infeasibility for wide deployment. By improving an ORB RGB-D SLAM with Occupancy Grid Mapping, this paper proposes a new indoor RTLS that can be readily adapted and deployed for a broad range of indoor locating applications while overcoming the limitations faced by current solutions. In addition to the sparse feature map that is maintained by ORB SLAM itself, a new 2D mapping module is developed to build and maintain an additional 2D Occupancy Grid Map (OGM). The 2D OGM is built with the 3D camera poses estimated by Visual SLAM (vSLAM)and laser scans extracted from the point cloud observed by the camera from those poses. In addition, the Robot Operating System (ROS)visualization tools are used to overlay real-time current camera poses and observations (virtual laser scans)on the OGM. This approach not only provides more intuitive pose information to users and allows them to interact with the system, but also enables path planning and continuous navigation, which cannot be implemented directly on vSLAM's original feature map. The localization accuracy of the proposed system is experimentally evaluated with a set of visual landmarks that are installed in a large-scale building environment. The achieved marker position measurement accuracy ranges from 0.039 m to 0.186 m and the marker distance measurement accuracy ranges from 0.018 m to 0.235 m, proving the method's feasibility and applicability in providing real-time and accurate localization for a wide range of applications within constructed facilities and the built environment. Three examples are provided to highlight such potential applications, including path planning and real-time navigation, geo-tagged date collection and location-aware point cloud updating.

KW - Geo-tagged data collection

KW - Navigation

KW - Occupancy Grid Map (OGM)

KW - Path planning

KW - Point cloud

KW - Real-time locating system (RTLS)

KW - Simultaneous Localization and Mapping (SLAM)

KW - Visual SLAM (vSLAM)

UR - http://www.scopus.com/inward/record.url?scp=85064747805&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85064747805&partnerID=8YFLogxK

U2 - 10.1016/j.autcon.2019.04.011

DO - 10.1016/j.autcon.2019.04.011

M3 - Article

VL - 104

SP - 230

EP - 245

JO - Automation in Construction

JF - Automation in Construction

SN - 0926-5805

ER -