Cooperative localization and mapping of MAVs using RGB-D sensors

Giuseppe Loianno, Justin Thomas, Vijay Kumar

Research output: Contribution to journalConference article

Abstract

The fusion of IMU and RGB-D sensors presents an interesting combination of information to achieve autonomous localization and mapping using robotic platforms such as ground robots and flying vehicles. In this paper, we present a software framework for cooperative localization and mapping while simultaneously using multiple aerial platforms. We employ a monocular visual odometry algorithm to solve the localization task, where the depth data flow associated to the RGB image is used to estimate the scale factor associated with the visual information. The current framework enables autonomous onboard control of each vehicle with cooperative localization and mapping. We present a methodology that provides both a sparse map generated by the monocular SLAM and a multiple resolution dense map generated by the associated depth. The localization algorithm and both 3D mapping algorithms work in parallel improving the system real-time reliability. We present experimental results to show the effectiveness of the proposed approach using two quadrotors platforms.

Original languageEnglish (US)
Article number7139761
Pages (from-to)4021-4028
Number of pages8
JournalProceedings - IEEE International Conference on Robotics and Automation
Volume2015-June
Issue numberJune
DOIs
StatePublished - Jan 1 2015
Event2015 IEEE International Conference on Robotics and Automation, ICRA 2015 - Seattle, United States
Duration: May 26 2015May 30 2015

Fingerprint

Micro air vehicle (MAV)
Sensors
Real time systems
Robotics
Fusion reactions
Robots
Antennas

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Artificial Intelligence
  • Electrical and Electronic Engineering

Cite this

Cooperative localization and mapping of MAVs using RGB-D sensors. / Loianno, Giuseppe; Thomas, Justin; Kumar, Vijay.

In: Proceedings - IEEE International Conference on Robotics and Automation, Vol. 2015-June, No. June, 7139761, 01.01.2015, p. 4021-4028.

Research output: Contribution to journalConference article

Loianno, Giuseppe ; Thomas, Justin ; Kumar, Vijay. / Cooperative localization and mapping of MAVs using RGB-D sensors. In: Proceedings - IEEE International Conference on Robotics and Automation. 2015 ; Vol. 2015-June, No. June. pp. 4021-4028.
@article{4bd0bc79d9624a36bc111859972c922f,
title = "Cooperative localization and mapping of MAVs using RGB-D sensors",
abstract = "The fusion of IMU and RGB-D sensors presents an interesting combination of information to achieve autonomous localization and mapping using robotic platforms such as ground robots and flying vehicles. In this paper, we present a software framework for cooperative localization and mapping while simultaneously using multiple aerial platforms. We employ a monocular visual odometry algorithm to solve the localization task, where the depth data flow associated to the RGB image is used to estimate the scale factor associated with the visual information. The current framework enables autonomous onboard control of each vehicle with cooperative localization and mapping. We present a methodology that provides both a sparse map generated by the monocular SLAM and a multiple resolution dense map generated by the associated depth. The localization algorithm and both 3D mapping algorithms work in parallel improving the system real-time reliability. We present experimental results to show the effectiveness of the proposed approach using two quadrotors platforms.",
author = "Giuseppe Loianno and Justin Thomas and Vijay Kumar",
year = "2015",
month = "1",
day = "1",
doi = "10.1109/ICRA.2015.7139761",
language = "English (US)",
volume = "2015-June",
pages = "4021--4028",
journal = "Proceedings - IEEE International Conference on Robotics and Automation",
issn = "1050-4729",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "June",

}

TY - JOUR

T1 - Cooperative localization and mapping of MAVs using RGB-D sensors

AU - Loianno, Giuseppe

AU - Thomas, Justin

AU - Kumar, Vijay

PY - 2015/1/1

Y1 - 2015/1/1

N2 - The fusion of IMU and RGB-D sensors presents an interesting combination of information to achieve autonomous localization and mapping using robotic platforms such as ground robots and flying vehicles. In this paper, we present a software framework for cooperative localization and mapping while simultaneously using multiple aerial platforms. We employ a monocular visual odometry algorithm to solve the localization task, where the depth data flow associated to the RGB image is used to estimate the scale factor associated with the visual information. The current framework enables autonomous onboard control of each vehicle with cooperative localization and mapping. We present a methodology that provides both a sparse map generated by the monocular SLAM and a multiple resolution dense map generated by the associated depth. The localization algorithm and both 3D mapping algorithms work in parallel improving the system real-time reliability. We present experimental results to show the effectiveness of the proposed approach using two quadrotors platforms.

AB - The fusion of IMU and RGB-D sensors presents an interesting combination of information to achieve autonomous localization and mapping using robotic platforms such as ground robots and flying vehicles. In this paper, we present a software framework for cooperative localization and mapping while simultaneously using multiple aerial platforms. We employ a monocular visual odometry algorithm to solve the localization task, where the depth data flow associated to the RGB image is used to estimate the scale factor associated with the visual information. The current framework enables autonomous onboard control of each vehicle with cooperative localization and mapping. We present a methodology that provides both a sparse map generated by the monocular SLAM and a multiple resolution dense map generated by the associated depth. The localization algorithm and both 3D mapping algorithms work in parallel improving the system real-time reliability. We present experimental results to show the effectiveness of the proposed approach using two quadrotors platforms.

UR - http://www.scopus.com/inward/record.url?scp=84938255806&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84938255806&partnerID=8YFLogxK

U2 - 10.1109/ICRA.2015.7139761

DO - 10.1109/ICRA.2015.7139761

M3 - Conference article

VL - 2015-June

SP - 4021

EP - 4028

JO - Proceedings - IEEE International Conference on Robotics and Automation

JF - Proceedings - IEEE International Conference on Robotics and Automation

SN - 1050-4729

IS - June

M1 - 7139761

ER -