Flying Smartphones

Automated Flight Enabled by Consumer Electronics

Giuseppe Loianno, Gareth Cross, Chao Qu, Yash Mulgaonkar, Joel A. Hesch, Vijay Kumar

Research output: Contribution to journalArticle

Abstract

Consumer-grade technology seen in cameras and phones has led to the price-performance ratio falling dramatically over the last decade. We are seeing a similar trend in robots that leverage this technology. A recent development is the interest of companies such as Google, Apple, and Qualcomm in high-end communication devices equipped with such sensors as cameras and inertial measurement units (IMUs) and with significant computational capability. Google, for instance, is developing a customized phone equipped with conventional as well as depth cameras. This article explores the potential for the rapid integration of inexpensive consumer-grade electronics with the off-the-shelf robotics technology for automation in homes and offices. We describe how standard hardware platforms (robots, processors, and smartphones) can be integrated through simple software architecture to build autonomous quadrotors that can navigate and map unknown, indoor environments. We show how the quadrotor can be stabilized and controlled to achieve autonomous flight and the generation of three-dimensional (3-D) maps for exploring and mapping indoor buildings with application to smart homes, search and rescue, and architecture. This opens up the possibility for any consumer to take a commercially available robot platform and a smartphone and automate the process of creating a 3-D map of his/her home or office.

Original languageEnglish (US)
Article number7105372
Pages (from-to)24-32
Number of pages9
JournalIEEE Robotics and Automation Magazine
Volume22
Issue number2
DOIs
StatePublished - Jun 1 2015

Fingerprint

Consumer electronics
Smartphones
Cameras
Robots
Units of measurement
Software architecture
Robotics
Electronic equipment
Automation
Hardware
Communication
Sensors
Industry

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science Applications
  • Electrical and Electronic Engineering

Cite this

Loianno, G., Cross, G., Qu, C., Mulgaonkar, Y., Hesch, J. A., & Kumar, V. (2015). Flying Smartphones: Automated Flight Enabled by Consumer Electronics. IEEE Robotics and Automation Magazine, 22(2), 24-32. [7105372]. https://doi.org/10.1109/MRA.2014.2382792

Flying Smartphones : Automated Flight Enabled by Consumer Electronics. / Loianno, Giuseppe; Cross, Gareth; Qu, Chao; Mulgaonkar, Yash; Hesch, Joel A.; Kumar, Vijay.

In: IEEE Robotics and Automation Magazine, Vol. 22, No. 2, 7105372, 01.06.2015, p. 24-32.

Research output: Contribution to journalArticle

Loianno, G, Cross, G, Qu, C, Mulgaonkar, Y, Hesch, JA & Kumar, V 2015, 'Flying Smartphones: Automated Flight Enabled by Consumer Electronics', IEEE Robotics and Automation Magazine, vol. 22, no. 2, 7105372, pp. 24-32. https://doi.org/10.1109/MRA.2014.2382792
Loianno, Giuseppe ; Cross, Gareth ; Qu, Chao ; Mulgaonkar, Yash ; Hesch, Joel A. ; Kumar, Vijay. / Flying Smartphones : Automated Flight Enabled by Consumer Electronics. In: IEEE Robotics and Automation Magazine. 2015 ; Vol. 22, No. 2. pp. 24-32.
@article{e50b2585e5d645ada0bb101b1c6b4da5,
title = "Flying Smartphones: Automated Flight Enabled by Consumer Electronics",
abstract = "Consumer-grade technology seen in cameras and phones has led to the price-performance ratio falling dramatically over the last decade. We are seeing a similar trend in robots that leverage this technology. A recent development is the interest of companies such as Google, Apple, and Qualcomm in high-end communication devices equipped with such sensors as cameras and inertial measurement units (IMUs) and with significant computational capability. Google, for instance, is developing a customized phone equipped with conventional as well as depth cameras. This article explores the potential for the rapid integration of inexpensive consumer-grade electronics with the off-the-shelf robotics technology for automation in homes and offices. We describe how standard hardware platforms (robots, processors, and smartphones) can be integrated through simple software architecture to build autonomous quadrotors that can navigate and map unknown, indoor environments. We show how the quadrotor can be stabilized and controlled to achieve autonomous flight and the generation of three-dimensional (3-D) maps for exploring and mapping indoor buildings with application to smart homes, search and rescue, and architecture. This opens up the possibility for any consumer to take a commercially available robot platform and a smartphone and automate the process of creating a 3-D map of his/her home or office.",
author = "Giuseppe Loianno and Gareth Cross and Chao Qu and Yash Mulgaonkar and Hesch, {Joel A.} and Vijay Kumar",
year = "2015",
month = "6",
day = "1",
doi = "10.1109/MRA.2014.2382792",
language = "English (US)",
volume = "22",
pages = "24--32",
journal = "IEEE Robotics and Automation Magazine",
issn = "1070-9932",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "2",

}

TY - JOUR

T1 - Flying Smartphones

T2 - Automated Flight Enabled by Consumer Electronics

AU - Loianno, Giuseppe

AU - Cross, Gareth

AU - Qu, Chao

AU - Mulgaonkar, Yash

AU - Hesch, Joel A.

AU - Kumar, Vijay

PY - 2015/6/1

Y1 - 2015/6/1

N2 - Consumer-grade technology seen in cameras and phones has led to the price-performance ratio falling dramatically over the last decade. We are seeing a similar trend in robots that leverage this technology. A recent development is the interest of companies such as Google, Apple, and Qualcomm in high-end communication devices equipped with such sensors as cameras and inertial measurement units (IMUs) and with significant computational capability. Google, for instance, is developing a customized phone equipped with conventional as well as depth cameras. This article explores the potential for the rapid integration of inexpensive consumer-grade electronics with the off-the-shelf robotics technology for automation in homes and offices. We describe how standard hardware platforms (robots, processors, and smartphones) can be integrated through simple software architecture to build autonomous quadrotors that can navigate and map unknown, indoor environments. We show how the quadrotor can be stabilized and controlled to achieve autonomous flight and the generation of three-dimensional (3-D) maps for exploring and mapping indoor buildings with application to smart homes, search and rescue, and architecture. This opens up the possibility for any consumer to take a commercially available robot platform and a smartphone and automate the process of creating a 3-D map of his/her home or office.

AB - Consumer-grade technology seen in cameras and phones has led to the price-performance ratio falling dramatically over the last decade. We are seeing a similar trend in robots that leverage this technology. A recent development is the interest of companies such as Google, Apple, and Qualcomm in high-end communication devices equipped with such sensors as cameras and inertial measurement units (IMUs) and with significant computational capability. Google, for instance, is developing a customized phone equipped with conventional as well as depth cameras. This article explores the potential for the rapid integration of inexpensive consumer-grade electronics with the off-the-shelf robotics technology for automation in homes and offices. We describe how standard hardware platforms (robots, processors, and smartphones) can be integrated through simple software architecture to build autonomous quadrotors that can navigate and map unknown, indoor environments. We show how the quadrotor can be stabilized and controlled to achieve autonomous flight and the generation of three-dimensional (3-D) maps for exploring and mapping indoor buildings with application to smart homes, search and rescue, and architecture. This opens up the possibility for any consumer to take a commercially available robot platform and a smartphone and automate the process of creating a 3-D map of his/her home or office.

UR - http://www.scopus.com/inward/record.url?scp=85027953742&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85027953742&partnerID=8YFLogxK

U2 - 10.1109/MRA.2014.2382792

DO - 10.1109/MRA.2014.2382792

M3 - Article

VL - 22

SP - 24

EP - 32

JO - IEEE Robotics and Automation Magazine

JF - IEEE Robotics and Automation Magazine

SN - 1070-9932

IS - 2

M1 - 7105372

ER -