Toward image based visual servoing for aerial grasping and perching

Justin Thomas, Giuseppe Loianno, Koushil Sreenath, Vijay Kumar

Research output: Contribution to journalConference article

Abstract

This paper addresses the dynamics, control, planning, and visual servoing for micro aerial vehicles to perform high-speed aerial grasping tasks. We draw inspiration from agile, fast-moving birds, such as raptors, that detect, locate, and execute high-speed swoop maneuvers to capture prey. Since these grasping maneuvers are predominantly in the sagittal plane, we consider the planar system and present mathematical models and algorithms for motion planning and control, required to incorporate similar capabilities in quadrotors equipped with a monocular camera. In particular, we develop a dynamical model directly in the image space, show that this is a differentially-flat system with the image features serving as flat outputs, outline a method for generating trajectories directly in the image feature space, develop a geometric visual controller that considers the second order dynamics (in contrast to most visual servoing controllers that assume first order dynamics), and present validation of our methods through both simulations and experiments.

Original languageEnglish (US)
Article number6907149
Pages (from-to)2113-2118
Number of pages6
JournalProceedings - IEEE International Conference on Robotics and Automation
DOIs
StatePublished - Jan 1 2014
Event2014 IEEE International Conference on Robotics and Automation, ICRA 2014 - Hong Kong, China
Duration: May 31 2014Jun 7 2014

Fingerprint

Visual servoing
Antennas
Controllers
Birds
Motion control
Motion planning
Cameras
Trajectories
Mathematical models
Planning
Experiments

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Artificial Intelligence
  • Electrical and Electronic Engineering

Cite this

Toward image based visual servoing for aerial grasping and perching. / Thomas, Justin; Loianno, Giuseppe; Sreenath, Koushil; Kumar, Vijay.

In: Proceedings - IEEE International Conference on Robotics and Automation, 01.01.2014, p. 2113-2118.

Research output: Contribution to journalConference article

@article{eb7e8a4f93354268986c091cbdf5b798,
title = "Toward image based visual servoing for aerial grasping and perching",
abstract = "This paper addresses the dynamics, control, planning, and visual servoing for micro aerial vehicles to perform high-speed aerial grasping tasks. We draw inspiration from agile, fast-moving birds, such as raptors, that detect, locate, and execute high-speed swoop maneuvers to capture prey. Since these grasping maneuvers are predominantly in the sagittal plane, we consider the planar system and present mathematical models and algorithms for motion planning and control, required to incorporate similar capabilities in quadrotors equipped with a monocular camera. In particular, we develop a dynamical model directly in the image space, show that this is a differentially-flat system with the image features serving as flat outputs, outline a method for generating trajectories directly in the image feature space, develop a geometric visual controller that considers the second order dynamics (in contrast to most visual servoing controllers that assume first order dynamics), and present validation of our methods through both simulations and experiments.",
author = "Justin Thomas and Giuseppe Loianno and Koushil Sreenath and Vijay Kumar",
year = "2014",
month = "1",
day = "1",
doi = "10.1109/ICRA.2014.6907149",
language = "English (US)",
pages = "2113--2118",
journal = "Proceedings - IEEE International Conference on Robotics and Automation",
issn = "1050-4729",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - JOUR

T1 - Toward image based visual servoing for aerial grasping and perching

AU - Thomas, Justin

AU - Loianno, Giuseppe

AU - Sreenath, Koushil

AU - Kumar, Vijay

PY - 2014/1/1

Y1 - 2014/1/1

N2 - This paper addresses the dynamics, control, planning, and visual servoing for micro aerial vehicles to perform high-speed aerial grasping tasks. We draw inspiration from agile, fast-moving birds, such as raptors, that detect, locate, and execute high-speed swoop maneuvers to capture prey. Since these grasping maneuvers are predominantly in the sagittal plane, we consider the planar system and present mathematical models and algorithms for motion planning and control, required to incorporate similar capabilities in quadrotors equipped with a monocular camera. In particular, we develop a dynamical model directly in the image space, show that this is a differentially-flat system with the image features serving as flat outputs, outline a method for generating trajectories directly in the image feature space, develop a geometric visual controller that considers the second order dynamics (in contrast to most visual servoing controllers that assume first order dynamics), and present validation of our methods through both simulations and experiments.

AB - This paper addresses the dynamics, control, planning, and visual servoing for micro aerial vehicles to perform high-speed aerial grasping tasks. We draw inspiration from agile, fast-moving birds, such as raptors, that detect, locate, and execute high-speed swoop maneuvers to capture prey. Since these grasping maneuvers are predominantly in the sagittal plane, we consider the planar system and present mathematical models and algorithms for motion planning and control, required to incorporate similar capabilities in quadrotors equipped with a monocular camera. In particular, we develop a dynamical model directly in the image space, show that this is a differentially-flat system with the image features serving as flat outputs, outline a method for generating trajectories directly in the image feature space, develop a geometric visual controller that considers the second order dynamics (in contrast to most visual servoing controllers that assume first order dynamics), and present validation of our methods through both simulations and experiments.

UR - http://www.scopus.com/inward/record.url?scp=84929161370&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84929161370&partnerID=8YFLogxK

U2 - 10.1109/ICRA.2014.6907149

DO - 10.1109/ICRA.2014.6907149

M3 - Conference article

AN - SCOPUS:84929161370

SP - 2113

EP - 2118

JO - Proceedings - IEEE International Conference on Robotics and Automation

JF - Proceedings - IEEE International Conference on Robotics and Automation

SN - 1050-4729

M1 - 6907149

ER -