Comparing interface elements on a tablet for intuitive teleoperation of a mobile manipulator

David A. Lopez, Jared A. Frank, Vikram Kapila

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As mobile robots experience increased commercialization, development of intuitive interfaces for human-robot interaction gains paramount importance to promote pervasive adoption of such robots in society. Although smart devices may be useful to operate robots, prior research has not fully investigated the appropriateness of various interaction elements (e.g., touch, gestures, sensors, etc.) to render an effective human-robot interface. This paper provides overviews of a mobile manipulator and a tablet-based application to operate the mobile manipulator. In particular, a mobile manipulator is designed to navigate an obstacle course and to pick and place objects around the course, all under the control of a human operator who uses a tabletbased application. The tablet application provides the user live videos that are captured and streamed by a camera onboard the robot and an overhead camera. In addition, to remotely operate the mobile manipulator, the tablet application provides the user a menu of four interface element options, including, virtual buttons, virtual joysticks, touchscreen gesture, and tilting the device. To evaluate the intuitiveness of the four interface elements for operating the mobile manipulator, a user study is conducted in which participants' performance is monitored as they operate the mobile manipulator using the designed interfaces. The analysis of the user study shows that the tablet-based application allows even non-experienced users to operate the mobile manipulator without the need for extensive training.

Original languageEnglish (US)
Title of host publicationEngineering Systems; Heat Transfer and Thermal Engineering; Materials and Tribology; Mechatronics; Robotics
PublisherWeb Portal ASME (American Society of Mechanical Engineers)
Volume3
ISBN (Print)9780791845851
DOIs
StatePublished - 2014
EventASME 2014 12th Biennial Conference on Engineering Systems Design and Analysis, ESDA 2014 - Copenhagen, Denmark
Duration: Jul 25 2014Jul 27 2014

Other

OtherASME 2014 12th Biennial Conference on Engineering Systems Design and Analysis, ESDA 2014
CountryDenmark
CityCopenhagen
Period7/25/147/27/14

Fingerprint

Mobile Manipulator
Interface Element
Teleoperation
Remote control
Manipulators
Intuitive
Robot
Robots
User Studies
Gesture
Camera
Cameras
Human-robot Interaction
Human robot interaction
Touch screens
Tilting
Mobile Robot
Mobile robots
Sensor
Evaluate

Keywords

  • Interface
  • Manipulator
  • Mobile
  • Robot
  • Tablet

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Mechanical Engineering
  • Computational Mechanics
  • Computer Science Applications
  • Modeling and Simulation

Cite this

Lopez, D. A., Frank, J. A., & Kapila, V. (2014). Comparing interface elements on a tablet for intuitive teleoperation of a mobile manipulator. In Engineering Systems; Heat Transfer and Thermal Engineering; Materials and Tribology; Mechatronics; Robotics (Vol. 3). Web Portal ASME (American Society of Mechanical Engineers). https://doi.org/10.1115/ESDA2014-20126

Comparing interface elements on a tablet for intuitive teleoperation of a mobile manipulator. / Lopez, David A.; Frank, Jared A.; Kapila, Vikram.

Engineering Systems; Heat Transfer and Thermal Engineering; Materials and Tribology; Mechatronics; Robotics. Vol. 3 Web Portal ASME (American Society of Mechanical Engineers), 2014.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Lopez, DA, Frank, JA & Kapila, V 2014, Comparing interface elements on a tablet for intuitive teleoperation of a mobile manipulator. in Engineering Systems; Heat Transfer and Thermal Engineering; Materials and Tribology; Mechatronics; Robotics. vol. 3, Web Portal ASME (American Society of Mechanical Engineers), ASME 2014 12th Biennial Conference on Engineering Systems Design and Analysis, ESDA 2014, Copenhagen, Denmark, 7/25/14. https://doi.org/10.1115/ESDA2014-20126
Lopez DA, Frank JA, Kapila V. Comparing interface elements on a tablet for intuitive teleoperation of a mobile manipulator. In Engineering Systems; Heat Transfer and Thermal Engineering; Materials and Tribology; Mechatronics; Robotics. Vol. 3. Web Portal ASME (American Society of Mechanical Engineers). 2014 https://doi.org/10.1115/ESDA2014-20126
Lopez, David A. ; Frank, Jared A. ; Kapila, Vikram. / Comparing interface elements on a tablet for intuitive teleoperation of a mobile manipulator. Engineering Systems; Heat Transfer and Thermal Engineering; Materials and Tribology; Mechatronics; Robotics. Vol. 3 Web Portal ASME (American Society of Mechanical Engineers), 2014.
@inproceedings{5bf08f96567848e9993c1becc3b484d3,
title = "Comparing interface elements on a tablet for intuitive teleoperation of a mobile manipulator",
abstract = "As mobile robots experience increased commercialization, development of intuitive interfaces for human-robot interaction gains paramount importance to promote pervasive adoption of such robots in society. Although smart devices may be useful to operate robots, prior research has not fully investigated the appropriateness of various interaction elements (e.g., touch, gestures, sensors, etc.) to render an effective human-robot interface. This paper provides overviews of a mobile manipulator and a tablet-based application to operate the mobile manipulator. In particular, a mobile manipulator is designed to navigate an obstacle course and to pick and place objects around the course, all under the control of a human operator who uses a tabletbased application. The tablet application provides the user live videos that are captured and streamed by a camera onboard the robot and an overhead camera. In addition, to remotely operate the mobile manipulator, the tablet application provides the user a menu of four interface element options, including, virtual buttons, virtual joysticks, touchscreen gesture, and tilting the device. To evaluate the intuitiveness of the four interface elements for operating the mobile manipulator, a user study is conducted in which participants' performance is monitored as they operate the mobile manipulator using the designed interfaces. The analysis of the user study shows that the tablet-based application allows even non-experienced users to operate the mobile manipulator without the need for extensive training.",
keywords = "Interface, Manipulator, Mobile, Robot, Tablet",
author = "Lopez, {David A.} and Frank, {Jared A.} and Vikram Kapila",
year = "2014",
doi = "10.1115/ESDA2014-20126",
language = "English (US)",
isbn = "9780791845851",
volume = "3",
booktitle = "Engineering Systems; Heat Transfer and Thermal Engineering; Materials and Tribology; Mechatronics; Robotics",
publisher = "Web Portal ASME (American Society of Mechanical Engineers)",

}

TY - GEN

T1 - Comparing interface elements on a tablet for intuitive teleoperation of a mobile manipulator

AU - Lopez, David A.

AU - Frank, Jared A.

AU - Kapila, Vikram

PY - 2014

Y1 - 2014

N2 - As mobile robots experience increased commercialization, development of intuitive interfaces for human-robot interaction gains paramount importance to promote pervasive adoption of such robots in society. Although smart devices may be useful to operate robots, prior research has not fully investigated the appropriateness of various interaction elements (e.g., touch, gestures, sensors, etc.) to render an effective human-robot interface. This paper provides overviews of a mobile manipulator and a tablet-based application to operate the mobile manipulator. In particular, a mobile manipulator is designed to navigate an obstacle course and to pick and place objects around the course, all under the control of a human operator who uses a tabletbased application. The tablet application provides the user live videos that are captured and streamed by a camera onboard the robot and an overhead camera. In addition, to remotely operate the mobile manipulator, the tablet application provides the user a menu of four interface element options, including, virtual buttons, virtual joysticks, touchscreen gesture, and tilting the device. To evaluate the intuitiveness of the four interface elements for operating the mobile manipulator, a user study is conducted in which participants' performance is monitored as they operate the mobile manipulator using the designed interfaces. The analysis of the user study shows that the tablet-based application allows even non-experienced users to operate the mobile manipulator without the need for extensive training.

AB - As mobile robots experience increased commercialization, development of intuitive interfaces for human-robot interaction gains paramount importance to promote pervasive adoption of such robots in society. Although smart devices may be useful to operate robots, prior research has not fully investigated the appropriateness of various interaction elements (e.g., touch, gestures, sensors, etc.) to render an effective human-robot interface. This paper provides overviews of a mobile manipulator and a tablet-based application to operate the mobile manipulator. In particular, a mobile manipulator is designed to navigate an obstacle course and to pick and place objects around the course, all under the control of a human operator who uses a tabletbased application. The tablet application provides the user live videos that are captured and streamed by a camera onboard the robot and an overhead camera. In addition, to remotely operate the mobile manipulator, the tablet application provides the user a menu of four interface element options, including, virtual buttons, virtual joysticks, touchscreen gesture, and tilting the device. To evaluate the intuitiveness of the four interface elements for operating the mobile manipulator, a user study is conducted in which participants' performance is monitored as they operate the mobile manipulator using the designed interfaces. The analysis of the user study shows that the tablet-based application allows even non-experienced users to operate the mobile manipulator without the need for extensive training.

KW - Interface

KW - Manipulator

KW - Mobile

KW - Robot

KW - Tablet

UR - http://www.scopus.com/inward/record.url?scp=84916908929&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84916908929&partnerID=8YFLogxK

U2 - 10.1115/ESDA2014-20126

DO - 10.1115/ESDA2014-20126

M3 - Conference contribution

AN - SCOPUS:84916908929

SN - 9780791845851

VL - 3

BT - Engineering Systems; Heat Transfer and Thermal Engineering; Materials and Tribology; Mechatronics; Robotics

PB - Web Portal ASME (American Society of Mechanical Engineers)

ER -