Using tablets in the vision-based control of a ball and beam test-bed

Jared A. Frank, José Antonio De Gracia Gómez, Vikram Kapila

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Although the onboard cameras of smart devices have been used in the monitoring and teleoperation of physical systems such as robots, their use in the vision-based feedback control of such systems remains to be fully explored. In this paper, we discuss an approach to control a ball and beam test-bed using visual feedback from a smart device with its camera pointed at the test-bed. The computation of a homography between the frames of a live video and a reference image allows the smart device to accurately estimate the state of the test-bed while facing the test-bed from any perspective. Augmented reality is incorporated in the development of an interactive user interface on the smart device that allows users to command the position of the ball on the beam by tapping their fingers at the desired location on the touchscreen. Experiments using a tablet are performed to characterize the noise of vision-based measurements and to illustrate the performance of the closed-loop control system.

Original languageEnglish (US)
Title of host publicationICINCO 2015 - 12th International Conference on Informatics in Control, Automation and Robotics, Proceedings
PublisherSciTePress
Pages92-102
Number of pages11
Volume2
ISBN (Print)9789897581236
StatePublished - 2015
Event12th International Conference on Informatics in Control, Automation and Robotics, ICINCO 2015 - Colmar, Alsace, France
Duration: Jul 21 2015Jul 23 2015

Other

Other12th International Conference on Informatics in Control, Automation and Robotics, ICINCO 2015
CountryFrance
CityColmar, Alsace
Period7/21/157/23/15

Fingerprint

Cameras
Closed loop control systems
Touch screens
Augmented reality
Remote control
User interfaces
Feedback control
Robots
Feedback
Monitoring
Experiments

Keywords

  • Ball and beam
  • Homography
  • Immersive
  • Interface
  • Networked control system
  • Tablet
  • Vision-based control

ASJC Scopus subject areas

  • Information Systems
  • Control and Systems Engineering
  • Computer Vision and Pattern Recognition

Cite this

Frank, J. A., De Gracia Gómez, J. A., & Kapila, V. (2015). Using tablets in the vision-based control of a ball and beam test-bed. In ICINCO 2015 - 12th International Conference on Informatics in Control, Automation and Robotics, Proceedings (Vol. 2, pp. 92-102). SciTePress.

Using tablets in the vision-based control of a ball and beam test-bed. / Frank, Jared A.; De Gracia Gómez, José Antonio; Kapila, Vikram.

ICINCO 2015 - 12th International Conference on Informatics in Control, Automation and Robotics, Proceedings. Vol. 2 SciTePress, 2015. p. 92-102.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Frank, JA, De Gracia Gómez, JA & Kapila, V 2015, Using tablets in the vision-based control of a ball and beam test-bed. in ICINCO 2015 - 12th International Conference on Informatics in Control, Automation and Robotics, Proceedings. vol. 2, SciTePress, pp. 92-102, 12th International Conference on Informatics in Control, Automation and Robotics, ICINCO 2015, Colmar, Alsace, France, 7/21/15.
Frank JA, De Gracia Gómez JA, Kapila V. Using tablets in the vision-based control of a ball and beam test-bed. In ICINCO 2015 - 12th International Conference on Informatics in Control, Automation and Robotics, Proceedings. Vol. 2. SciTePress. 2015. p. 92-102
Frank, Jared A. ; De Gracia Gómez, José Antonio ; Kapila, Vikram. / Using tablets in the vision-based control of a ball and beam test-bed. ICINCO 2015 - 12th International Conference on Informatics in Control, Automation and Robotics, Proceedings. Vol. 2 SciTePress, 2015. pp. 92-102
@inproceedings{c08c34a979ae4567991cba0fa5589d38,
title = "Using tablets in the vision-based control of a ball and beam test-bed",
abstract = "Although the onboard cameras of smart devices have been used in the monitoring and teleoperation of physical systems such as robots, their use in the vision-based feedback control of such systems remains to be fully explored. In this paper, we discuss an approach to control a ball and beam test-bed using visual feedback from a smart device with its camera pointed at the test-bed. The computation of a homography between the frames of a live video and a reference image allows the smart device to accurately estimate the state of the test-bed while facing the test-bed from any perspective. Augmented reality is incorporated in the development of an interactive user interface on the smart device that allows users to command the position of the ball on the beam by tapping their fingers at the desired location on the touchscreen. Experiments using a tablet are performed to characterize the noise of vision-based measurements and to illustrate the performance of the closed-loop control system.",
keywords = "Ball and beam, Homography, Immersive, Interface, Networked control system, Tablet, Vision-based control",
author = "Frank, {Jared A.} and {De Gracia G{\'o}mez}, {Jos{\'e} Antonio} and Vikram Kapila",
year = "2015",
language = "English (US)",
isbn = "9789897581236",
volume = "2",
pages = "92--102",
booktitle = "ICINCO 2015 - 12th International Conference on Informatics in Control, Automation and Robotics, Proceedings",
publisher = "SciTePress",

}

TY - GEN

T1 - Using tablets in the vision-based control of a ball and beam test-bed

AU - Frank, Jared A.

AU - De Gracia Gómez, José Antonio

AU - Kapila, Vikram

PY - 2015

Y1 - 2015

N2 - Although the onboard cameras of smart devices have been used in the monitoring and teleoperation of physical systems such as robots, their use in the vision-based feedback control of such systems remains to be fully explored. In this paper, we discuss an approach to control a ball and beam test-bed using visual feedback from a smart device with its camera pointed at the test-bed. The computation of a homography between the frames of a live video and a reference image allows the smart device to accurately estimate the state of the test-bed while facing the test-bed from any perspective. Augmented reality is incorporated in the development of an interactive user interface on the smart device that allows users to command the position of the ball on the beam by tapping their fingers at the desired location on the touchscreen. Experiments using a tablet are performed to characterize the noise of vision-based measurements and to illustrate the performance of the closed-loop control system.

AB - Although the onboard cameras of smart devices have been used in the monitoring and teleoperation of physical systems such as robots, their use in the vision-based feedback control of such systems remains to be fully explored. In this paper, we discuss an approach to control a ball and beam test-bed using visual feedback from a smart device with its camera pointed at the test-bed. The computation of a homography between the frames of a live video and a reference image allows the smart device to accurately estimate the state of the test-bed while facing the test-bed from any perspective. Augmented reality is incorporated in the development of an interactive user interface on the smart device that allows users to command the position of the ball on the beam by tapping their fingers at the desired location on the touchscreen. Experiments using a tablet are performed to characterize the noise of vision-based measurements and to illustrate the performance of the closed-loop control system.

KW - Ball and beam

KW - Homography

KW - Immersive

KW - Interface

KW - Networked control system

KW - Tablet

KW - Vision-based control

UR - http://www.scopus.com/inward/record.url?scp=84943540980&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84943540980&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9789897581236

VL - 2

SP - 92

EP - 102

BT - ICINCO 2015 - 12th International Conference on Informatics in Control, Automation and Robotics, Proceedings

PB - SciTePress

ER -