Interactive mobile interface with augmented reality for learning digital control concepts

Jared A. Frank, Anthony Brill, Vikram Kapila

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The use of augmented reality (AR) and mobile applications has recently been investigated in the teaching of advanced concepts and training of skills in a variety of fields. By developing educational mobile applications that incorporate augmented reality, unique interactive learning experiences can be provided to learners on their personal smartphones and tablet computers. This paper presents the development of an immersive user interface on a tablet device that can be used by engineering students to interact with a motor test-bed as they examine the effects of discrete-time pole locations on the closed-loop dynamic response of the test-bed. Specifically, users point the rear-facing camera of the tablet at the test-bed on which colored markers are affixed to enable an image processing routine running on the tablet to measure the angular position of an arm attached to the motor. To perform vision-based control of the angular position of motor arm, a discrete-time Kalman filter and a full-state feedback controller are implemented in the background of the application. As the user taps on the touchscreen of the device, s/he adjusts the angular position of a 3D semi-transparent virtual arm that represents the set point to the system. An interactive pole-zero plot allows users to tap at any desired location for the closed-loop pole-placement, in turn triggering the application code to redesign a new controller for driving the test-bed. Real-time plots enable the user to explore the resulting closed-loop response of the test-bed. Experimental results show several responses of the test-bed to demonstrate the efficacy of the proposed system.

Original languageEnglish (US)
Title of host publication2016 Indian Control Conference, ICC 2016 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages85-92
Number of pages8
ISBN (Print)9781467379939
DOIs
StatePublished - Mar 24 2016
Event2nd Indian Control Conference, ICC 2016 - Hyderabad, India
Duration: Jan 4 2016Jan 6 2016

Other

Other2nd Indian Control Conference, ICC 2016
CountryIndia
CityHyderabad
Period1/4/161/6/16

Fingerprint

Augmented reality
Poles
Facings
Controllers
Touch screens
Smartphones
State feedback
Kalman filters
User interfaces
Dynamic response
Teaching
Image processing
Cameras
Students

ASJC Scopus subject areas

  • Control and Systems Engineering

Cite this

Frank, J. A., Brill, A., & Kapila, V. (2016). Interactive mobile interface with augmented reality for learning digital control concepts. In 2016 Indian Control Conference, ICC 2016 - Proceedings (pp. 85-92). [7441110] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/INDIANCC.2016.7441110

Interactive mobile interface with augmented reality for learning digital control concepts. / Frank, Jared A.; Brill, Anthony; Kapila, Vikram.

2016 Indian Control Conference, ICC 2016 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2016. p. 85-92 7441110.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Frank, JA, Brill, A & Kapila, V 2016, Interactive mobile interface with augmented reality for learning digital control concepts. in 2016 Indian Control Conference, ICC 2016 - Proceedings., 7441110, Institute of Electrical and Electronics Engineers Inc., pp. 85-92, 2nd Indian Control Conference, ICC 2016, Hyderabad, India, 1/4/16. https://doi.org/10.1109/INDIANCC.2016.7441110
Frank JA, Brill A, Kapila V. Interactive mobile interface with augmented reality for learning digital control concepts. In 2016 Indian Control Conference, ICC 2016 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2016. p. 85-92. 7441110 https://doi.org/10.1109/INDIANCC.2016.7441110
Frank, Jared A. ; Brill, Anthony ; Kapila, Vikram. / Interactive mobile interface with augmented reality for learning digital control concepts. 2016 Indian Control Conference, ICC 2016 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 85-92
@inproceedings{df4341d4db7b4ab1a9a7a7fab4894c6f,
title = "Interactive mobile interface with augmented reality for learning digital control concepts",
abstract = "The use of augmented reality (AR) and mobile applications has recently been investigated in the teaching of advanced concepts and training of skills in a variety of fields. By developing educational mobile applications that incorporate augmented reality, unique interactive learning experiences can be provided to learners on their personal smartphones and tablet computers. This paper presents the development of an immersive user interface on a tablet device that can be used by engineering students to interact with a motor test-bed as they examine the effects of discrete-time pole locations on the closed-loop dynamic response of the test-bed. Specifically, users point the rear-facing camera of the tablet at the test-bed on which colored markers are affixed to enable an image processing routine running on the tablet to measure the angular position of an arm attached to the motor. To perform vision-based control of the angular position of motor arm, a discrete-time Kalman filter and a full-state feedback controller are implemented in the background of the application. As the user taps on the touchscreen of the device, s/he adjusts the angular position of a 3D semi-transparent virtual arm that represents the set point to the system. An interactive pole-zero plot allows users to tap at any desired location for the closed-loop pole-placement, in turn triggering the application code to redesign a new controller for driving the test-bed. Real-time plots enable the user to explore the resulting closed-loop response of the test-bed. Experimental results show several responses of the test-bed to demonstrate the efficacy of the proposed system.",
author = "Frank, {Jared A.} and Anthony Brill and Vikram Kapila",
year = "2016",
month = "3",
day = "24",
doi = "10.1109/INDIANCC.2016.7441110",
language = "English (US)",
isbn = "9781467379939",
pages = "85--92",
booktitle = "2016 Indian Control Conference, ICC 2016 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Interactive mobile interface with augmented reality for learning digital control concepts

AU - Frank, Jared A.

AU - Brill, Anthony

AU - Kapila, Vikram

PY - 2016/3/24

Y1 - 2016/3/24

N2 - The use of augmented reality (AR) and mobile applications has recently been investigated in the teaching of advanced concepts and training of skills in a variety of fields. By developing educational mobile applications that incorporate augmented reality, unique interactive learning experiences can be provided to learners on their personal smartphones and tablet computers. This paper presents the development of an immersive user interface on a tablet device that can be used by engineering students to interact with a motor test-bed as they examine the effects of discrete-time pole locations on the closed-loop dynamic response of the test-bed. Specifically, users point the rear-facing camera of the tablet at the test-bed on which colored markers are affixed to enable an image processing routine running on the tablet to measure the angular position of an arm attached to the motor. To perform vision-based control of the angular position of motor arm, a discrete-time Kalman filter and a full-state feedback controller are implemented in the background of the application. As the user taps on the touchscreen of the device, s/he adjusts the angular position of a 3D semi-transparent virtual arm that represents the set point to the system. An interactive pole-zero plot allows users to tap at any desired location for the closed-loop pole-placement, in turn triggering the application code to redesign a new controller for driving the test-bed. Real-time plots enable the user to explore the resulting closed-loop response of the test-bed. Experimental results show several responses of the test-bed to demonstrate the efficacy of the proposed system.

AB - The use of augmented reality (AR) and mobile applications has recently been investigated in the teaching of advanced concepts and training of skills in a variety of fields. By developing educational mobile applications that incorporate augmented reality, unique interactive learning experiences can be provided to learners on their personal smartphones and tablet computers. This paper presents the development of an immersive user interface on a tablet device that can be used by engineering students to interact with a motor test-bed as they examine the effects of discrete-time pole locations on the closed-loop dynamic response of the test-bed. Specifically, users point the rear-facing camera of the tablet at the test-bed on which colored markers are affixed to enable an image processing routine running on the tablet to measure the angular position of an arm attached to the motor. To perform vision-based control of the angular position of motor arm, a discrete-time Kalman filter and a full-state feedback controller are implemented in the background of the application. As the user taps on the touchscreen of the device, s/he adjusts the angular position of a 3D semi-transparent virtual arm that represents the set point to the system. An interactive pole-zero plot allows users to tap at any desired location for the closed-loop pole-placement, in turn triggering the application code to redesign a new controller for driving the test-bed. Real-time plots enable the user to explore the resulting closed-loop response of the test-bed. Experimental results show several responses of the test-bed to demonstrate the efficacy of the proposed system.

UR - http://www.scopus.com/inward/record.url?scp=84965176712&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84965176712&partnerID=8YFLogxK

U2 - 10.1109/INDIANCC.2016.7441110

DO - 10.1109/INDIANCC.2016.7441110

M3 - Conference contribution

AN - SCOPUS:84965176712

SN - 9781467379939

SP - 85

EP - 92

BT - 2016 Indian Control Conference, ICC 2016 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -