Controlling a robotic fish via a natural user interface for informal science education

Paul Phamduy, Mauro Debellis, Maurizio Porfiri

Research output: Contribution to journalArticle

Abstract

Informal science education is a key contributing factor to scientific literacy, which determines our capacity as a society to technologically progress and make cognizant decisions on pressing issues of global scale. Both the fields of robotics and natural user interfaces have been separately proposed as effective means to aid informal science education, by increasing users' engagement through multiple interactive features. Here, we demonstrate the integration of these two fields of investigation toward a novel educational platform, revolving around the control of a robotic fish via a natural user interface. Users control the robotic fish through upper limb gestures that are captured by the Kinect. The robotic fish incorporates a temperature sensor, which collects data in a tank instrumented with heating and cooling sources. Participants observe the measurements they are recording in real-time to map the environment. Self-reported post-activity surveys and behavioral coding data on young users were collected to assess their level of engagement in the activity and their perception of the system. Our results indicate that the robotic fish is intuitive to drive with the natural user interface, the activity of collecting water temperature is interesting, and robotics may be a viable and accessible career option.

Original languageEnglish (US)
Article number7272111
Pages (from-to)2328-2337
Number of pages10
JournalIEEE Transactions on Multimedia
Volume17
Issue number12
DOIs
StatePublished - Dec 1 2015

Fingerprint

Fish
User interfaces
Robotics
Education
Temperature sensors
Cooling
Heating
Water
Temperature

Keywords

  • Biologically-inspired robots
  • educational robotics
  • Kinect
  • natural user interfaces (NUIs)

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Signal Processing
  • Media Technology
  • Computer Science Applications

Cite this

Controlling a robotic fish via a natural user interface for informal science education. / Phamduy, Paul; Debellis, Mauro; Porfiri, Maurizio.

In: IEEE Transactions on Multimedia, Vol. 17, No. 12, 7272111, 01.12.2015, p. 2328-2337.

Research output: Contribution to journalArticle

@article{5ab2cc71253343459ed547b157901269,
title = "Controlling a robotic fish via a natural user interface for informal science education",
abstract = "Informal science education is a key contributing factor to scientific literacy, which determines our capacity as a society to technologically progress and make cognizant decisions on pressing issues of global scale. Both the fields of robotics and natural user interfaces have been separately proposed as effective means to aid informal science education, by increasing users' engagement through multiple interactive features. Here, we demonstrate the integration of these two fields of investigation toward a novel educational platform, revolving around the control of a robotic fish via a natural user interface. Users control the robotic fish through upper limb gestures that are captured by the Kinect. The robotic fish incorporates a temperature sensor, which collects data in a tank instrumented with heating and cooling sources. Participants observe the measurements they are recording in real-time to map the environment. Self-reported post-activity surveys and behavioral coding data on young users were collected to assess their level of engagement in the activity and their perception of the system. Our results indicate that the robotic fish is intuitive to drive with the natural user interface, the activity of collecting water temperature is interesting, and robotics may be a viable and accessible career option.",
keywords = "Biologically-inspired robots, educational robotics, Kinect, natural user interfaces (NUIs)",
author = "Paul Phamduy and Mauro Debellis and Maurizio Porfiri",
year = "2015",
month = "12",
day = "1",
doi = "10.1109/TMM.2015.2480226",
language = "English (US)",
volume = "17",
pages = "2328--2337",
journal = "IEEE Transactions on Multimedia",
issn = "1520-9210",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "12",

}

TY - JOUR

T1 - Controlling a robotic fish via a natural user interface for informal science education

AU - Phamduy, Paul

AU - Debellis, Mauro

AU - Porfiri, Maurizio

PY - 2015/12/1

Y1 - 2015/12/1

N2 - Informal science education is a key contributing factor to scientific literacy, which determines our capacity as a society to technologically progress and make cognizant decisions on pressing issues of global scale. Both the fields of robotics and natural user interfaces have been separately proposed as effective means to aid informal science education, by increasing users' engagement through multiple interactive features. Here, we demonstrate the integration of these two fields of investigation toward a novel educational platform, revolving around the control of a robotic fish via a natural user interface. Users control the robotic fish through upper limb gestures that are captured by the Kinect. The robotic fish incorporates a temperature sensor, which collects data in a tank instrumented with heating and cooling sources. Participants observe the measurements they are recording in real-time to map the environment. Self-reported post-activity surveys and behavioral coding data on young users were collected to assess their level of engagement in the activity and their perception of the system. Our results indicate that the robotic fish is intuitive to drive with the natural user interface, the activity of collecting water temperature is interesting, and robotics may be a viable and accessible career option.

AB - Informal science education is a key contributing factor to scientific literacy, which determines our capacity as a society to technologically progress and make cognizant decisions on pressing issues of global scale. Both the fields of robotics and natural user interfaces have been separately proposed as effective means to aid informal science education, by increasing users' engagement through multiple interactive features. Here, we demonstrate the integration of these two fields of investigation toward a novel educational platform, revolving around the control of a robotic fish via a natural user interface. Users control the robotic fish through upper limb gestures that are captured by the Kinect. The robotic fish incorporates a temperature sensor, which collects data in a tank instrumented with heating and cooling sources. Participants observe the measurements they are recording in real-time to map the environment. Self-reported post-activity surveys and behavioral coding data on young users were collected to assess their level of engagement in the activity and their perception of the system. Our results indicate that the robotic fish is intuitive to drive with the natural user interface, the activity of collecting water temperature is interesting, and robotics may be a viable and accessible career option.

KW - Biologically-inspired robots

KW - educational robotics

KW - Kinect

KW - natural user interfaces (NUIs)

UR - http://www.scopus.com/inward/record.url?scp=84964905872&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84964905872&partnerID=8YFLogxK

U2 - 10.1109/TMM.2015.2480226

DO - 10.1109/TMM.2015.2480226

M3 - Article

VL - 17

SP - 2328

EP - 2337

JO - IEEE Transactions on Multimedia

JF - IEEE Transactions on Multimedia

SN - 1520-9210

IS - 12

M1 - 7272111

ER -