Wearable smart glasses for assessment of eye-contact behavior in children with autism

Ashwin RajKumar, Chetan Arora, Barry Katz, Vikram Kapila

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

To promote eye contact learning and behavior in children with autism, there exist specialized environments as well as smartphone applications. However, few currently available techniques support the assessment of desired behavioral improvement during learning. In this paper, we describe recently developed wearable smart glasses instrumented with mechatronic sensors and controllers. The mechatronics glasses, worn by both an instructor and a child, quantitatively measure the eye contact behavior of the child. The instructor glasses connect with a smartphone application through Bluetooth low energy. A user interface is created and hosted on the smartphone to enable the instructor to customize the reward to the child based on improvements in eye contact behavior. Specifically, the smartphone application quantifies the eye contact duration, frequency, latency, and session time, allowing instructors, therapists, and clinicians to monitor and track the child’s progress in eye contact behavior. The results from preliminary user testing of the device with control subjects show that the device is capable of recording sessions details and supporting eye contact behavior assessment.

Original languageEnglish (US)
Title of host publicationFrontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019
PublisherAmerican Society of Mechanical Engineers (ASME)
ISBN (Electronic)9780791841037
DOIs
StatePublished - Jan 1 2019
Event2019 Design of Medical Devices Conference, DMD 2019 - Minneapolis, United States
Duration: Apr 15 2019Apr 18 2019

Publication series

NameFrontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019

Conference

Conference2019 Design of Medical Devices Conference, DMD 2019
CountryUnited States
CityMinneapolis
Period4/15/194/18/19

Fingerprint

Smartphones
Glass
Mechatronics
Bluetooth
User interfaces
Controllers
Sensors
Testing

Keywords

  • Assessment
  • Autism spectrum disorder
  • Eye contact behavior
  • Wearable glasses

ASJC Scopus subject areas

  • Biomedical Engineering

Cite this

RajKumar, A., Arora, C., Katz, B., & Kapila, V. (2019). Wearable smart glasses for assessment of eye-contact behavior in children with autism. In Frontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019 (Frontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019). American Society of Mechanical Engineers (ASME). https://doi.org/10.1115/DMD2019-3221

Wearable smart glasses for assessment of eye-contact behavior in children with autism. / RajKumar, Ashwin; Arora, Chetan; Katz, Barry; Kapila, Vikram.

Frontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019. American Society of Mechanical Engineers (ASME), 2019. (Frontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

RajKumar, A, Arora, C, Katz, B & Kapila, V 2019, Wearable smart glasses for assessment of eye-contact behavior in children with autism. in Frontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019. Frontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019, American Society of Mechanical Engineers (ASME), 2019 Design of Medical Devices Conference, DMD 2019, Minneapolis, United States, 4/15/19. https://doi.org/10.1115/DMD2019-3221
RajKumar A, Arora C, Katz B, Kapila V. Wearable smart glasses for assessment of eye-contact behavior in children with autism. In Frontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019. American Society of Mechanical Engineers (ASME). 2019. (Frontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019). https://doi.org/10.1115/DMD2019-3221
RajKumar, Ashwin ; Arora, Chetan ; Katz, Barry ; Kapila, Vikram. / Wearable smart glasses for assessment of eye-contact behavior in children with autism. Frontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019. American Society of Mechanical Engineers (ASME), 2019. (Frontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019).
@inproceedings{0e229e3938584d5b9c005cb358e51654,
title = "Wearable smart glasses for assessment of eye-contact behavior in children with autism",
abstract = "To promote eye contact learning and behavior in children with autism, there exist specialized environments as well as smartphone applications. However, few currently available techniques support the assessment of desired behavioral improvement during learning. In this paper, we describe recently developed wearable smart glasses instrumented with mechatronic sensors and controllers. The mechatronics glasses, worn by both an instructor and a child, quantitatively measure the eye contact behavior of the child. The instructor glasses connect with a smartphone application through Bluetooth low energy. A user interface is created and hosted on the smartphone to enable the instructor to customize the reward to the child based on improvements in eye contact behavior. Specifically, the smartphone application quantifies the eye contact duration, frequency, latency, and session time, allowing instructors, therapists, and clinicians to monitor and track the child’s progress in eye contact behavior. The results from preliminary user testing of the device with control subjects show that the device is capable of recording sessions details and supporting eye contact behavior assessment.",
keywords = "Assessment, Autism spectrum disorder, Eye contact behavior, Wearable glasses",
author = "Ashwin RajKumar and Chetan Arora and Barry Katz and Vikram Kapila",
year = "2019",
month = "1",
day = "1",
doi = "10.1115/DMD2019-3221",
language = "English (US)",
series = "Frontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019",
publisher = "American Society of Mechanical Engineers (ASME)",
booktitle = "Frontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019",

}

TY - GEN

T1 - Wearable smart glasses for assessment of eye-contact behavior in children with autism

AU - RajKumar, Ashwin

AU - Arora, Chetan

AU - Katz, Barry

AU - Kapila, Vikram

PY - 2019/1/1

Y1 - 2019/1/1

N2 - To promote eye contact learning and behavior in children with autism, there exist specialized environments as well as smartphone applications. However, few currently available techniques support the assessment of desired behavioral improvement during learning. In this paper, we describe recently developed wearable smart glasses instrumented with mechatronic sensors and controllers. The mechatronics glasses, worn by both an instructor and a child, quantitatively measure the eye contact behavior of the child. The instructor glasses connect with a smartphone application through Bluetooth low energy. A user interface is created and hosted on the smartphone to enable the instructor to customize the reward to the child based on improvements in eye contact behavior. Specifically, the smartphone application quantifies the eye contact duration, frequency, latency, and session time, allowing instructors, therapists, and clinicians to monitor and track the child’s progress in eye contact behavior. The results from preliminary user testing of the device with control subjects show that the device is capable of recording sessions details and supporting eye contact behavior assessment.

AB - To promote eye contact learning and behavior in children with autism, there exist specialized environments as well as smartphone applications. However, few currently available techniques support the assessment of desired behavioral improvement during learning. In this paper, we describe recently developed wearable smart glasses instrumented with mechatronic sensors and controllers. The mechatronics glasses, worn by both an instructor and a child, quantitatively measure the eye contact behavior of the child. The instructor glasses connect with a smartphone application through Bluetooth low energy. A user interface is created and hosted on the smartphone to enable the instructor to customize the reward to the child based on improvements in eye contact behavior. Specifically, the smartphone application quantifies the eye contact duration, frequency, latency, and session time, allowing instructors, therapists, and clinicians to monitor and track the child’s progress in eye contact behavior. The results from preliminary user testing of the device with control subjects show that the device is capable of recording sessions details and supporting eye contact behavior assessment.

KW - Assessment

KW - Autism spectrum disorder

KW - Eye contact behavior

KW - Wearable glasses

UR - http://www.scopus.com/inward/record.url?scp=85073889207&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073889207&partnerID=8YFLogxK

U2 - 10.1115/DMD2019-3221

DO - 10.1115/DMD2019-3221

M3 - Conference contribution

AN - SCOPUS:85073889207

T3 - Frontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019

BT - Frontiers in Biomedical Devices, BIOMED - 2019 Design of Medical Devices Conference, DMD 2019

PB - American Society of Mechanical Engineers (ASME)

ER -