AutoViDev: A Computer-Vision Framework to Enhance and Accelerate Research in Human Development

Ori Ossmy, Rick O. Gilmore, Karen Adolph

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Interdisciplinary exchange of ideas and tools can accelerate scientific progress. For example, findings from developmental and vision science have spurred recent advances in artificial intelligence and computer vision. However, relatively little attention has been paid to how artificial intelligence and computer vision can facilitate research in developmental science. The current study presents AutoViDev—an automatic video-analysis tool that uses machine learning and computer vision to support video-based developmental research. AutoViDev identifies full body position estimations in real-time video streams using convolutional pose machine-learning algorithms. AutoViDev provides valuable information about a variety of behaviors, including gaze direction, facial expressions, posture, locomotion, manual actions, and interactions with objects. We present a high-level architecture of the framework and describe two projects that demonstrate its usability. We discuss the benefits of applying AutoViDev to large-scale, shared video datasets and highlight how machine learning and computer vision can enhance and accelerate research in developmental science.

Original languageEnglish (US)
Title of host publicationAdvances in Computer Vision - Proceedings of the 2019 Computer Vision Conference CVC
EditorsKohei Arai, Supriya Kapoor
PublisherSpringer-Verlag
Pages147-156
Number of pages10
ISBN (Print)9783030177973
DOIs
StatePublished - Jan 1 2020
EventComputer Vision Conference, CVC 2019 - Las Vegas, United States
Duration: Apr 25 2019Apr 26 2019

Publication series

NameAdvances in Intelligent Systems and Computing
Volume944
ISSN (Print)2194-5357

Conference

ConferenceComputer Vision Conference, CVC 2019
CountryUnited States
CityLas Vegas
Period4/25/194/26/19

    Fingerprint

Keywords

  • Behavioral science
  • Body recognition
  • Computer vision
  • Convolutional pose machines
  • Human development

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science(all)

Cite this

Ossmy, O., Gilmore, R. O., & Adolph, K. (2020). AutoViDev: A Computer-Vision Framework to Enhance and Accelerate Research in Human Development. In K. Arai, & S. Kapoor (Eds.), Advances in Computer Vision - Proceedings of the 2019 Computer Vision Conference CVC (pp. 147-156). (Advances in Intelligent Systems and Computing; Vol. 944). Springer-Verlag. https://doi.org/10.1007/978-3-030-17798-0_14