Motion Browser: Visualizing and Understanding Complex Upper Limb Movement under Obstetrical Brachial Plexus Injuries

Gromit Yeuk Yin Chan, Luis Gustavo Nonato, Alice Chu, Preeti Raghavan, Viswanath Aluru, Cláudio T. Silva

Research output: Contribution to journalArticle

Abstract

The brachial plexus is a complex network of peripheral nerves that enables sensing from and control of the movements of the arms and hand. Nowadays, the coordination between the muscles to generate simple movements is still not well understood, hindering the knowledge of how to best treat patients with this type of peripheral nerve injury. To acquire enough information for medical data analysis, physicians conduct motion analysis assessments with patients to produce a rich dataset of electromyographic signals from multiple muscles recorded with joint movements during real-world tasks. However, tools for the analysis and visualization of the data in a succinct and interpretable manner are currently not available. Without the ability to integrate, compare, and compute multiple data sources in one platform, physicians can only compute simple statistical values to describe patient's behavior vaguely, which limits the possibility to answer clinical questions and generate hypotheses for research. To address this challenge, we have developed Motion Browser, an interactive visual analytics system which provides an efficient framework to extract and compare muscle activity patterns from the patient's limbs and coordinated views to help users analyze muscle signals, motion data, and video information to address different tasks. The system was developed as a result of a collaborative endeavor between computer scientists and orthopedic surgery and rehabilitation physicians. We present case studies showing physicians can utilize the information displayed to understand how individuals coordinate their muscles to initiate appropriate treatment and generate new hypotheses for future research.

Original languageEnglish (US)
Article number8809920
Pages (from-to)981-990
Number of pages10
JournalIEEE Transactions on Visualization and Computer Graphics
Volume26
Issue number1
DOIs
StatePublished - Jan 2020

Fingerprint

Muscle
Computer peripheral equipment
Orthopedics
Complex networks
Patient rehabilitation
Surgery
Visualization

Keywords

  • Brachial Plexus Injuries
  • Medical Data Visualization
  • Multimodal Data
  • Time Series Data
  • Visual Analytics Application

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Cite this

Motion Browser : Visualizing and Understanding Complex Upper Limb Movement under Obstetrical Brachial Plexus Injuries. / Chan, Gromit Yeuk Yin; Nonato, Luis Gustavo; Chu, Alice; Raghavan, Preeti; Aluru, Viswanath; Silva, Cláudio T.

In: IEEE Transactions on Visualization and Computer Graphics, Vol. 26, No. 1, 8809920, 01.2020, p. 981-990.

Research output: Contribution to journalArticle

Chan, Gromit Yeuk Yin ; Nonato, Luis Gustavo ; Chu, Alice ; Raghavan, Preeti ; Aluru, Viswanath ; Silva, Cláudio T. / Motion Browser : Visualizing and Understanding Complex Upper Limb Movement under Obstetrical Brachial Plexus Injuries. In: IEEE Transactions on Visualization and Computer Graphics. 2020 ; Vol. 26, No. 1. pp. 981-990.
@article{ac1eea3abc1440158c5ed4f9228cc83b,
title = "Motion Browser: Visualizing and Understanding Complex Upper Limb Movement under Obstetrical Brachial Plexus Injuries",
abstract = "The brachial plexus is a complex network of peripheral nerves that enables sensing from and control of the movements of the arms and hand. Nowadays, the coordination between the muscles to generate simple movements is still not well understood, hindering the knowledge of how to best treat patients with this type of peripheral nerve injury. To acquire enough information for medical data analysis, physicians conduct motion analysis assessments with patients to produce a rich dataset of electromyographic signals from multiple muscles recorded with joint movements during real-world tasks. However, tools for the analysis and visualization of the data in a succinct and interpretable manner are currently not available. Without the ability to integrate, compare, and compute multiple data sources in one platform, physicians can only compute simple statistical values to describe patient's behavior vaguely, which limits the possibility to answer clinical questions and generate hypotheses for research. To address this challenge, we have developed Motion Browser, an interactive visual analytics system which provides an efficient framework to extract and compare muscle activity patterns from the patient's limbs and coordinated views to help users analyze muscle signals, motion data, and video information to address different tasks. The system was developed as a result of a collaborative endeavor between computer scientists and orthopedic surgery and rehabilitation physicians. We present case studies showing physicians can utilize the information displayed to understand how individuals coordinate their muscles to initiate appropriate treatment and generate new hypotheses for future research.",
keywords = "Brachial Plexus Injuries, Medical Data Visualization, Multimodal Data, Time Series Data, Visual Analytics Application",
author = "Chan, {Gromit Yeuk Yin} and Nonato, {Luis Gustavo} and Alice Chu and Preeti Raghavan and Viswanath Aluru and Silva, {Cl{\'a}udio T.}",
year = "2020",
month = "1",
doi = "10.1109/TVCG.2019.2934280",
language = "English (US)",
volume = "26",
pages = "981--990",
journal = "IEEE Transactions on Visualization and Computer Graphics",
issn = "1077-2626",
publisher = "IEEE Computer Society",
number = "1",

}

TY - JOUR

T1 - Motion Browser

T2 - Visualizing and Understanding Complex Upper Limb Movement under Obstetrical Brachial Plexus Injuries

AU - Chan, Gromit Yeuk Yin

AU - Nonato, Luis Gustavo

AU - Chu, Alice

AU - Raghavan, Preeti

AU - Aluru, Viswanath

AU - Silva, Cláudio T.

PY - 2020/1

Y1 - 2020/1

N2 - The brachial plexus is a complex network of peripheral nerves that enables sensing from and control of the movements of the arms and hand. Nowadays, the coordination between the muscles to generate simple movements is still not well understood, hindering the knowledge of how to best treat patients with this type of peripheral nerve injury. To acquire enough information for medical data analysis, physicians conduct motion analysis assessments with patients to produce a rich dataset of electromyographic signals from multiple muscles recorded with joint movements during real-world tasks. However, tools for the analysis and visualization of the data in a succinct and interpretable manner are currently not available. Without the ability to integrate, compare, and compute multiple data sources in one platform, physicians can only compute simple statistical values to describe patient's behavior vaguely, which limits the possibility to answer clinical questions and generate hypotheses for research. To address this challenge, we have developed Motion Browser, an interactive visual analytics system which provides an efficient framework to extract and compare muscle activity patterns from the patient's limbs and coordinated views to help users analyze muscle signals, motion data, and video information to address different tasks. The system was developed as a result of a collaborative endeavor between computer scientists and orthopedic surgery and rehabilitation physicians. We present case studies showing physicians can utilize the information displayed to understand how individuals coordinate their muscles to initiate appropriate treatment and generate new hypotheses for future research.

AB - The brachial plexus is a complex network of peripheral nerves that enables sensing from and control of the movements of the arms and hand. Nowadays, the coordination between the muscles to generate simple movements is still not well understood, hindering the knowledge of how to best treat patients with this type of peripheral nerve injury. To acquire enough information for medical data analysis, physicians conduct motion analysis assessments with patients to produce a rich dataset of electromyographic signals from multiple muscles recorded with joint movements during real-world tasks. However, tools for the analysis and visualization of the data in a succinct and interpretable manner are currently not available. Without the ability to integrate, compare, and compute multiple data sources in one platform, physicians can only compute simple statistical values to describe patient's behavior vaguely, which limits the possibility to answer clinical questions and generate hypotheses for research. To address this challenge, we have developed Motion Browser, an interactive visual analytics system which provides an efficient framework to extract and compare muscle activity patterns from the patient's limbs and coordinated views to help users analyze muscle signals, motion data, and video information to address different tasks. The system was developed as a result of a collaborative endeavor between computer scientists and orthopedic surgery and rehabilitation physicians. We present case studies showing physicians can utilize the information displayed to understand how individuals coordinate their muscles to initiate appropriate treatment and generate new hypotheses for future research.

KW - Brachial Plexus Injuries

KW - Medical Data Visualization

KW - Multimodal Data

KW - Time Series Data

KW - Visual Analytics Application

UR - http://www.scopus.com/inward/record.url?scp=85075621389&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85075621389&partnerID=8YFLogxK

U2 - 10.1109/TVCG.2019.2934280

DO - 10.1109/TVCG.2019.2934280

M3 - Article

AN - SCOPUS:85075621389

VL - 26

SP - 981

EP - 990

JO - IEEE Transactions on Visualization and Computer Graphics

JF - IEEE Transactions on Visualization and Computer Graphics

SN - 1077-2626

IS - 1

M1 - 8809920

ER -