Development of a closed-loop feedback system for real-time control of a high-dimensional brain machine interface

David Putrino, Yan T. Wong, Mariana Vigeral, Bijan Pesaran

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As the field of neural prosthetics advances, Brain Machine Interface (BMI) design requires the development of virtual prostheses that allow decoding algorithms to be tested for efficacy in a time- and cost-efficient manner. Using an x-ray and MRI-guided skeletal reconstruction, and a graphic artist's rendering of an anatomically correct macaque upper limb, we created a virtual avatar capable of independent movement across 27 degrees-of-freedom (DOF). Using a custom software interface, we animated the avatar's movements in real-time using kinematic data acquired from awake, behaving macaque subjects using a 16 camera motion capture system. Using this system, we demonstrate real-time, closed-loop control of up to 27 DOFs in a virtual prosthetic device. Thus, we describe a practical method of testing the efficacy of high-complexity BMI decoding algorithms without the expense of fabricating a physical prosthetic.

Original languageEnglish (US)
Title of host publication2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2012
Pages4567-4570
Number of pages4
DOIs
StatePublished - 2012
Event34th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS 2012 - San Diego, CA, United States
Duration: Aug 28 2012Sep 1 2012

Other

Other34th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS 2012
CountryUnited States
CitySan Diego, CA
Period8/28/129/1/12

Fingerprint

Brain-Computer Interfaces
Computer Systems
Real time control
Macaca
Prosthetics
Brain
Feedback
Biomechanical Phenomena
Upper Extremity
Prostheses and Implants
Decoding
Software
X-Rays
Costs and Cost Analysis
Equipment and Supplies
Magnetic resonance imaging
Kinematics
Cameras
X rays
Testing

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Biomedical Engineering
  • Health Informatics

Cite this

Putrino, D., Wong, Y. T., Vigeral, M., & Pesaran, B. (2012). Development of a closed-loop feedback system for real-time control of a high-dimensional brain machine interface. In 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2012 (pp. 4567-4570). [6346983] https://doi.org/10.1109/EMBC.2012.6346983

Development of a closed-loop feedback system for real-time control of a high-dimensional brain machine interface. / Putrino, David; Wong, Yan T.; Vigeral, Mariana; Pesaran, Bijan.

2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2012. 2012. p. 4567-4570 6346983.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Putrino, D, Wong, YT, Vigeral, M & Pesaran, B 2012, Development of a closed-loop feedback system for real-time control of a high-dimensional brain machine interface. in 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2012., 6346983, pp. 4567-4570, 34th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS 2012, San Diego, CA, United States, 8/28/12. https://doi.org/10.1109/EMBC.2012.6346983
Putrino D, Wong YT, Vigeral M, Pesaran B. Development of a closed-loop feedback system for real-time control of a high-dimensional brain machine interface. In 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2012. 2012. p. 4567-4570. 6346983 https://doi.org/10.1109/EMBC.2012.6346983
Putrino, David ; Wong, Yan T. ; Vigeral, Mariana ; Pesaran, Bijan. / Development of a closed-loop feedback system for real-time control of a high-dimensional brain machine interface. 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2012. 2012. pp. 4567-4570
@inproceedings{fb9a15a9c33d433ebfd5e8b06d55bad7,
title = "Development of a closed-loop feedback system for real-time control of a high-dimensional brain machine interface",
abstract = "As the field of neural prosthetics advances, Brain Machine Interface (BMI) design requires the development of virtual prostheses that allow decoding algorithms to be tested for efficacy in a time- and cost-efficient manner. Using an x-ray and MRI-guided skeletal reconstruction, and a graphic artist's rendering of an anatomically correct macaque upper limb, we created a virtual avatar capable of independent movement across 27 degrees-of-freedom (DOF). Using a custom software interface, we animated the avatar's movements in real-time using kinematic data acquired from awake, behaving macaque subjects using a 16 camera motion capture system. Using this system, we demonstrate real-time, closed-loop control of up to 27 DOFs in a virtual prosthetic device. Thus, we describe a practical method of testing the efficacy of high-complexity BMI decoding algorithms without the expense of fabricating a physical prosthetic.",
author = "David Putrino and Wong, {Yan T.} and Mariana Vigeral and Bijan Pesaran",
year = "2012",
doi = "10.1109/EMBC.2012.6346983",
language = "English (US)",
isbn = "9781424441198",
pages = "4567--4570",
booktitle = "2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2012",

}

TY - GEN

T1 - Development of a closed-loop feedback system for real-time control of a high-dimensional brain machine interface

AU - Putrino, David

AU - Wong, Yan T.

AU - Vigeral, Mariana

AU - Pesaran, Bijan

PY - 2012

Y1 - 2012

N2 - As the field of neural prosthetics advances, Brain Machine Interface (BMI) design requires the development of virtual prostheses that allow decoding algorithms to be tested for efficacy in a time- and cost-efficient manner. Using an x-ray and MRI-guided skeletal reconstruction, and a graphic artist's rendering of an anatomically correct macaque upper limb, we created a virtual avatar capable of independent movement across 27 degrees-of-freedom (DOF). Using a custom software interface, we animated the avatar's movements in real-time using kinematic data acquired from awake, behaving macaque subjects using a 16 camera motion capture system. Using this system, we demonstrate real-time, closed-loop control of up to 27 DOFs in a virtual prosthetic device. Thus, we describe a practical method of testing the efficacy of high-complexity BMI decoding algorithms without the expense of fabricating a physical prosthetic.

AB - As the field of neural prosthetics advances, Brain Machine Interface (BMI) design requires the development of virtual prostheses that allow decoding algorithms to be tested for efficacy in a time- and cost-efficient manner. Using an x-ray and MRI-guided skeletal reconstruction, and a graphic artist's rendering of an anatomically correct macaque upper limb, we created a virtual avatar capable of independent movement across 27 degrees-of-freedom (DOF). Using a custom software interface, we animated the avatar's movements in real-time using kinematic data acquired from awake, behaving macaque subjects using a 16 camera motion capture system. Using this system, we demonstrate real-time, closed-loop control of up to 27 DOFs in a virtual prosthetic device. Thus, we describe a practical method of testing the efficacy of high-complexity BMI decoding algorithms without the expense of fabricating a physical prosthetic.

UR - http://www.scopus.com/inward/record.url?scp=84870812471&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84870812471&partnerID=8YFLogxK

U2 - 10.1109/EMBC.2012.6346983

DO - 10.1109/EMBC.2012.6346983

M3 - Conference contribution

SN - 9781424441198

SP - 4567

EP - 4570

BT - 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2012

ER -