Robust adaptive dynamic programming for sensorimotor control with signal-dependent noise

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As human beings, we coordinate movements and interact with our environment through sensory information and motor adaptation in our daily lives. Many characteristics of these interactions can be studied using optimization-based models, which assume that the precise knowledge of both the sensorimotor system and its interacting environment is available for the central nervous system (CNS). However, when static and dynamic uncertainties are present, the previously developed optimization models may fail to explain how the CNS can adapt to the uncertainties and still coordinate the movement. In this paper, we attempt to propose a novel computational mechanism for sensorimotor control from a perspective of robust adaptive dynamic programming (RADP). It is suggested that, instead of identifying the system dynamics of both the motor system and the environment, the CNS computes iteratively a robust optimal control policy for movement, using the real-time sensory data. With the help of numerical analysis and simulations, it is observed that the proposed model can reproduce movement trajectories which are consistent with experimental data. Consequently, we conjecture that, in order to achieve successful adaptation, this RADP-type mechanism may be used by the CNS of humans to coordinate movements in the presence of static/dynamic arising in the sensorimotor system.

Original languageEnglish (US)
Title of host publication2013 IEEE Signal Processing in Medicine and Biology Symposium, SPMB 2013
PublisherIEEE Computer Society
ISBN (Print)9781479930074
DOIs
StatePublished - 2013
Event2013 IEEE Signal Processing in Medicine and Biology Symposium, SPMB 2013 - Brooklyn, NY, United States
Duration: Dec 7 2013Dec 7 2013

Other

Other2013 IEEE Signal Processing in Medicine and Biology Symposium, SPMB 2013
CountryUnited States
CityBrooklyn, NY
Period12/7/1312/7/13

Fingerprint

Neurology
Dynamic programming
Numerical analysis
Dynamical systems
Trajectories
Computer simulation
Uncertainty

ASJC Scopus subject areas

  • Biomedical Engineering

Cite this

Jiang, Y., & Jiang, Z-P. (2013). Robust adaptive dynamic programming for sensorimotor control with signal-dependent noise. In 2013 IEEE Signal Processing in Medicine and Biology Symposium, SPMB 2013 [6736781] IEEE Computer Society. https://doi.org/10.1109/SPMB.2013.6736781

Robust adaptive dynamic programming for sensorimotor control with signal-dependent noise. / Jiang, Yu; Jiang, Zhong-Ping.

2013 IEEE Signal Processing in Medicine and Biology Symposium, SPMB 2013. IEEE Computer Society, 2013. 6736781.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Jiang, Y & Jiang, Z-P 2013, Robust adaptive dynamic programming for sensorimotor control with signal-dependent noise. in 2013 IEEE Signal Processing in Medicine and Biology Symposium, SPMB 2013., 6736781, IEEE Computer Society, 2013 IEEE Signal Processing in Medicine and Biology Symposium, SPMB 2013, Brooklyn, NY, United States, 12/7/13. https://doi.org/10.1109/SPMB.2013.6736781
Jiang Y, Jiang Z-P. Robust adaptive dynamic programming for sensorimotor control with signal-dependent noise. In 2013 IEEE Signal Processing in Medicine and Biology Symposium, SPMB 2013. IEEE Computer Society. 2013. 6736781 https://doi.org/10.1109/SPMB.2013.6736781
Jiang, Yu ; Jiang, Zhong-Ping. / Robust adaptive dynamic programming for sensorimotor control with signal-dependent noise. 2013 IEEE Signal Processing in Medicine and Biology Symposium, SPMB 2013. IEEE Computer Society, 2013.
@inproceedings{024317f3adb64ef5b1f3f2c1ecfc24c5,
title = "Robust adaptive dynamic programming for sensorimotor control with signal-dependent noise",
abstract = "As human beings, we coordinate movements and interact with our environment through sensory information and motor adaptation in our daily lives. Many characteristics of these interactions can be studied using optimization-based models, which assume that the precise knowledge of both the sensorimotor system and its interacting environment is available for the central nervous system (CNS). However, when static and dynamic uncertainties are present, the previously developed optimization models may fail to explain how the CNS can adapt to the uncertainties and still coordinate the movement. In this paper, we attempt to propose a novel computational mechanism for sensorimotor control from a perspective of robust adaptive dynamic programming (RADP). It is suggested that, instead of identifying the system dynamics of both the motor system and the environment, the CNS computes iteratively a robust optimal control policy for movement, using the real-time sensory data. With the help of numerical analysis and simulations, it is observed that the proposed model can reproduce movement trajectories which are consistent with experimental data. Consequently, we conjecture that, in order to achieve successful adaptation, this RADP-type mechanism may be used by the CNS of humans to coordinate movements in the presence of static/dynamic arising in the sensorimotor system.",
author = "Yu Jiang and Zhong-Ping Jiang",
year = "2013",
doi = "10.1109/SPMB.2013.6736781",
language = "English (US)",
isbn = "9781479930074",
booktitle = "2013 IEEE Signal Processing in Medicine and Biology Symposium, SPMB 2013",
publisher = "IEEE Computer Society",

}

TY - GEN

T1 - Robust adaptive dynamic programming for sensorimotor control with signal-dependent noise

AU - Jiang, Yu

AU - Jiang, Zhong-Ping

PY - 2013

Y1 - 2013

N2 - As human beings, we coordinate movements and interact with our environment through sensory information and motor adaptation in our daily lives. Many characteristics of these interactions can be studied using optimization-based models, which assume that the precise knowledge of both the sensorimotor system and its interacting environment is available for the central nervous system (CNS). However, when static and dynamic uncertainties are present, the previously developed optimization models may fail to explain how the CNS can adapt to the uncertainties and still coordinate the movement. In this paper, we attempt to propose a novel computational mechanism for sensorimotor control from a perspective of robust adaptive dynamic programming (RADP). It is suggested that, instead of identifying the system dynamics of both the motor system and the environment, the CNS computes iteratively a robust optimal control policy for movement, using the real-time sensory data. With the help of numerical analysis and simulations, it is observed that the proposed model can reproduce movement trajectories which are consistent with experimental data. Consequently, we conjecture that, in order to achieve successful adaptation, this RADP-type mechanism may be used by the CNS of humans to coordinate movements in the presence of static/dynamic arising in the sensorimotor system.

AB - As human beings, we coordinate movements and interact with our environment through sensory information and motor adaptation in our daily lives. Many characteristics of these interactions can be studied using optimization-based models, which assume that the precise knowledge of both the sensorimotor system and its interacting environment is available for the central nervous system (CNS). However, when static and dynamic uncertainties are present, the previously developed optimization models may fail to explain how the CNS can adapt to the uncertainties and still coordinate the movement. In this paper, we attempt to propose a novel computational mechanism for sensorimotor control from a perspective of robust adaptive dynamic programming (RADP). It is suggested that, instead of identifying the system dynamics of both the motor system and the environment, the CNS computes iteratively a robust optimal control policy for movement, using the real-time sensory data. With the help of numerical analysis and simulations, it is observed that the proposed model can reproduce movement trajectories which are consistent with experimental data. Consequently, we conjecture that, in order to achieve successful adaptation, this RADP-type mechanism may be used by the CNS of humans to coordinate movements in the presence of static/dynamic arising in the sensorimotor system.

UR - http://www.scopus.com/inward/record.url?scp=84897695303&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84897695303&partnerID=8YFLogxK

U2 - 10.1109/SPMB.2013.6736781

DO - 10.1109/SPMB.2013.6736781

M3 - Conference contribution

AN - SCOPUS:84897695303

SN - 9781479930074

BT - 2013 IEEE Signal Processing in Medicine and Biology Symposium, SPMB 2013

PB - IEEE Computer Society

ER -