Multiscale modeling and decoding algorithms for spike-field activity

Han Lin Hsieh, Yan T. Wong, Bijan Pesaran, Maryam M. Shanechi

Research output: Contribution to journalArticle

Abstract

Objective. Behavior is encoded across multiple spatiotemporal scales of brain activity. Modern technology can simultaneously record various scales, from spiking of individual neurons to large neural populations measured with field activity. This capability necessitates developing multiscale modeling and decoding algorithms for spike-field activity, which is challenging because of the fundamental differences in statistical characteristics and time-scales of these signals. Spikes are binary-valued with a millisecond time-scale while fields are continuous-valued with slower time-scales. Approach. We develop a multiscale encoding model, adaptive learning algorithm, and decoder that explicitly incorporate the different statistical profiles and time-scales of spikes and fields. The multiscale model consists of combined point process and Gaussian process likelihood functions. The multiscale filter (MSF) for decoding runs at the millisecond time-scale of spikes while adding information from fields at their slower time-scales. The adaptive algorithm learns all spike-field multiscale model parameters simultaneously, in real time, and at their different time-scales. Main results. We validated the multiscale framework within motor tasks using both closed-loop brain-machine interface (BMI) simulations and non-human primate (NHP) spike and local field potential (LFP) motor cortical activity during a naturalistic 3D reach task. Our closed-loop simulations show that the MSF can add information across scales and that the adaptive MSF can accurately learn all parameters in real time. We also decoded the seven joint angular trajectories of the NHP arm using spike-LFP activity. These data showed that the MSF outperformed single-scale decoding, this improvement was due to the addition of information across scales rather than the dominance of one scale and was largest in the low-information regime, and the improvement was similar regardless of the degree of overlap between spike and LFP channels. Significance. This multiscale framework provides a tool to study encoding across scales and may help enhance future neurotechnologies such as motor BMIs.

Original languageEnglish (US)
Article number016018
JournalJournal of Neural Engineering
Volume16
Issue number1
DOIs
StatePublished - Feb 1 2019

Fingerprint

Decoding
Adaptive algorithms
Brain
Adaptive filters
Learning algorithms
Neurons
Trajectories
Primates
Brain-Computer Interfaces
Likelihood Functions
Motor Activity
Joints
Learning
Technology
Population

Keywords

  • adaptive decoding
  • brain-machine interfaces (BMI)
  • LFP
  • multiscale
  • neural decoding
  • neural encoding
  • spikes

ASJC Scopus subject areas

  • Biomedical Engineering
  • Cellular and Molecular Neuroscience

Cite this

Multiscale modeling and decoding algorithms for spike-field activity. / Hsieh, Han Lin; Wong, Yan T.; Pesaran, Bijan; Shanechi, Maryam M.

In: Journal of Neural Engineering, Vol. 16, No. 1, 016018, 01.02.2019.

Research output: Contribution to journalArticle

Hsieh, Han Lin ; Wong, Yan T. ; Pesaran, Bijan ; Shanechi, Maryam M. / Multiscale modeling and decoding algorithms for spike-field activity. In: Journal of Neural Engineering. 2019 ; Vol. 16, No. 1.
@article{396f38d4d2994d6e9fc487e35c175518,
title = "Multiscale modeling and decoding algorithms for spike-field activity",
abstract = "Objective. Behavior is encoded across multiple spatiotemporal scales of brain activity. Modern technology can simultaneously record various scales, from spiking of individual neurons to large neural populations measured with field activity. This capability necessitates developing multiscale modeling and decoding algorithms for spike-field activity, which is challenging because of the fundamental differences in statistical characteristics and time-scales of these signals. Spikes are binary-valued with a millisecond time-scale while fields are continuous-valued with slower time-scales. Approach. We develop a multiscale encoding model, adaptive learning algorithm, and decoder that explicitly incorporate the different statistical profiles and time-scales of spikes and fields. The multiscale model consists of combined point process and Gaussian process likelihood functions. The multiscale filter (MSF) for decoding runs at the millisecond time-scale of spikes while adding information from fields at their slower time-scales. The adaptive algorithm learns all spike-field multiscale model parameters simultaneously, in real time, and at their different time-scales. Main results. We validated the multiscale framework within motor tasks using both closed-loop brain-machine interface (BMI) simulations and non-human primate (NHP) spike and local field potential (LFP) motor cortical activity during a naturalistic 3D reach task. Our closed-loop simulations show that the MSF can add information across scales and that the adaptive MSF can accurately learn all parameters in real time. We also decoded the seven joint angular trajectories of the NHP arm using spike-LFP activity. These data showed that the MSF outperformed single-scale decoding, this improvement was due to the addition of information across scales rather than the dominance of one scale and was largest in the low-information regime, and the improvement was similar regardless of the degree of overlap between spike and LFP channels. Significance. This multiscale framework provides a tool to study encoding across scales and may help enhance future neurotechnologies such as motor BMIs.",
keywords = "adaptive decoding, brain-machine interfaces (BMI), LFP, multiscale, neural decoding, neural encoding, spikes",
author = "Hsieh, {Han Lin} and Wong, {Yan T.} and Bijan Pesaran and Shanechi, {Maryam M.}",
year = "2019",
month = "2",
day = "1",
doi = "10.1088/1741-2552/aaeb1a",
language = "English (US)",
volume = "16",
journal = "Journal of Neural Engineering",
issn = "1741-2560",
publisher = "IOP Publishing Ltd.",
number = "1",

}

TY - JOUR

T1 - Multiscale modeling and decoding algorithms for spike-field activity

AU - Hsieh, Han Lin

AU - Wong, Yan T.

AU - Pesaran, Bijan

AU - Shanechi, Maryam M.

PY - 2019/2/1

Y1 - 2019/2/1

N2 - Objective. Behavior is encoded across multiple spatiotemporal scales of brain activity. Modern technology can simultaneously record various scales, from spiking of individual neurons to large neural populations measured with field activity. This capability necessitates developing multiscale modeling and decoding algorithms for spike-field activity, which is challenging because of the fundamental differences in statistical characteristics and time-scales of these signals. Spikes are binary-valued with a millisecond time-scale while fields are continuous-valued with slower time-scales. Approach. We develop a multiscale encoding model, adaptive learning algorithm, and decoder that explicitly incorporate the different statistical profiles and time-scales of spikes and fields. The multiscale model consists of combined point process and Gaussian process likelihood functions. The multiscale filter (MSF) for decoding runs at the millisecond time-scale of spikes while adding information from fields at their slower time-scales. The adaptive algorithm learns all spike-field multiscale model parameters simultaneously, in real time, and at their different time-scales. Main results. We validated the multiscale framework within motor tasks using both closed-loop brain-machine interface (BMI) simulations and non-human primate (NHP) spike and local field potential (LFP) motor cortical activity during a naturalistic 3D reach task. Our closed-loop simulations show that the MSF can add information across scales and that the adaptive MSF can accurately learn all parameters in real time. We also decoded the seven joint angular trajectories of the NHP arm using spike-LFP activity. These data showed that the MSF outperformed single-scale decoding, this improvement was due to the addition of information across scales rather than the dominance of one scale and was largest in the low-information regime, and the improvement was similar regardless of the degree of overlap between spike and LFP channels. Significance. This multiscale framework provides a tool to study encoding across scales and may help enhance future neurotechnologies such as motor BMIs.

AB - Objective. Behavior is encoded across multiple spatiotemporal scales of brain activity. Modern technology can simultaneously record various scales, from spiking of individual neurons to large neural populations measured with field activity. This capability necessitates developing multiscale modeling and decoding algorithms for spike-field activity, which is challenging because of the fundamental differences in statistical characteristics and time-scales of these signals. Spikes are binary-valued with a millisecond time-scale while fields are continuous-valued with slower time-scales. Approach. We develop a multiscale encoding model, adaptive learning algorithm, and decoder that explicitly incorporate the different statistical profiles and time-scales of spikes and fields. The multiscale model consists of combined point process and Gaussian process likelihood functions. The multiscale filter (MSF) for decoding runs at the millisecond time-scale of spikes while adding information from fields at their slower time-scales. The adaptive algorithm learns all spike-field multiscale model parameters simultaneously, in real time, and at their different time-scales. Main results. We validated the multiscale framework within motor tasks using both closed-loop brain-machine interface (BMI) simulations and non-human primate (NHP) spike and local field potential (LFP) motor cortical activity during a naturalistic 3D reach task. Our closed-loop simulations show that the MSF can add information across scales and that the adaptive MSF can accurately learn all parameters in real time. We also decoded the seven joint angular trajectories of the NHP arm using spike-LFP activity. These data showed that the MSF outperformed single-scale decoding, this improvement was due to the addition of information across scales rather than the dominance of one scale and was largest in the low-information regime, and the improvement was similar regardless of the degree of overlap between spike and LFP channels. Significance. This multiscale framework provides a tool to study encoding across scales and may help enhance future neurotechnologies such as motor BMIs.

KW - adaptive decoding

KW - brain-machine interfaces (BMI)

KW - LFP

KW - multiscale

KW - neural decoding

KW - neural encoding

KW - spikes

UR - http://www.scopus.com/inward/record.url?scp=85059898872&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85059898872&partnerID=8YFLogxK

U2 - 10.1088/1741-2552/aaeb1a

DO - 10.1088/1741-2552/aaeb1a

M3 - Article

VL - 16

JO - Journal of Neural Engineering

JF - Journal of Neural Engineering

SN - 1741-2560

IS - 1

M1 - 016018

ER -