Distributed correlated Q-learning for dynamic transmission control of sensor networks

Jane Wei Huang, Quanyan Zhu, Vikram Krishnamurthy, Tamer Basar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper considers a Markovian dynamical game theoretic setting for distributed transmission control in a wireless sensor network. The available spectrum bandwidth is modeled as a Markov chain. A distributed algorithm named correlated Q-learning algorithm is proposed to obtain the correlated equilibrium policies of the system. This algorithm has the decentralized feature and is easily implementable in a real system. Numerical example is also provided to verify the performances of the proposed algorithms.

Original languageEnglish (US)
Title of host publication2010 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010 - Proceedings
Pages1982-1985
Number of pages4
DOIs
StatePublished - 2010
Event2010 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010 - Dallas, TX, United States
Duration: Mar 14 2010Mar 19 2010

Other

Other2010 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010
CountryUnited States
CityDallas, TX
Period3/14/103/19/10

Fingerprint

Sensor networks
Parallel algorithms
Markov processes
Learning algorithms
Wireless sensor networks
Bandwidth

Keywords

  • Distributed algorithms
  • Game theory
  • Multisensor systems
  • Stochastic games

ASJC Scopus subject areas

  • Signal Processing
  • Software
  • Electrical and Electronic Engineering

Cite this

Huang, J. W., Zhu, Q., Krishnamurthy, V., & Basar, T. (2010). Distributed correlated Q-learning for dynamic transmission control of sensor networks. In 2010 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010 - Proceedings (pp. 1982-1985). [5495265] https://doi.org/10.1109/ICASSP.2010.5495265

Distributed correlated Q-learning for dynamic transmission control of sensor networks. / Huang, Jane Wei; Zhu, Quanyan; Krishnamurthy, Vikram; Basar, Tamer.

2010 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010 - Proceedings. 2010. p. 1982-1985 5495265.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Huang, JW, Zhu, Q, Krishnamurthy, V & Basar, T 2010, Distributed correlated Q-learning for dynamic transmission control of sensor networks. in 2010 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010 - Proceedings., 5495265, pp. 1982-1985, 2010 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010, Dallas, TX, United States, 3/14/10. https://doi.org/10.1109/ICASSP.2010.5495265
Huang JW, Zhu Q, Krishnamurthy V, Basar T. Distributed correlated Q-learning for dynamic transmission control of sensor networks. In 2010 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010 - Proceedings. 2010. p. 1982-1985. 5495265 https://doi.org/10.1109/ICASSP.2010.5495265
Huang, Jane Wei ; Zhu, Quanyan ; Krishnamurthy, Vikram ; Basar, Tamer. / Distributed correlated Q-learning for dynamic transmission control of sensor networks. 2010 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010 - Proceedings. 2010. pp. 1982-1985
@inproceedings{65fcbdaff53b45caa9ab4b03d4801d21,
title = "Distributed correlated Q-learning for dynamic transmission control of sensor networks",
abstract = "This paper considers a Markovian dynamical game theoretic setting for distributed transmission control in a wireless sensor network. The available spectrum bandwidth is modeled as a Markov chain. A distributed algorithm named correlated Q-learning algorithm is proposed to obtain the correlated equilibrium policies of the system. This algorithm has the decentralized feature and is easily implementable in a real system. Numerical example is also provided to verify the performances of the proposed algorithms.",
keywords = "Distributed algorithms, Game theory, Multisensor systems, Stochastic games",
author = "Huang, {Jane Wei} and Quanyan Zhu and Vikram Krishnamurthy and Tamer Basar",
year = "2010",
doi = "10.1109/ICASSP.2010.5495265",
language = "English (US)",
isbn = "9781424442966",
pages = "1982--1985",
booktitle = "2010 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010 - Proceedings",

}

TY - GEN

T1 - Distributed correlated Q-learning for dynamic transmission control of sensor networks

AU - Huang, Jane Wei

AU - Zhu, Quanyan

AU - Krishnamurthy, Vikram

AU - Basar, Tamer

PY - 2010

Y1 - 2010

N2 - This paper considers a Markovian dynamical game theoretic setting for distributed transmission control in a wireless sensor network. The available spectrum bandwidth is modeled as a Markov chain. A distributed algorithm named correlated Q-learning algorithm is proposed to obtain the correlated equilibrium policies of the system. This algorithm has the decentralized feature and is easily implementable in a real system. Numerical example is also provided to verify the performances of the proposed algorithms.

AB - This paper considers a Markovian dynamical game theoretic setting for distributed transmission control in a wireless sensor network. The available spectrum bandwidth is modeled as a Markov chain. A distributed algorithm named correlated Q-learning algorithm is proposed to obtain the correlated equilibrium policies of the system. This algorithm has the decentralized feature and is easily implementable in a real system. Numerical example is also provided to verify the performances of the proposed algorithms.

KW - Distributed algorithms

KW - Game theory

KW - Multisensor systems

KW - Stochastic games

UR - http://www.scopus.com/inward/record.url?scp=78049396149&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78049396149&partnerID=8YFLogxK

U2 - 10.1109/ICASSP.2010.5495265

DO - 10.1109/ICASSP.2010.5495265

M3 - Conference contribution

SN - 9781424442966

SP - 1982

EP - 1985

BT - 2010 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010 - Proceedings

ER -