An MDP model for optimal handover decisions in mmWave cellular networks

Marco Mezzavilla, Sanjay Goyal, Shivendra Panwar, Sundeep Rangan, Michele Zorzi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The new frontier in cellular networks is harnessing the enormous spectrum available at millimeter wave (mmWave) frequencies above 28 GHz. The challenging radio propagation characteristics at these frequencies, and the use of highly directional beamforming, lead to intermittent links between the base station (BS) and the user equipment (UE). In this paper, we revisit the problem of cell selection to maintain an acceptable level of service, despite the underlying intermittent link connectivity typical of mmWave links. We propose a Markov Decision Process (MDP) framework to study the properties and performance of our proposed cell selection strategy, which jointly considers several factors such as dynamic channel load and link quality. We use the Value Iteration Algorithm (VIA) to solve the MDP, and obtain the optimal set of associations. We address the multi user problem through a distributed iterative approach, in which each UE characterizes the evolution of the system based on stationary channel distribution and cell selection statistics of other UEs. Through simulation results, we show that our proposed technique makes judicious handoff choices, thereby providing a significant improvement in the overall network capacity. Further, our technique reduces the total number of handoffs, thus lowering the signaling overhead, while providing a higher quality of service to the UEs.

Original languageEnglish (US)
Title of host publicationEUCNC 2016 - European Conference on Networks and Communications
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages100-105
Number of pages6
ISBN (Electronic)9781509028931
DOIs
StatePublished - Sep 6 2016
Event2016 European Conference on Networks and Communications, EUCNC 2016 - Athens, Greece
Duration: Jun 27 2016Jun 30 2016

Other

Other2016 European Conference on Networks and Communications, EUCNC 2016
CountryGreece
CityAthens
Period6/27/166/30/16

Fingerprint

Millimeter waves
Telecommunication links
Radio transmission
Beamforming
Base stations
Quality of service
Statistics

Keywords

  • 5G
  • Cellular
  • Handover
  • MDP
  • mmWave

ASJC Scopus subject areas

  • Computer Networks and Communications

Cite this

Mezzavilla, M., Goyal, S., Panwar, S., Rangan, S., & Zorzi, M. (2016). An MDP model for optimal handover decisions in mmWave cellular networks. In EUCNC 2016 - European Conference on Networks and Communications (pp. 100-105). [7561013] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EuCNC.2016.7561013

An MDP model for optimal handover decisions in mmWave cellular networks. / Mezzavilla, Marco; Goyal, Sanjay; Panwar, Shivendra; Rangan, Sundeep; Zorzi, Michele.

EUCNC 2016 - European Conference on Networks and Communications. Institute of Electrical and Electronics Engineers Inc., 2016. p. 100-105 7561013.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Mezzavilla, M, Goyal, S, Panwar, S, Rangan, S & Zorzi, M 2016, An MDP model for optimal handover decisions in mmWave cellular networks. in EUCNC 2016 - European Conference on Networks and Communications., 7561013, Institute of Electrical and Electronics Engineers Inc., pp. 100-105, 2016 European Conference on Networks and Communications, EUCNC 2016, Athens, Greece, 6/27/16. https://doi.org/10.1109/EuCNC.2016.7561013
Mezzavilla M, Goyal S, Panwar S, Rangan S, Zorzi M. An MDP model for optimal handover decisions in mmWave cellular networks. In EUCNC 2016 - European Conference on Networks and Communications. Institute of Electrical and Electronics Engineers Inc. 2016. p. 100-105. 7561013 https://doi.org/10.1109/EuCNC.2016.7561013
Mezzavilla, Marco ; Goyal, Sanjay ; Panwar, Shivendra ; Rangan, Sundeep ; Zorzi, Michele. / An MDP model for optimal handover decisions in mmWave cellular networks. EUCNC 2016 - European Conference on Networks and Communications. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 100-105
@inproceedings{e9bada9b9e054e9ea9b4ae26b1716e4c,
title = "An MDP model for optimal handover decisions in mmWave cellular networks",
abstract = "The new frontier in cellular networks is harnessing the enormous spectrum available at millimeter wave (mmWave) frequencies above 28 GHz. The challenging radio propagation characteristics at these frequencies, and the use of highly directional beamforming, lead to intermittent links between the base station (BS) and the user equipment (UE). In this paper, we revisit the problem of cell selection to maintain an acceptable level of service, despite the underlying intermittent link connectivity typical of mmWave links. We propose a Markov Decision Process (MDP) framework to study the properties and performance of our proposed cell selection strategy, which jointly considers several factors such as dynamic channel load and link quality. We use the Value Iteration Algorithm (VIA) to solve the MDP, and obtain the optimal set of associations. We address the multi user problem through a distributed iterative approach, in which each UE characterizes the evolution of the system based on stationary channel distribution and cell selection statistics of other UEs. Through simulation results, we show that our proposed technique makes judicious handoff choices, thereby providing a significant improvement in the overall network capacity. Further, our technique reduces the total number of handoffs, thus lowering the signaling overhead, while providing a higher quality of service to the UEs.",
keywords = "5G, Cellular, Handover, MDP, mmWave",
author = "Marco Mezzavilla and Sanjay Goyal and Shivendra Panwar and Sundeep Rangan and Michele Zorzi",
year = "2016",
month = "9",
day = "6",
doi = "10.1109/EuCNC.2016.7561013",
language = "English (US)",
pages = "100--105",
booktitle = "EUCNC 2016 - European Conference on Networks and Communications",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

TY - GEN

T1 - An MDP model for optimal handover decisions in mmWave cellular networks

AU - Mezzavilla, Marco

AU - Goyal, Sanjay

AU - Panwar, Shivendra

AU - Rangan, Sundeep

AU - Zorzi, Michele

PY - 2016/9/6

Y1 - 2016/9/6

N2 - The new frontier in cellular networks is harnessing the enormous spectrum available at millimeter wave (mmWave) frequencies above 28 GHz. The challenging radio propagation characteristics at these frequencies, and the use of highly directional beamforming, lead to intermittent links between the base station (BS) and the user equipment (UE). In this paper, we revisit the problem of cell selection to maintain an acceptable level of service, despite the underlying intermittent link connectivity typical of mmWave links. We propose a Markov Decision Process (MDP) framework to study the properties and performance of our proposed cell selection strategy, which jointly considers several factors such as dynamic channel load and link quality. We use the Value Iteration Algorithm (VIA) to solve the MDP, and obtain the optimal set of associations. We address the multi user problem through a distributed iterative approach, in which each UE characterizes the evolution of the system based on stationary channel distribution and cell selection statistics of other UEs. Through simulation results, we show that our proposed technique makes judicious handoff choices, thereby providing a significant improvement in the overall network capacity. Further, our technique reduces the total number of handoffs, thus lowering the signaling overhead, while providing a higher quality of service to the UEs.

AB - The new frontier in cellular networks is harnessing the enormous spectrum available at millimeter wave (mmWave) frequencies above 28 GHz. The challenging radio propagation characteristics at these frequencies, and the use of highly directional beamforming, lead to intermittent links between the base station (BS) and the user equipment (UE). In this paper, we revisit the problem of cell selection to maintain an acceptable level of service, despite the underlying intermittent link connectivity typical of mmWave links. We propose a Markov Decision Process (MDP) framework to study the properties and performance of our proposed cell selection strategy, which jointly considers several factors such as dynamic channel load and link quality. We use the Value Iteration Algorithm (VIA) to solve the MDP, and obtain the optimal set of associations. We address the multi user problem through a distributed iterative approach, in which each UE characterizes the evolution of the system based on stationary channel distribution and cell selection statistics of other UEs. Through simulation results, we show that our proposed technique makes judicious handoff choices, thereby providing a significant improvement in the overall network capacity. Further, our technique reduces the total number of handoffs, thus lowering the signaling overhead, while providing a higher quality of service to the UEs.

KW - 5G

KW - Cellular

KW - Handover

KW - MDP

KW - mmWave

UR - http://www.scopus.com/inward/record.url?scp=84988946104&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84988946104&partnerID=8YFLogxK

U2 - 10.1109/EuCNC.2016.7561013

DO - 10.1109/EuCNC.2016.7561013

M3 - Conference contribution

SP - 100

EP - 105

BT - EUCNC 2016 - European Conference on Networks and Communications

PB - Institute of Electrical and Electronics Engineers Inc.

ER -