A Two-Tier System for On-Demand Streaming of 360 Degree Video over Dynamic Networks

Liyang Sun, Fanyi Duanmu, Yong Liu, Yao Wang, Yinghua Ye, Hang Shi, David Dai

Research output: Contribution to journalArticle

Abstract

360° video on-demand streaming is a key component of the emerging virtual reality and augmented reality applications. In such applications, sending the entire 360° video demands extremely high network bandwidth that may not be affordable by today's networks. On the other hand, sending only the predicted user's field of view (FoV) is not viable as it is hard to achieve perfect FoV prediction in on-demand streaming, where it is better to prefetch the video multiple seconds ahead, to absorb the network bandwidth fluctuation. This paper proposes a two-tier solution, where the base tier delivers the entire 360° span at a lower quality with a long prefetching buffer, and the enhancement tier delivers the predicted FoV at a higher quality using a short buffer. The base tier provides robustness to both network bandwidth variations and FoV prediction errors. The enhancement tier improves the video quality if it is delivered in time and FoV prediction is accurate. We study the optimal rate allocation between the two tiers and buffer provisioning for the enhancement tier to achieve the optimal trade-off between video quality and streaming robustness. We also design periodic and adaptive optimization frameworks to adapt to the bandwidth variations and FoV prediction errors in realtime. Through simulations driven by real LTE and WiGig network bandwidth traces and user FoV traces, we demonstrate that the proposed two-tier systems can achieve a high-level of quality-of-experience in the face of network bandwidth and user FoV dynamics.

Original languageEnglish (US)
Article number8640123
Pages (from-to)43-57
Number of pages15
JournalIEEE Journal on Emerging and Selected Topics in Circuits and Systems
Volume9
Issue number1
DOIs
StatePublished - Mar 1 2019

Fingerprint

Bandwidth
Video on demand
Augmented reality
Virtual reality

Keywords

  • 360° video
  • on-demand video streaming
  • virtual reality

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

A Two-Tier System for On-Demand Streaming of 360 Degree Video over Dynamic Networks. / Sun, Liyang; Duanmu, Fanyi; Liu, Yong; Wang, Yao; Ye, Yinghua; Shi, Hang; Dai, David.

In: IEEE Journal on Emerging and Selected Topics in Circuits and Systems, Vol. 9, No. 1, 8640123, 01.03.2019, p. 43-57.

Research output: Contribution to journalArticle

@article{c98059e0ee6a4f04b6a703375fbf2e8a,
title = "A Two-Tier System for On-Demand Streaming of 360 Degree Video over Dynamic Networks",
abstract = "360° video on-demand streaming is a key component of the emerging virtual reality and augmented reality applications. In such applications, sending the entire 360° video demands extremely high network bandwidth that may not be affordable by today's networks. On the other hand, sending only the predicted user's field of view (FoV) is not viable as it is hard to achieve perfect FoV prediction in on-demand streaming, where it is better to prefetch the video multiple seconds ahead, to absorb the network bandwidth fluctuation. This paper proposes a two-tier solution, where the base tier delivers the entire 360° span at a lower quality with a long prefetching buffer, and the enhancement tier delivers the predicted FoV at a higher quality using a short buffer. The base tier provides robustness to both network bandwidth variations and FoV prediction errors. The enhancement tier improves the video quality if it is delivered in time and FoV prediction is accurate. We study the optimal rate allocation between the two tiers and buffer provisioning for the enhancement tier to achieve the optimal trade-off between video quality and streaming robustness. We also design periodic and adaptive optimization frameworks to adapt to the bandwidth variations and FoV prediction errors in realtime. Through simulations driven by real LTE and WiGig network bandwidth traces and user FoV traces, we demonstrate that the proposed two-tier systems can achieve a high-level of quality-of-experience in the face of network bandwidth and user FoV dynamics.",
keywords = "360° video, on-demand video streaming, virtual reality",
author = "Liyang Sun and Fanyi Duanmu and Yong Liu and Yao Wang and Yinghua Ye and Hang Shi and David Dai",
year = "2019",
month = "3",
day = "1",
doi = "10.1109/JETCAS.2019.2898877",
language = "English (US)",
volume = "9",
pages = "43--57",
journal = "IEEE Journal on Emerging and Selected Topics in Circuits and Systems",
issn = "2156-3357",
publisher = "IEEE Circuits and Systems Society",
number = "1",

}

TY - JOUR

T1 - A Two-Tier System for On-Demand Streaming of 360 Degree Video over Dynamic Networks

AU - Sun, Liyang

AU - Duanmu, Fanyi

AU - Liu, Yong

AU - Wang, Yao

AU - Ye, Yinghua

AU - Shi, Hang

AU - Dai, David

PY - 2019/3/1

Y1 - 2019/3/1

N2 - 360° video on-demand streaming is a key component of the emerging virtual reality and augmented reality applications. In such applications, sending the entire 360° video demands extremely high network bandwidth that may not be affordable by today's networks. On the other hand, sending only the predicted user's field of view (FoV) is not viable as it is hard to achieve perfect FoV prediction in on-demand streaming, where it is better to prefetch the video multiple seconds ahead, to absorb the network bandwidth fluctuation. This paper proposes a two-tier solution, where the base tier delivers the entire 360° span at a lower quality with a long prefetching buffer, and the enhancement tier delivers the predicted FoV at a higher quality using a short buffer. The base tier provides robustness to both network bandwidth variations and FoV prediction errors. The enhancement tier improves the video quality if it is delivered in time and FoV prediction is accurate. We study the optimal rate allocation between the two tiers and buffer provisioning for the enhancement tier to achieve the optimal trade-off between video quality and streaming robustness. We also design periodic and adaptive optimization frameworks to adapt to the bandwidth variations and FoV prediction errors in realtime. Through simulations driven by real LTE and WiGig network bandwidth traces and user FoV traces, we demonstrate that the proposed two-tier systems can achieve a high-level of quality-of-experience in the face of network bandwidth and user FoV dynamics.

AB - 360° video on-demand streaming is a key component of the emerging virtual reality and augmented reality applications. In such applications, sending the entire 360° video demands extremely high network bandwidth that may not be affordable by today's networks. On the other hand, sending only the predicted user's field of view (FoV) is not viable as it is hard to achieve perfect FoV prediction in on-demand streaming, where it is better to prefetch the video multiple seconds ahead, to absorb the network bandwidth fluctuation. This paper proposes a two-tier solution, where the base tier delivers the entire 360° span at a lower quality with a long prefetching buffer, and the enhancement tier delivers the predicted FoV at a higher quality using a short buffer. The base tier provides robustness to both network bandwidth variations and FoV prediction errors. The enhancement tier improves the video quality if it is delivered in time and FoV prediction is accurate. We study the optimal rate allocation between the two tiers and buffer provisioning for the enhancement tier to achieve the optimal trade-off between video quality and streaming robustness. We also design periodic and adaptive optimization frameworks to adapt to the bandwidth variations and FoV prediction errors in realtime. Through simulations driven by real LTE and WiGig network bandwidth traces and user FoV traces, we demonstrate that the proposed two-tier systems can achieve a high-level of quality-of-experience in the face of network bandwidth and user FoV dynamics.

KW - 360° video

KW - on-demand video streaming

KW - virtual reality

UR - http://www.scopus.com/inward/record.url?scp=85061537736&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85061537736&partnerID=8YFLogxK

U2 - 10.1109/JETCAS.2019.2898877

DO - 10.1109/JETCAS.2019.2898877

M3 - Article

AN - SCOPUS:85061537736

VL - 9

SP - 43

EP - 57

JO - IEEE Journal on Emerging and Selected Topics in Circuits and Systems

JF - IEEE Journal on Emerging and Selected Topics in Circuits and Systems

SN - 2156-3357

IS - 1

M1 - 8640123

ER -