Perceptual quality assessment of video considering both frame rate and quantization artifacts

Yen Fu Ou, Zhan Ma, Tao Liu, Yao Wang

Research output: Contribution to journalArticle

Abstract

In this paper, we explore the impact of frame rate and quantization on perceptual quality of a video. We propose to use the product of a spatial quality factor that assesses the quality of decoded frames without considering the frame rate effect and a temporal correction factor, which reduces the quality assigned by the first factor according to the actual frame rate. We find that the temporal correction factor follows closely an inverted falling exponential function, whereas the quantization effect on the coded frames can be captured accurately by a sigmoid function of the peak signal-to-noise ratio. The proposed model is analytically simple, with each function requiring only a single content-dependent parameter. The proposed overall metric has been validated using both our subjective test scores as well as those reported by others. For all seven data sets examined, our model yields high Pearson correlation (higher than 0.9) with measured mean opinion score (MOS). We further investigate how to predict parameters of our proposed model using content features derived from the original videos. Using predicted parameters from content features, our model still fits with measured MOS with high correlation.

Original languageEnglish (US)
Article number5604671
Pages (from-to)286-298
Number of pages13
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume21
Issue number3
DOIs
StatePublished - Mar 2011

Fingerprint

Exponential functions
Signal to noise ratio

Keywords

  • Content features
  • frame rate
  • scalable video
  • video quality model

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Media Technology

Cite this

Perceptual quality assessment of video considering both frame rate and quantization artifacts. / Ou, Yen Fu; Ma, Zhan; Liu, Tao; Wang, Yao.

In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 21, No. 3, 5604671, 03.2011, p. 286-298.

Research output: Contribution to journalArticle

@article{61df9f5991bf4c339b52e7834691b9b0,
title = "Perceptual quality assessment of video considering both frame rate and quantization artifacts",
abstract = "In this paper, we explore the impact of frame rate and quantization on perceptual quality of a video. We propose to use the product of a spatial quality factor that assesses the quality of decoded frames without considering the frame rate effect and a temporal correction factor, which reduces the quality assigned by the first factor according to the actual frame rate. We find that the temporal correction factor follows closely an inverted falling exponential function, whereas the quantization effect on the coded frames can be captured accurately by a sigmoid function of the peak signal-to-noise ratio. The proposed model is analytically simple, with each function requiring only a single content-dependent parameter. The proposed overall metric has been validated using both our subjective test scores as well as those reported by others. For all seven data sets examined, our model yields high Pearson correlation (higher than 0.9) with measured mean opinion score (MOS). We further investigate how to predict parameters of our proposed model using content features derived from the original videos. Using predicted parameters from content features, our model still fits with measured MOS with high correlation.",
keywords = "Content features, frame rate, scalable video, video quality model",
author = "Ou, {Yen Fu} and Zhan Ma and Tao Liu and Yao Wang",
year = "2011",
month = "3",
doi = "10.1109/TCSVT.2010.2087833",
language = "English (US)",
volume = "21",
pages = "286--298",
journal = "IEEE Transactions on Circuits and Systems for Video Technology",
issn = "1051-8215",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "3",

}

TY - JOUR

T1 - Perceptual quality assessment of video considering both frame rate and quantization artifacts

AU - Ou, Yen Fu

AU - Ma, Zhan

AU - Liu, Tao

AU - Wang, Yao

PY - 2011/3

Y1 - 2011/3

N2 - In this paper, we explore the impact of frame rate and quantization on perceptual quality of a video. We propose to use the product of a spatial quality factor that assesses the quality of decoded frames without considering the frame rate effect and a temporal correction factor, which reduces the quality assigned by the first factor according to the actual frame rate. We find that the temporal correction factor follows closely an inverted falling exponential function, whereas the quantization effect on the coded frames can be captured accurately by a sigmoid function of the peak signal-to-noise ratio. The proposed model is analytically simple, with each function requiring only a single content-dependent parameter. The proposed overall metric has been validated using both our subjective test scores as well as those reported by others. For all seven data sets examined, our model yields high Pearson correlation (higher than 0.9) with measured mean opinion score (MOS). We further investigate how to predict parameters of our proposed model using content features derived from the original videos. Using predicted parameters from content features, our model still fits with measured MOS with high correlation.

AB - In this paper, we explore the impact of frame rate and quantization on perceptual quality of a video. We propose to use the product of a spatial quality factor that assesses the quality of decoded frames without considering the frame rate effect and a temporal correction factor, which reduces the quality assigned by the first factor according to the actual frame rate. We find that the temporal correction factor follows closely an inverted falling exponential function, whereas the quantization effect on the coded frames can be captured accurately by a sigmoid function of the peak signal-to-noise ratio. The proposed model is analytically simple, with each function requiring only a single content-dependent parameter. The proposed overall metric has been validated using both our subjective test scores as well as those reported by others. For all seven data sets examined, our model yields high Pearson correlation (higher than 0.9) with measured mean opinion score (MOS). We further investigate how to predict parameters of our proposed model using content features derived from the original videos. Using predicted parameters from content features, our model still fits with measured MOS with high correlation.

KW - Content features

KW - frame rate

KW - scalable video

KW - video quality model

UR - http://www.scopus.com/inward/record.url?scp=79953053723&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79953053723&partnerID=8YFLogxK

U2 - 10.1109/TCSVT.2010.2087833

DO - 10.1109/TCSVT.2010.2087833

M3 - Article

AN - SCOPUS:79953053723

VL - 21

SP - 286

EP - 298

JO - IEEE Transactions on Circuits and Systems for Video Technology

JF - IEEE Transactions on Circuits and Systems for Video Technology

SN - 1051-8215

IS - 3

M1 - 5604671

ER -