Q-STAR: A perceptual video quality model considering impact of spatial, temporal, and amplitude resolutions

Yen Fu Ou, Yuanyi Xue, Yao Wang

Research output: Contribution to journalArticle

Abstract

In this paper, we investigate the impact of spatial, temporal, and amplitude resolution on the perceptual quality of a compressed video. Subjective quality tests were carried out on a mobile device and a total of 189 processed video sequences with 10 source sequences included in the test. Subjective data reveal that the impact of spatial resolution (SR), temporal resolution (TR), and quantization stepsize (QS) can each be captured by a function with a single content-dependent parameter, which indicates the decay rate of the quality with each resolution factor. The joint impact of SR, TR, and QS can be accurately modeled by the product of these three functions with only three parameters. The impact of SR and QS on the quality are independent of that of TR, but there are significant interactions between SR and QS. Furthermore, the model parameters can be predicted accurately from a few content features derived from the original video. The proposed model correlates well with the subjective ratings with a Pearson correlation coefficient of 0.985 when the model parameters are predicted from content features. The quality model is further validated on six other subjective rating data sets with very high accuracy and outperforms several well-known quality models.

Original languageEnglish (US)
Article number6728690
Pages (from-to)2473-2486
Number of pages14
JournalIEEE Transactions on Image Processing
Volume23
Issue number6
DOIs
StatePublished - 2014

Fingerprint

Mobile devices

Keywords

  • frame rate
  • Perceptual video quality
  • quality model
  • quantization
  • scalable video
  • spatial resolution

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Software

Cite this

Q-STAR : A perceptual video quality model considering impact of spatial, temporal, and amplitude resolutions. / Ou, Yen Fu; Xue, Yuanyi; Wang, Yao.

In: IEEE Transactions on Image Processing, Vol. 23, No. 6, 6728690, 2014, p. 2473-2486.

Research output: Contribution to journalArticle

@article{dbbbcf87fc7c4d86a9c0d8b99922092c,
title = "Q-STAR: A perceptual video quality model considering impact of spatial, temporal, and amplitude resolutions",
abstract = "In this paper, we investigate the impact of spatial, temporal, and amplitude resolution on the perceptual quality of a compressed video. Subjective quality tests were carried out on a mobile device and a total of 189 processed video sequences with 10 source sequences included in the test. Subjective data reveal that the impact of spatial resolution (SR), temporal resolution (TR), and quantization stepsize (QS) can each be captured by a function with a single content-dependent parameter, which indicates the decay rate of the quality with each resolution factor. The joint impact of SR, TR, and QS can be accurately modeled by the product of these three functions with only three parameters. The impact of SR and QS on the quality are independent of that of TR, but there are significant interactions between SR and QS. Furthermore, the model parameters can be predicted accurately from a few content features derived from the original video. The proposed model correlates well with the subjective ratings with a Pearson correlation coefficient of 0.985 when the model parameters are predicted from content features. The quality model is further validated on six other subjective rating data sets with very high accuracy and outperforms several well-known quality models.",
keywords = "frame rate, Perceptual video quality, quality model, quantization, scalable video, spatial resolution",
author = "Ou, {Yen Fu} and Yuanyi Xue and Yao Wang",
year = "2014",
doi = "10.1109/TIP.2014.2303636",
language = "English (US)",
volume = "23",
pages = "2473--2486",
journal = "IEEE Transactions on Image Processing",
issn = "1057-7149",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "6",

}

TY - JOUR

T1 - Q-STAR

T2 - A perceptual video quality model considering impact of spatial, temporal, and amplitude resolutions

AU - Ou, Yen Fu

AU - Xue, Yuanyi

AU - Wang, Yao

PY - 2014

Y1 - 2014

N2 - In this paper, we investigate the impact of spatial, temporal, and amplitude resolution on the perceptual quality of a compressed video. Subjective quality tests were carried out on a mobile device and a total of 189 processed video sequences with 10 source sequences included in the test. Subjective data reveal that the impact of spatial resolution (SR), temporal resolution (TR), and quantization stepsize (QS) can each be captured by a function with a single content-dependent parameter, which indicates the decay rate of the quality with each resolution factor. The joint impact of SR, TR, and QS can be accurately modeled by the product of these three functions with only three parameters. The impact of SR and QS on the quality are independent of that of TR, but there are significant interactions between SR and QS. Furthermore, the model parameters can be predicted accurately from a few content features derived from the original video. The proposed model correlates well with the subjective ratings with a Pearson correlation coefficient of 0.985 when the model parameters are predicted from content features. The quality model is further validated on six other subjective rating data sets with very high accuracy and outperforms several well-known quality models.

AB - In this paper, we investigate the impact of spatial, temporal, and amplitude resolution on the perceptual quality of a compressed video. Subjective quality tests were carried out on a mobile device and a total of 189 processed video sequences with 10 source sequences included in the test. Subjective data reveal that the impact of spatial resolution (SR), temporal resolution (TR), and quantization stepsize (QS) can each be captured by a function with a single content-dependent parameter, which indicates the decay rate of the quality with each resolution factor. The joint impact of SR, TR, and QS can be accurately modeled by the product of these three functions with only three parameters. The impact of SR and QS on the quality are independent of that of TR, but there are significant interactions between SR and QS. Furthermore, the model parameters can be predicted accurately from a few content features derived from the original video. The proposed model correlates well with the subjective ratings with a Pearson correlation coefficient of 0.985 when the model parameters are predicted from content features. The quality model is further validated on six other subjective rating data sets with very high accuracy and outperforms several well-known quality models.

KW - frame rate

KW - Perceptual video quality

KW - quality model

KW - quantization

KW - scalable video

KW - spatial resolution

UR - http://www.scopus.com/inward/record.url?scp=84901052777&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84901052777&partnerID=8YFLogxK

U2 - 10.1109/TIP.2014.2303636

DO - 10.1109/TIP.2014.2303636

M3 - Article

AN - SCOPUS:84901052777

VL - 23

SP - 2473

EP - 2486

JO - IEEE Transactions on Image Processing

JF - IEEE Transactions on Image Processing

SN - 1057-7149

IS - 6

M1 - 6728690

ER -