Identification of perceived sound quality attributes of 360° audiovisual recordings in VR using a Free Verbalization Method

Marta Olko, Dennis Dembeck, Yun Han Wu, Andrea F. Genovese, Agnieszka Roginska

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recent advances in Virtual Reality (VR) technology have led to fast development of 3D binaural sound rendering methods that work in conjunction with head-tracking technology. As the production of 360° media grows, new subjective experiments that can appropriately evaluate and compare the sound quality of VR production tools are required. In this preliminary study, a Free Verbalization Method is employed to uncover auditory features within 360° audio-video experiences when paired with a 3-degrees-of-freedom head-tracking VR device and binaural sound over headphones. Subjects were first asked to identify perceived differences and similarities between different versions of audiovisual stimuli. In a second stage, subjects developed bipolar scales based on their verbal descriptions obtained previously. The verbal constructs created during the experiment, were then combined by the authors and experts into parent attributes by means of semantical analysis, similar to previous research on sound quality attributes. Analysis of the results indicated that there were three main groups of the sound quality attributes: attributes of sound quality describing the general impression of the 360° sound environment, attributes describing sound in relation to the head movement, and attributes describing audio and video congruency. Overall, the consistency of sound between different positions in 360° environment seems to create the new fundamental aspect of sound evaluation for VR and AR multimedia content.

Original languageEnglish (US)
Title of host publication143rd Audio Engineering Society Convention 2017, AES 2017
PublisherAudio Engineering Society
Pages171-180
Number of pages10
Volume1
ISBN (Electronic)9781510870703
StatePublished - Jan 1 2017
Event143rd Audio Engineering Society Convention 2017, AES 2017 - New York, United States
Duration: Oct 18 2017Oct 20 2017

Other

Other143rd Audio Engineering Society Convention 2017, AES 2017
CountryUnited States
CityNew York
Period10/18/1710/20/17

Fingerprint

virtual reality
Virtual Reality
Virtual reality
recording
Attribute
Acoustic waves
acoustics
head movement
Sound
Headphones
multimedia
Rendering
stimuli
Experiment
Multimedia
degrees of freedom
Experiments
Degree of freedom

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Modeling and Simulation
  • Acoustics and Ultrasonics

Cite this

Olko, M., Dembeck, D., Wu, Y. H., Genovese, A. F., & Roginska, A. (2017). Identification of perceived sound quality attributes of 360° audiovisual recordings in VR using a Free Verbalization Method. In 143rd Audio Engineering Society Convention 2017, AES 2017 (Vol. 1, pp. 171-180). Audio Engineering Society.

Identification of perceived sound quality attributes of 360° audiovisual recordings in VR using a Free Verbalization Method. / Olko, Marta; Dembeck, Dennis; Wu, Yun Han; Genovese, Andrea F.; Roginska, Agnieszka.

143rd Audio Engineering Society Convention 2017, AES 2017. Vol. 1 Audio Engineering Society, 2017. p. 171-180.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Olko, M, Dembeck, D, Wu, YH, Genovese, AF & Roginska, A 2017, Identification of perceived sound quality attributes of 360° audiovisual recordings in VR using a Free Verbalization Method. in 143rd Audio Engineering Society Convention 2017, AES 2017. vol. 1, Audio Engineering Society, pp. 171-180, 143rd Audio Engineering Society Convention 2017, AES 2017, New York, United States, 10/18/17.
Olko M, Dembeck D, Wu YH, Genovese AF, Roginska A. Identification of perceived sound quality attributes of 360° audiovisual recordings in VR using a Free Verbalization Method. In 143rd Audio Engineering Society Convention 2017, AES 2017. Vol. 1. Audio Engineering Society. 2017. p. 171-180
Olko, Marta ; Dembeck, Dennis ; Wu, Yun Han ; Genovese, Andrea F. ; Roginska, Agnieszka. / Identification of perceived sound quality attributes of 360° audiovisual recordings in VR using a Free Verbalization Method. 143rd Audio Engineering Society Convention 2017, AES 2017. Vol. 1 Audio Engineering Society, 2017. pp. 171-180
@inproceedings{d173fdbc0db7449a9ffe3f152ac3d02e,
title = "Identification of perceived sound quality attributes of 360° audiovisual recordings in VR using a Free Verbalization Method",
abstract = "Recent advances in Virtual Reality (VR) technology have led to fast development of 3D binaural sound rendering methods that work in conjunction with head-tracking technology. As the production of 360° media grows, new subjective experiments that can appropriately evaluate and compare the sound quality of VR production tools are required. In this preliminary study, a Free Verbalization Method is employed to uncover auditory features within 360° audio-video experiences when paired with a 3-degrees-of-freedom head-tracking VR device and binaural sound over headphones. Subjects were first asked to identify perceived differences and similarities between different versions of audiovisual stimuli. In a second stage, subjects developed bipolar scales based on their verbal descriptions obtained previously. The verbal constructs created during the experiment, were then combined by the authors and experts into parent attributes by means of semantical analysis, similar to previous research on sound quality attributes. Analysis of the results indicated that there were three main groups of the sound quality attributes: attributes of sound quality describing the general impression of the 360° sound environment, attributes describing sound in relation to the head movement, and attributes describing audio and video congruency. Overall, the consistency of sound between different positions in 360° environment seems to create the new fundamental aspect of sound evaluation for VR and AR multimedia content.",
author = "Marta Olko and Dennis Dembeck and Wu, {Yun Han} and Genovese, {Andrea F.} and Agnieszka Roginska",
year = "2017",
month = "1",
day = "1",
language = "English (US)",
volume = "1",
pages = "171--180",
booktitle = "143rd Audio Engineering Society Convention 2017, AES 2017",
publisher = "Audio Engineering Society",
address = "United States",

}

TY - GEN

T1 - Identification of perceived sound quality attributes of 360° audiovisual recordings in VR using a Free Verbalization Method

AU - Olko, Marta

AU - Dembeck, Dennis

AU - Wu, Yun Han

AU - Genovese, Andrea F.

AU - Roginska, Agnieszka

PY - 2017/1/1

Y1 - 2017/1/1

N2 - Recent advances in Virtual Reality (VR) technology have led to fast development of 3D binaural sound rendering methods that work in conjunction with head-tracking technology. As the production of 360° media grows, new subjective experiments that can appropriately evaluate and compare the sound quality of VR production tools are required. In this preliminary study, a Free Verbalization Method is employed to uncover auditory features within 360° audio-video experiences when paired with a 3-degrees-of-freedom head-tracking VR device and binaural sound over headphones. Subjects were first asked to identify perceived differences and similarities between different versions of audiovisual stimuli. In a second stage, subjects developed bipolar scales based on their verbal descriptions obtained previously. The verbal constructs created during the experiment, were then combined by the authors and experts into parent attributes by means of semantical analysis, similar to previous research on sound quality attributes. Analysis of the results indicated that there were three main groups of the sound quality attributes: attributes of sound quality describing the general impression of the 360° sound environment, attributes describing sound in relation to the head movement, and attributes describing audio and video congruency. Overall, the consistency of sound between different positions in 360° environment seems to create the new fundamental aspect of sound evaluation for VR and AR multimedia content.

AB - Recent advances in Virtual Reality (VR) technology have led to fast development of 3D binaural sound rendering methods that work in conjunction with head-tracking technology. As the production of 360° media grows, new subjective experiments that can appropriately evaluate and compare the sound quality of VR production tools are required. In this preliminary study, a Free Verbalization Method is employed to uncover auditory features within 360° audio-video experiences when paired with a 3-degrees-of-freedom head-tracking VR device and binaural sound over headphones. Subjects were first asked to identify perceived differences and similarities between different versions of audiovisual stimuli. In a second stage, subjects developed bipolar scales based on their verbal descriptions obtained previously. The verbal constructs created during the experiment, were then combined by the authors and experts into parent attributes by means of semantical analysis, similar to previous research on sound quality attributes. Analysis of the results indicated that there were three main groups of the sound quality attributes: attributes of sound quality describing the general impression of the 360° sound environment, attributes describing sound in relation to the head movement, and attributes describing audio and video congruency. Overall, the consistency of sound between different positions in 360° environment seems to create the new fundamental aspect of sound evaluation for VR and AR multimedia content.

UR - http://www.scopus.com/inward/record.url?scp=85059089569&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85059089569&partnerID=8YFLogxK

M3 - Conference contribution

VL - 1

SP - 171

EP - 180

BT - 143rd Audio Engineering Society Convention 2017, AES 2017

PB - Audio Engineering Society

ER -