Designing Real-time, Continuous QoE Score Acquisition Techniques for HMD-based 360°VR Video Watching

Tong Xue; Abdallah El Ali; Irene Viola; Gangyi Ding; Pablo Cesar

doi:10.1109/QoMEX55416.2022.9900914

Designing Real-time, Continuous QoE Score Acquisition Techniques for HMD-based 360°VR Video Watching

Tong Xue, Abdallah El Ali, Irene Viola, Gangyi Ding, Pablo Cesar

Multimedia Computing

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

1 Citation (Scopus)

13 Downloads (Pure)

Abstract

Watching HMD-based 360° video has become in-creasing popular as a medium for immersive viewing of photo-realistic content. To evaluate subjective video quality, researchers typically prompt users to provide an overall Quality of Experience (QoE) score after viewing a stimulus. However, since users can adjust their viewport throughout a 360° video, a higher level of spatiotemporal granularity is needed for adaptive 360° video streaming. To address this, we design several real-time, continuous QoE annotation input and peripheral visualization techniques, with the goal of minimizing mental workload and distraction during score acquisition. Drawing on two parallel co-design sessions with seven experts, we find that touchpad and joystick are most suitable for continuous input, with DotMorph (circle with tick label that varies in filling) for peripheral state feedback. We contribute design findings for testing QoE score acquisition techniques during HMD-based 360° video watching, which enable more precise optimization of adaptive video streaming quality.

Original language	English
Title of host publication	Proceedings of the 2022 14th International Conference on Quality of Multimedia Experience (QoMEX)
Place of Publication	Danvers
Publisher	IEEE
Pages	1-6
Number of pages	6
ISBN (Electronic)	978-1-6654-8794-8
ISBN (Print)	978-1-6654-8795-5
DOIs	https://doi.org/10.1109/QoMEX55416.2022.9900914
Publication status	Published - 2022
Event	2022 14th International Conference on Quality of Multimedia Experience (QoMEX) - Lippstadt, Germany Duration: 5 Sept 2022 → 7 Sept 2022 Conference number: 14th

Publication series

Name	2022 14th International Conference on Quality of Multimedia Experience, QoMEX 2022

Conference

Conference	2022 14th International Conference on Quality of Multimedia Experience (QoMEX)
Country/Territory	Germany
City	Lippstadt
Period	5/09/22 → 7/09/22

Bibliographical note

Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

Quality of Experience
360° video
real-time
continuous
acquisition
peripheral visualization

Access to Document

10.1109/QoMEX55416.2022.9900914

Designing_Real-time_Continuous_QoE_Score_Acquisition_Techniques_for_HMD-based_360VR_Video_WatchingFinal published version, 2.18 MB

Cite this

Xue, T., El Ali, A., Viola, I., Ding, G., & Cesar, P. (2022). Designing Real-time, Continuous QoE Score Acquisition Techniques for HMD-based 360°VR Video Watching. In Proceedings of the 2022 14th International Conference on Quality of Multimedia Experience (QoMEX) (pp. 1-6). (2022 14th International Conference on Quality of Multimedia Experience, QoMEX 2022). IEEE. https://doi.org/10.1109/QoMEX55416.2022.9900914

Xue, Tong ; El Ali, Abdallah ; Viola, Irene et al. / Designing Real-time, Continuous QoE Score Acquisition Techniques for HMD-based 360°VR Video Watching. Proceedings of the 2022 14th International Conference on Quality of Multimedia Experience (QoMEX). Danvers : IEEE, 2022. pp. 1-6 (2022 14th International Conference on Quality of Multimedia Experience, QoMEX 2022).

@inproceedings{dc30e31f0ef2424d879e57182b2e40bd,

title = "Designing Real-time, Continuous QoE Score Acquisition Techniques for HMD-based 360°VR Video Watching",

abstract = "Watching HMD-based 360° video has become in-creasing popular as a medium for immersive viewing of photo-realistic content. To evaluate subjective video quality, researchers typically prompt users to provide an overall Quality of Experience (QoE) score after viewing a stimulus. However, since users can adjust their viewport throughout a 360° video, a higher level of spatiotemporal granularity is needed for adaptive 360° video streaming. To address this, we design several real-time, continuous QoE annotation input and peripheral visualization techniques, with the goal of minimizing mental workload and distraction during score acquisition. Drawing on two parallel co-design sessions with seven experts, we find that touchpad and joystick are most suitable for continuous input, with DotMorph (circle with tick label that varies in filling) for peripheral state feedback. We contribute design findings for testing QoE score acquisition techniques during HMD-based 360° video watching, which enable more precise optimization of adaptive video streaming quality.",

keywords = "Quality of Experience, 360° video, real-time, continuous, acquisition, peripheral visualization",

author = "Tong Xue and {El Ali}, Abdallah and Irene Viola and Gangyi Ding and Pablo Cesar",

note = "Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.; 2022 14th International Conference on Quality of Multimedia Experience (QoMEX)<br/> ; Conference date: 05-09-2022 Through 07-09-2022",

year = "2022",

doi = "10.1109/QoMEX55416.2022.9900914",

language = "English",

isbn = "978-1-6654-8795-5",

series = "2022 14th International Conference on Quality of Multimedia Experience, QoMEX 2022",

publisher = "IEEE",

pages = "1--6",

booktitle = "Proceedings of the 2022 14th International Conference on Quality of Multimedia Experience (QoMEX)",

address = "United States",

}

Xue, T, El Ali, A, Viola, I, Ding, G & Cesar, P 2022, Designing Real-time, Continuous QoE Score Acquisition Techniques for HMD-based 360°VR Video Watching. in Proceedings of the 2022 14th International Conference on Quality of Multimedia Experience (QoMEX). 2022 14th International Conference on Quality of Multimedia Experience, QoMEX 2022, IEEE, Danvers, pp. 1-6, 2022 14th International Conference on Quality of Multimedia Experience (QoMEX)
, Lippstadt, Germany, 5/09/22. https://doi.org/10.1109/QoMEX55416.2022.9900914

Designing Real-time, Continuous QoE Score Acquisition Techniques for HMD-based 360°VR Video Watching. / Xue, Tong; El Ali, Abdallah; Viola, Irene et al.
Proceedings of the 2022 14th International Conference on Quality of Multimedia Experience (QoMEX). Danvers: IEEE, 2022. p. 1-6 (2022 14th International Conference on Quality of Multimedia Experience, QoMEX 2022).

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Designing Real-time, Continuous QoE Score Acquisition Techniques for HMD-based 360°VR Video Watching

AU - Xue, Tong

AU - El Ali, Abdallah

AU - Viola, Irene

AU - Ding, Gangyi

AU - Cesar, Pablo

N1 - Conference code: 14th

PY - 2022

Y1 - 2022

N2 - Watching HMD-based 360° video has become in-creasing popular as a medium for immersive viewing of photo-realistic content. To evaluate subjective video quality, researchers typically prompt users to provide an overall Quality of Experience (QoE) score after viewing a stimulus. However, since users can adjust their viewport throughout a 360° video, a higher level of spatiotemporal granularity is needed for adaptive 360° video streaming. To address this, we design several real-time, continuous QoE annotation input and peripheral visualization techniques, with the goal of minimizing mental workload and distraction during score acquisition. Drawing on two parallel co-design sessions with seven experts, we find that touchpad and joystick are most suitable for continuous input, with DotMorph (circle with tick label that varies in filling) for peripheral state feedback. We contribute design findings for testing QoE score acquisition techniques during HMD-based 360° video watching, which enable more precise optimization of adaptive video streaming quality.

AB - Watching HMD-based 360° video has become in-creasing popular as a medium for immersive viewing of photo-realistic content. To evaluate subjective video quality, researchers typically prompt users to provide an overall Quality of Experience (QoE) score after viewing a stimulus. However, since users can adjust their viewport throughout a 360° video, a higher level of spatiotemporal granularity is needed for adaptive 360° video streaming. To address this, we design several real-time, continuous QoE annotation input and peripheral visualization techniques, with the goal of minimizing mental workload and distraction during score acquisition. Drawing on two parallel co-design sessions with seven experts, we find that touchpad and joystick are most suitable for continuous input, with DotMorph (circle with tick label that varies in filling) for peripheral state feedback. We contribute design findings for testing QoE score acquisition techniques during HMD-based 360° video watching, which enable more precise optimization of adaptive video streaming quality.

KW - Quality of Experience

KW - 360° video

KW - real-time

KW - continuous

KW - acquisition

KW - peripheral visualization

UR - http://www.scopus.com/inward/record.url?scp=85141709414&partnerID=8YFLogxK

U2 - 10.1109/QoMEX55416.2022.9900914

DO - 10.1109/QoMEX55416.2022.9900914

M3 - Conference contribution

SN - 978-1-6654-8795-5

T3 - 2022 14th International Conference on Quality of Multimedia Experience, QoMEX 2022

SP - 1

EP - 6

BT - Proceedings of the 2022 14th International Conference on Quality of Multimedia Experience (QoMEX)

PB - IEEE

CY - Danvers

T2 - 2022 14th International Conference on Quality of Multimedia Experience (QoMEX)<br/>

Y2 - 5 September 2022 through 7 September 2022

ER -

Xue T, El Ali A, Viola I, Ding G, Cesar P. Designing Real-time, Continuous QoE Score Acquisition Techniques for HMD-based 360°VR Video Watching. In Proceedings of the 2022 14th International Conference on Quality of Multimedia Experience (QoMEX). Danvers: IEEE. 2022. p. 1-6. (2022 14th International Conference on Quality of Multimedia Experience, QoMEX 2022). doi: 10.1109/QoMEX55416.2022.9900914

Designing Real-time, Continuous QoE Score Acquisition Techniques for HMD-based 360°VR Video Watching

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this