ComPEQ-MR: Compressed Point Cloud Dataset with Eye Tracking and Quality Assessment in Mixed Reality

Minh Nguyen, Shivi Vats, Xuemei Zhou, Irene Viola, Pablo Cesar, Christian Timmerer, Hermann Hellwagner

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

45 Downloads (Pure)

Abstract

Point clouds (PCs) have attracted researchers and developers due to their ability to provide immersive experiences with six degrees of freedom (6DoF). However, there are still several open issues in understanding the Quality of Experience (QoE) and visual attention of end users while experiencing 6DoF volumetric videos. First, encoding and decoding point clouds require a significant amount of both time and computational resources. Second, QoE prediction models for dynamic point clouds in 6DoF have not yet been developed due to the lack of visual quality databases. Third, visual attention in 6DoF is hardly explored, which impedes research into more sophisticated approaches for adaptive streaming of dynamic point clouds. In this work, we provide an open-source Compressed Point cloud dataset with Eye-tracking and Quality assessment in Mixed Reality (ComPEQ - MR). The dataset comprises four compressed dynamic point clouds processed by Moving Picture Experts Group (MPEG) reference tools (i.e., VPCC and GPCC), each with 12 distortion levels. We also conducted subjective tests to assess the quality of the compressed point clouds with different levels of distortion. The rating scores are attached to ComPEQ - MR so that they can be used to develop QoE prediction models in the context of MR environments. Additionally, eye-tracking data for visual saliency is included in this dataset, which is necessary to predict where people look when watching 3D videos in MR experiences. We collected opinion scores and eye-tracking data from 41 participants, resulting in 2132 responses and 164 visual attention maps in total. The dataset is available at https://ftp.itec.aau.at/datasets/ComPEQ-MR/.

Original languageEnglish
Title of host publicationMMSys 2024 - Proceedings of the 2024 ACM Multimedia Systems Conference
PublisherAssociation for Computing Machinery (ACM)
Pages367-373
Number of pages7
ISBN (Electronic)9798400704123
DOIs
Publication statusPublished - 2024
Event15th ACM Multimedia Systems Conference, MMSys 2024 - Bari, Italy
Duration: 15 Apr 202418 Apr 2024

Publication series

NameMMSys 2024 - Proceedings of the 2024 ACM Multimedia Systems Conference

Conference

Conference15th ACM Multimedia Systems Conference, MMSys 2024
Country/TerritoryItaly
CityBari
Period15/04/2418/04/24

Keywords

  • Adaptive Video Streaming
  • Augmented Reality
  • Dataset
  • Metaverse
  • Point Cloud

Fingerprint

Dive into the research topics of 'ComPEQ-MR: Compressed Point Cloud Dataset with Eye Tracking and Quality Assessment in Mixed Reality'. Together they form a unique fingerprint.

Cite this