Annotation Tool for Precise Emotion Ground Truth Label Acquisition while Watching 360° VR Videos

Tong Xue, Abdallah El Ali, Gangyi Ding, Pablo Cesar

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

1 Citation (Scopus)
3 Downloads (Pure)

Abstract

We demonstrate an HMD-based annotation tool for collecting precise emotion ground truth labels while users are watching 360° videos in Virtual Reality (VR). Our tool uses an HTC VIVE Pro Eye HMD for displaying 360° videos, a Joy-Con controller for inputting emotion annotations, and an Empatica E4 wristband for capturing physiological signals. Timestamps of these devices are synchronized via an NTP server. Following dimensional emotion models, users can report their emotion in terms of valence and arousal as they watch a video in VR. Annotation feedback is provided through two peripheral visualization techniques: HaloLight and DotSize. Our annotation tool provides a starting point for researchers to design momentary and continuous self-reports in virtual environments to enable fine-grained emotion recognition.

Original languageEnglish
Title of host publicationProceedings - 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2020
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages371-372
Number of pages2
ISBN (Electronic)9781728174631
DOIs
Publication statusPublished - 2020
Event3rd IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2020: MARCH Workshop - Modeling and Animating Realistic Crowds and Humans - Virtual event, Virtual, Utrecht, Netherlands
Duration: 14 Dec 202018 Dec 2020
https://aivr.science.uu.nl/

Publication series

NameProceedings - 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2020

Conference

Conference3rd IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2020
CountryNetherlands
CityVirtual, Utrecht
Period14/12/2018/12/20
Internet address

Keywords

  • 360°video
  • continuous
  • emotion annotation
  • ground truth labels

Fingerprint

Dive into the research topics of 'Annotation Tool for Precise Emotion Ground Truth Label Acquisition while Watching 360° VR Videos'. Together they form a unique fingerprint.

Cite this