FeelTheNews: Augmenting Affective Perceptions of News Videos with Thermal and Vibrotactile Stimulation

Simone Ooms; Minha Lee; Pablo Cesar; Abdallah El Ali

doi:10.1145/3544549.3585638

FeelTheNews: Augmenting Affective Perceptions of News Videos with Thermal and Vibrotactile Stimulation

Simone Ooms, Minha Lee, Pablo Cesar, Abdallah El Ali

Multimedia Computing

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

1 Citation (Scopus)

17 Downloads (Pure)

Abstract

Emotion plays a key role in the emerging wave of immersive, multi-sensory audience news engagement experiences. Since emotions can be triggered by somatosensory feedback, in this work we explore how augmenting news video watching with haptics can influence affective perceptions of news. Using a mixed-methods approach, we design and evaluate FeelTheNews, a prototype that combines vibrotactile and thermal stimulation (Matching, 70Hz/20° C, 200Hz/40° C) during news video watching. In a within-subjects study (N=20), we investigate the effects of haptic stimulation and video valence on perceived valence, emotion intensity, comfort, and overall haptic experiences. Findings showed: (a) news valence and emotion intensity ratings were not affected by haptics, (b) no stimulation was more comfortable than including stimulation, (c) attention and engagement with the news can override haptic sensations, and (d) users' perceived agency over their reactions is critical to avoid distrust. We contribute cautionary insights for haptic augmentation of the news watching experience.

Original language	English
Title of host publication	CHI 2023 - Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
Publisher	Association for Computing Machinery (ACM)
Number of pages	8
ISBN (Electronic)	978-1-4503-9422-2
DOIs	https://doi.org/10.1145/3544549.3585638
Publication status	Published - 2023
Event	2023 CHI Conference on Human Factors in Computing Systems - Congress Center Hamburg (CCH), Hamburg, Germany Duration: 23 Apr 2023 → 28 Apr 2023 https://chi2023.acm.org/

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	2023 CHI Conference on Human Factors in Computing Systems
Abbreviated title	CHI'23
Country/Territory	Germany
City	Hamburg
Period	23/04/23 → 28/04/23
Internet address	https://chi2023.acm.org/

Bibliographical note

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

emotion
haptics
journalism
news
thermal
vibrotactile

Access to Document

10.1145/3544549.3585638

3544549.3585638Final published version, 16.1 MB

Cite this

Ooms, S., Lee, M., Cesar, P., & El Ali, A. (2023). FeelTheNews: Augmenting Affective Perceptions of News Videos with Thermal and Vibrotactile Stimulation. In CHI 2023 - Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems Article 137 (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery (ACM). https://doi.org/10.1145/3544549.3585638

@inproceedings{f4cc736b7a3e4ffc9cd7bd7078c4253c,

title = "FeelTheNews: Augmenting Affective Perceptions of News Videos with Thermal and Vibrotactile Stimulation",

abstract = "Emotion plays a key role in the emerging wave of immersive, multi-sensory audience news engagement experiences. Since emotions can be triggered by somatosensory feedback, in this work we explore how augmenting news video watching with haptics can influence affective perceptions of news. Using a mixed-methods approach, we design and evaluate FeelTheNews, a prototype that combines vibrotactile and thermal stimulation (Matching, 70Hz/20° C, 200Hz/40° C) during news video watching. In a within-subjects study (N=20), we investigate the effects of haptic stimulation and video valence on perceived valence, emotion intensity, comfort, and overall haptic experiences. Findings showed: (a) news valence and emotion intensity ratings were not affected by haptics, (b) no stimulation was more comfortable than including stimulation, (c) attention and engagement with the news can override haptic sensations, and (d) users' perceived agency over their reactions is critical to avoid distrust. We contribute cautionary insights for haptic augmentation of the news watching experience.",

keywords = "emotion, haptics, journalism, news, thermal, vibrotactile",

author = "Simone Ooms and Minha Lee and Pablo Cesar and {El Ali}, Abdallah",

note = "Green Open Access added to TU Delft Institutional Repository {\textquoteleft}You share, we take care!{\textquoteright} – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.; 2023 CHI Conference on Human Factors in Computing Systems, CHI'23 ; Conference date: 23-04-2023 Through 28-04-2023",

year = "2023",

doi = "10.1145/3544549.3585638",

language = "English",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery (ACM)",

booktitle = "CHI 2023 - Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems",

address = "United States",

url = "https://chi2023.acm.org/",

}

Ooms, S, Lee, M, Cesar, P & El Ali, A 2023, FeelTheNews: Augmenting Affective Perceptions of News Videos with Thermal and Vibrotactile Stimulation. in CHI 2023 - Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems., 137, Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery (ACM), 2023 CHI Conference on Human Factors in Computing Systems, Hamburg, Germany, 23/04/23. https://doi.org/10.1145/3544549.3585638

FeelTheNews: Augmenting Affective Perceptions of News Videos with Thermal and Vibrotactile Stimulation. / Ooms, Simone; Lee, Minha; Cesar, Pablo et al.
CHI 2023 - Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery (ACM), 2023. 137 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - FeelTheNews

T2 - 2023 CHI Conference on Human Factors in Computing Systems

AU - Ooms, Simone

AU - Lee, Minha

AU - Cesar, Pablo

AU - El Ali, Abdallah

N1 - Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

PY - 2023

Y1 - 2023

N2 - Emotion plays a key role in the emerging wave of immersive, multi-sensory audience news engagement experiences. Since emotions can be triggered by somatosensory feedback, in this work we explore how augmenting news video watching with haptics can influence affective perceptions of news. Using a mixed-methods approach, we design and evaluate FeelTheNews, a prototype that combines vibrotactile and thermal stimulation (Matching, 70Hz/20° C, 200Hz/40° C) during news video watching. In a within-subjects study (N=20), we investigate the effects of haptic stimulation and video valence on perceived valence, emotion intensity, comfort, and overall haptic experiences. Findings showed: (a) news valence and emotion intensity ratings were not affected by haptics, (b) no stimulation was more comfortable than including stimulation, (c) attention and engagement with the news can override haptic sensations, and (d) users' perceived agency over their reactions is critical to avoid distrust. We contribute cautionary insights for haptic augmentation of the news watching experience.

AB - Emotion plays a key role in the emerging wave of immersive, multi-sensory audience news engagement experiences. Since emotions can be triggered by somatosensory feedback, in this work we explore how augmenting news video watching with haptics can influence affective perceptions of news. Using a mixed-methods approach, we design and evaluate FeelTheNews, a prototype that combines vibrotactile and thermal stimulation (Matching, 70Hz/20° C, 200Hz/40° C) during news video watching. In a within-subjects study (N=20), we investigate the effects of haptic stimulation and video valence on perceived valence, emotion intensity, comfort, and overall haptic experiences. Findings showed: (a) news valence and emotion intensity ratings were not affected by haptics, (b) no stimulation was more comfortable than including stimulation, (c) attention and engagement with the news can override haptic sensations, and (d) users' perceived agency over their reactions is critical to avoid distrust. We contribute cautionary insights for haptic augmentation of the news watching experience.

KW - emotion

KW - haptics

KW - journalism

KW - news

KW - thermal

KW - vibrotactile

UR - http://www.scopus.com/inward/record.url?scp=85153741573&partnerID=8YFLogxK

U2 - 10.1145/3544549.3585638

DO - 10.1145/3544549.3585638

M3 - Conference contribution

AN - SCOPUS:85153741573

T3 - Conference on Human Factors in Computing Systems - Proceedings

BT - CHI 2023 - Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery (ACM)

Y2 - 23 April 2023 through 28 April 2023

ER -

Ooms S, Lee M, Cesar P, El Ali A. FeelTheNews: Augmenting Affective Perceptions of News Videos with Thermal and Vibrotactile Stimulation. In CHI 2023 - Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery (ACM). 2023. 137. (Conference on Human Factors in Computing Systems - Proceedings). doi: 10.1145/3544549.3585638

FeelTheNews: Augmenting Affective Perceptions of News Videos with Thermal and Vibrotactile Stimulation

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this