On Head Motion for Recognizing Aggression and Negative Affect during Speaking and Listening

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

31 Downloads (Pure)

Abstract

Affective aggression is a form of aggression characterized by impulsive reactions driven by strong negative emotions. Despite the extensive research in the area of automatic emotion recognition, affective aggression is a phenomenon that has received less attention. This study investigates the use of head motion as a potential indicator of affective aggression and negative affect. It provides an analysis of head movement patterns associated with various levels of aggression, valence, arousal and dominance, and compares behaviors and recognition performance under speaking and listening conditions. The study was conducted on the Negative Affect and Aggression database - a multimodal corpus of dyadic interactions between aggression regulation training actors and non-actors, annotated for levels of aggression, valence, arousal, and dominance. Results demonstrate that head motion features can serve as promising indicators of affect during both speaking and listening. Valence and arousal prediction achieved better performance during speaking, while aggression and dominance were better predicted during listening. Significant increases in the magnitude of pitch angular acceleration were associated with escalation along all four annotated dimensions. Interestingly, higher escalation was accompanied by a significant increase in the total number of movements during speaking, but a significant decrease of the number of movements was observed as escalation increased along listening intervals. These findings are particularly relevant as head motion can be used solely or potentially as a supplementary modality when other modalities such as speech or facial expressions are unavailable or altered.

Original languageEnglish
Title of host publicationICMI 2023 - Proceedings of the 25th International Conference on Multimodal Interaction
PublisherAssociation for Computing Machinery (ACM)
Pages455-464
Number of pages10
ISBN (Electronic)9798400700552
DOIs
Publication statusPublished - 2023
Event25th International Conference on Multimodal Interaction, ICMI 2023 - Paris, France
Duration: 9 Oct 202313 Oct 2023

Publication series

NameACM International Conference Proceeding Series

Conference

Conference25th International Conference on Multimodal Interaction, ICMI 2023
Country/TerritoryFrance
CityParis
Period9/10/2313/10/23

Keywords

  • Affective Aggression
  • Affective Computing
  • Emotion
  • Head Motion
  • NAA database
  • Speaking and Listening Behavior.

Fingerprint

Dive into the research topics of 'On Head Motion for Recognizing Aggression and Negative Affect during Speaking and Listening'. Together they form a unique fingerprint.

Cite this