NAA: A Multimodal Database of Negative Affect and Aggression

Iulia Lefter, Catholijn M. Jonker, Stephanie Klein Tuente, Wim Veling, Stefan Bogaerts

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

8 Citations (Scopus)


We present the collection and annotation of a multi-modal database with negative human-human interactions. The work is part of supporting behavior recognition in the context of a virtual reality aggression prevention training system. The data consist of dyadic interactions between professional aggression training actors (actors) and naive participants (students). In addition to audio and video, we have recorded motion capture data with kinect, head tracking, and physiological data: heart rate (ECG), galvanic skin response (GSR) and electromyography (EMG) of biceps, triceps and trapezius muscles. Aggression levels, fear, valence, arousal and dominance have been rated separately for actors and students. We observe higher inter-rater agreement for rating the actors than for rating the students, consistently for each annotated dimension, and a higher inter-rater agreement for speaking behavior than for listening behavior. The data can be used among others for research on affect recognition, multimodal fusion and the relation between different bodily manifestation.
Original languageEnglish
Title of host publicationProceedings of International Conference on Affective Computing and Intelligent Interaction (ACII2017)
Place of PublicationPiscataway, NJ
Number of pages7
ISBN (Electronic)978-1-5386-0563-9
Publication statusPublished - 2017
EventACIIW 2017: 7th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos - San Antonio, TX, United States
Duration: 23 Oct 201726 Oct 2017
Conference number: 7


ConferenceACIIW 2017
Country/TerritoryUnited States
CitySan Antonio, TX


  • Training
  • Sensors
  • Databases
  • Forensics
  • Magnetic heads
  • Electromyography
  • Tracking


Dive into the research topics of 'NAA: A Multimodal Database of Negative Affect and Aggression'. Together they form a unique fingerprint.

Cite this