MuSe 2020 Challenge and Workshop: Multimodal Sentiment Analysis, Emotion-target Engagement and Trustworthiness Detection in Real-life Media: Emotional Car Reviews in-the-wild

Lukas Stappen, Alice Baird, Georgios Rizos, Panagiotis Tzirakis, Du Xinchen Du, Felix Hafner, Lea Schumann, Adria Mallol-Ragolta, Iulia Lefter, More Authors

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

30 Citations (Scopus)

Abstract

Multimodal Sentiment Analysis in Real-life Media (MuSe) 2020 is a Challenge-based Workshop focusing on the tasks of sentiment recognition, as well as emotion-target engagement and trustworthiness detection by means of more comprehensively integrating the audio-visual and language modalities. The purpose of MuSe 2020 is to bring together communities from different disciplines; mainly, the audio-visual emotion recognition community (signal-based), and the sentiment analysis community (symbol-based). We present three distinct sub-challenges: MuSe-Wild, which focuses on continuous emotion (arousal and valence) prediction; MuSe-Topic, in which participants recognise 10 domain-specific topics as the target of 3-class (low, medium, high) emotions; and MuSe-Trust, in which the novel aspect of trustworthiness is to be predicted. In this paper, we provide detailed information on MuSe-CAR, the first of its kind in-the-wild database, which is utilised for the challenge, as well as the state-of-the-art features and modelling approaches applied. For each sub-challenge, a competitive baseline for participants is set; namely, on test we report for MuSe-Wild a combined (valence and arousal) CCC of .2568, for MuSe-Topic a score (computed as 0.34∗UAR + 0.66∗F1) of 76.78 % on the 10-class topic and 40.64 % on the 3-class emotion prediction, and for MuSe-Trust a CCC of .4359.

Original languageEnglish
Title of host publicationMuSe 2020 - Proceedings of the 1st International Multimodal Sentiment Analysis in Real-Life Media Challenge and Workshop
PublisherAssociation for Computing Machinery (ACM)
Pages35-44
Number of pages10
ISBN (Electronic)9781450381574
DOIs
Publication statusPublished - 2020
Event1st International Multimodal Sentiment Analysis in Real-Life Media Challenge and Workshop, MuSe 2020 - Virtual, Online, United States
Duration: 16 Oct 2020 → …

Publication series

NameMuSe 2020 - Proceedings of the 1st International Multimodal Sentiment Analysis in Real-Life Media Challenge and Workshop

Conference

Conference1st International Multimodal Sentiment Analysis in Real-Life Media Challenge and Workshop, MuSe 2020
Country/TerritoryUnited States
CityVirtual, Online
Period16/10/20 → …

Keywords

  • affective computing
  • multimodal fusion
  • multimodal sentiment analysis
  • user-generated data

Fingerprint

Dive into the research topics of 'MuSe 2020 Challenge and Workshop: Multimodal Sentiment Analysis, Emotion-target Engagement and Trustworthiness Detection in Real-life Media: Emotional Car Reviews in-the-wild'. Together they form a unique fingerprint.

Cite this