Estimating verbal expressions of task and social cohesion in meetings by quantifying paralinguistic mimicry

Marjolein C. Nanninga, Yanxia Zhang, Nale Lehmann-Willenbrock, Zoltán Szlávik, Hayley Hung

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

8 Citations (Scopus)

Abstract

In this paper we propose a novel method of estimating verbal expressions of task and social cohesion by quantifying the dynamic alignment of nonverbal behaviors in speech. As team cohesion has been linked to team effectiveness and productivity, automatically estimating team cohesion can be a useful tool for assessing meeting quality and broader team functioning. In total, more than 20 hours of business meetings (3-8 people) were recorded and annotated for behavioral indicators of group cohesion, distinguishing between social and task cohesion. We hypothesized that behaviors commonly referred to as mimicry can be indicative of verbal expressions of social and task cohesion. Where most prior work targets mimicry of dyads, we investigated the effectiveness of quantifying group-level phenomena. A dynamic approach was adopted in which both the cohesion expressions and the paralinguistic mimicry were quantified on small time windows. By extracting features solely related to the alignment of paralinguistic speech behavior, we found that 2-minute high and low social cohesive regions could be classified with a 0.71 Area under the ROC curve, performing on par with the state-of-the-art where turn-taking features were used. Estimating task cohesion was more challenging, obtaining an accuracy of 0.64 AUC, outperforming the state-of-the-art. Our results suggest that our proposed methodology is successful in quantifying group-level paralinguistic mimicry. As both the state-of-the-art turn-taking features and mimicry features performed worse on estimating task cohesion, we conclude that social cohesion is more openly expressed by nonverbal vocal behavior than task cohesion
Original languageEnglish
Title of host publicationICMI 2017
Subtitle of host publicationProceedings of the 19th ACM International Conference on Multimodal Interaction
Place of PublicationNew York
PublisherAssociation for Computer Machinery
Pages206-215
Number of pages10
ISBN (Print)978-1-4503-5543-8
DOIs
Publication statusPublished - 2017
EventThe 19th ACM International Conference on Multimodal Interaction: ICMI 2017 - Glasgow, United Kingdom
Duration: 13 Nov 201717 Nov 2017

Conference

ConferenceThe 19th ACM International Conference on Multimodal Interaction
CountryUnited Kingdom
CityGlasgow
Period13/11/1717/11/17

Keywords

  • Cohesion
  • Small group meetings
  • Mimicry
  • Group conversation analysis
  • Social signal processing

Fingerprint Dive into the research topics of 'Estimating verbal expressions of task and social cohesion in meetings by quantifying paralinguistic mimicry'. Together they form a unique fingerprint.

  • Cite this

    Nanninga, M. C., Zhang, Y., Lehmann-Willenbrock, N., Szlávik, Z., & Hung, H. (2017). Estimating verbal expressions of task and social cohesion in meetings by quantifying paralinguistic mimicry. In ICMI 2017: Proceedings of the 19th ACM International Conference on Multimodal Interaction (pp. 206-215). Association for Computer Machinery. https://doi.org/10.1145/3136755.3136811