The 19 Unifying Questionnaire Constructs of Artificial Social Agents: An IVA Community Analysis

Siska Fitrianie, Merijn Bruijnes, Deborah Richards, Andrea Bönsch, Willem Paul Brinkman

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

19 Citations (Scopus)
26 Downloads (Pure)

Abstract

In this paper, we report on the multi-year Intelligent Virtual Agents (IVA) community effort, involving more than 80 researchers worldwide, researching the IVA community interests and practises in evaluating human interaction with an artificial social agent (ASA). The effort is driven by previous IVA workshops and plenary IVA discussions related to the methodological crisis on the evaluation of ASAs. A previous literature review showed a continuous practise of creating new questionnaires instead of reusing validated questionnaires. We address this issue by examining questionnaire measurement constructs used in empirical studies between 2013 to 2018 published in the IVA conference. We identified 189 constructs used in 89 questionnaires that are reported across 81 studies. Although these constructs have different names, they often measure the same thing. In this paper, we, therefore, present a unifying set of 19 constructs that captures more than 80% of the 189 constructs initially identified. We established this set in two steps. First, 49 researchers classified the constructs in broad theoretically based categories. Next, 23 researchers grouped the constructs in each category on their similarity. The resulting 19 groups form a unifying set of constructs, which will be the basis for the future questionnaire instrument of human-ASA interaction.

Original languageEnglish
Title of host publicationProceedings of the 20th ACM International Conference on Intelligent Virtual Agents, IVA 2020
PublisherAssociation for Computing Machinery (ACM)
Number of pages8
ISBN (Electronic)9781450375863
DOIs
Publication statusPublished - 2020
Event20th ACM International Conference on Intelligent Virtual Agents, IVA 2020 - Virtual, Online, United Kingdom
Duration: 20 Oct 202022 Oct 2020

Publication series

NameProceedings of the 20th ACM International Conference on Intelligent Virtual Agents, IVA 2020

Conference

Conference20th ACM International Conference on Intelligent Virtual Agents, IVA 2020
Country/TerritoryUnited Kingdom
CityVirtual, Online
Period20/10/2022/10/20

Bibliographical note

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

  • Artificial social agent
  • evaluation instrument
  • measurement construct
  • questionnaire
  • user study

Fingerprint

Dive into the research topics of 'The 19 Unifying Questionnaire Constructs of Artificial Social Agents: An IVA Community Analysis'. Together they form a unique fingerprint.

Cite this