Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot Interaction

Maria Tsfasman; Avinash Saravanan; Dekel Viner; Daan Goslinga; Sarah De Wolf; Chirag Raman; Catholijn M. Jonker; Catharine Oertel

doi:10.1145/3475959.3485394

Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot Interaction

Maria Tsfasman^*, Avinash Saravanan, Dekel Viner, Daan Goslinga, Sarah De Wolf, Chirag Raman, Catholijn M. Jonker, Catharine Oertel

^*Corresponding author for this work

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

3 Citations (Scopus)

94 Downloads (Pure)

Abstract

How human-like do conversational robots need to look to enable long-term human-robot conversation? One essential aspect of long-term interaction is a human's ability to adapt to the varying degrees of a conversational partner's engagement and emotions. Prosodically, this can be achieved through (dis)entrainment. While speech-synthesis has been a limiting factor for many years, restrictions in this regard are increasingly mitigated. These advancements now emphasise the importance of studying the effect of robot embodiment on human entrainment. In this study, we conducted a between-subjects online human-robot interaction experiment in an educational use-case scenario where a tutor was either embodied through a human or a robot face. 43 English-speaking participants took part in the study for whom we analysed the degree of acoustic-prosodic entrainment to the human or robot face, respectively. We found that the degree of subjective and objective perception of anthropomorphism positively correlates with acoustic-prosodic entrainment.

Original language	English
Title of host publication	MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021
Publisher	Association for Computing Machinery (ACM)
Pages	13-18
Number of pages	6
ISBN (Electronic)	978-1-4503-8679-1
DOIs	https://doi.org/10.1145/3475959.3485394
Publication status	Published - 2021
Event	2nd ACM Multimedia Workshop on Multimodal Conversational AI, MuCAI 2021, co-located with ACM MM 2021 - Virtual, Online, China Duration: 24 Oct 2021 → …

Publication series

Name	MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021

Conference

Conference	2nd ACM Multimedia Workshop on Multimodal Conversational AI, MuCAI 2021, co-located with ACM MM 2021
Country/Territory	China
City	Virtual, Online
Period	24/10/21 → …

Keywords

acoustic-prosodic entrainment
human-robot interaction
multi-modal
prosody

Access to Document

10.1145/3475959.3485394

3475959.3485394Final published version, 1.21 MBLicence: CC BY

Cite this

Tsfasman, M., Saravanan, A., Viner, D., Goslinga, D., De Wolf, S., Raman, C., Jonker, C. M., & Oertel, C. (2021). Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot Interaction. In MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021 (pp. 13-18). (MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021). Association for Computing Machinery (ACM). https://doi.org/10.1145/3475959.3485394

Tsfasman, Maria ; Saravanan, Avinash ; Viner, Dekel et al. / Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot Interaction. MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021. Association for Computing Machinery (ACM), 2021. pp. 13-18 (MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021).

@inproceedings{fa7f021c3f314e6390a15954009f3661,

title = "Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot Interaction",

abstract = "How human-like do conversational robots need to look to enable long-term human-robot conversation? One essential aspect of long-term interaction is a human's ability to adapt to the varying degrees of a conversational partner's engagement and emotions. Prosodically, this can be achieved through (dis)entrainment. While speech-synthesis has been a limiting factor for many years, restrictions in this regard are increasingly mitigated. These advancements now emphasise the importance of studying the effect of robot embodiment on human entrainment. In this study, we conducted a between-subjects online human-robot interaction experiment in an educational use-case scenario where a tutor was either embodied through a human or a robot face. 43 English-speaking participants took part in the study for whom we analysed the degree of acoustic-prosodic entrainment to the human or robot face, respectively. We found that the degree of subjective and objective perception of anthropomorphism positively correlates with acoustic-prosodic entrainment. ",

keywords = "acoustic-prosodic entrainment, human-robot interaction, multi-modal, prosody",

author = "Maria Tsfasman and Avinash Saravanan and Dekel Viner and Daan Goslinga and {De Wolf}, Sarah and Chirag Raman and Jonker, {Catholijn M.} and Catharine Oertel",

year = "2021",

doi = "10.1145/3475959.3485394",

language = "English",

series = "MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021",

publisher = "Association for Computing Machinery (ACM)",

pages = "13--18",

booktitle = "MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021",

address = "United States",

note = "2nd ACM Multimedia Workshop on Multimodal Conversational AI, MuCAI 2021, co-located with ACM MM 2021 ; Conference date: 24-10-2021",

}

Tsfasman, M, Saravanan, A, Viner, D, Goslinga, D, De Wolf, S, Raman, C , Jonker, CM & Oertel, C 2021, Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot Interaction. in MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021. MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021, Association for Computing Machinery (ACM), pp. 13-18, 2nd ACM Multimedia Workshop on Multimodal Conversational AI, MuCAI 2021, co-located with ACM MM 2021, Virtual, Online, China, 24/10/21. https://doi.org/10.1145/3475959.3485394

Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot Interaction. / Tsfasman, Maria; Saravanan, Avinash; Viner, Dekel et al.
MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021. Association for Computing Machinery (ACM), 2021. p. 13-18 (MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021).

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot Interaction

AU - Tsfasman, Maria

AU - Saravanan, Avinash

AU - Viner, Dekel

AU - Goslinga, Daan

AU - De Wolf, Sarah

AU - Raman, Chirag

AU - Jonker, Catholijn M.

AU - Oertel, Catharine

PY - 2021

Y1 - 2021

N2 - How human-like do conversational robots need to look to enable long-term human-robot conversation? One essential aspect of long-term interaction is a human's ability to adapt to the varying degrees of a conversational partner's engagement and emotions. Prosodically, this can be achieved through (dis)entrainment. While speech-synthesis has been a limiting factor for many years, restrictions in this regard are increasingly mitigated. These advancements now emphasise the importance of studying the effect of robot embodiment on human entrainment. In this study, we conducted a between-subjects online human-robot interaction experiment in an educational use-case scenario where a tutor was either embodied through a human or a robot face. 43 English-speaking participants took part in the study for whom we analysed the degree of acoustic-prosodic entrainment to the human or robot face, respectively. We found that the degree of subjective and objective perception of anthropomorphism positively correlates with acoustic-prosodic entrainment.

AB - How human-like do conversational robots need to look to enable long-term human-robot conversation? One essential aspect of long-term interaction is a human's ability to adapt to the varying degrees of a conversational partner's engagement and emotions. Prosodically, this can be achieved through (dis)entrainment. While speech-synthesis has been a limiting factor for many years, restrictions in this regard are increasingly mitigated. These advancements now emphasise the importance of studying the effect of robot embodiment on human entrainment. In this study, we conducted a between-subjects online human-robot interaction experiment in an educational use-case scenario where a tutor was either embodied through a human or a robot face. 43 English-speaking participants took part in the study for whom we analysed the degree of acoustic-prosodic entrainment to the human or robot face, respectively. We found that the degree of subjective and objective perception of anthropomorphism positively correlates with acoustic-prosodic entrainment.

KW - acoustic-prosodic entrainment

KW - human-robot interaction

KW - multi-modal

KW - prosody

UR - http://www.scopus.com/inward/record.url?scp=85119377600&partnerID=8YFLogxK

U2 - 10.1145/3475959.3485394

DO - 10.1145/3475959.3485394

M3 - Conference contribution

AN - SCOPUS:85119377600

T3 - MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021

SP - 13

EP - 18

BT - MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021

PB - Association for Computing Machinery (ACM)

T2 - 2nd ACM Multimedia Workshop on Multimodal Conversational AI, MuCAI 2021, co-located with ACM MM 2021

Y2 - 24 October 2021

ER -

Tsfasman M, Saravanan A, Viner D, Goslinga D, De Wolf S, Raman C et al. Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot Interaction. In MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021. Association for Computing Machinery (ACM). 2021. p. 13-18. (MuCAI 2021 - Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021). doi: 10.1145/3475959.3485394

Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot Interaction

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this