Acquiring Semantic Knowledge for User Model Updates via Human-Agent Alignment Dialogues: Transcriptions

Dataset

Description

The data is the transcriptions for the focus groups underlying the paper "Acquiring Semantic Knowledge for User Model Updates via Human-Agent Alignment Dialogues: An exploratory focus group study" by Pei-Yu Chen, Myrthe Tielman, Dirk Heylen, Catholijn Jonker, and Birna van Riemsdijk. The goal of this paper is to explore what potential users like or dislike about certain aspects of the dialogues and identify dimensions that are important for designing good alignment dialogues.


Study

We performed an exploratory focus group user study, in which we showed participants six scenarios with different variants of how we envision such alignment dialogues might look like. The scenarios and dialogues are in textual form. After they finished reading, we asked them to discuss and compare the dialogues, and then we moved on to the next scenario and discussion. The process continued until all six scenarios were discussed. For the structure of the discussion, we prepared the following questions to guide the participants:

Which version of the dialogue do you prefer, or which part of which dialogue do you prefer? Why?
Is there a certain part of the dialogue that you particularly like/not like? Why? How would you want to do it instead?
Which dialogue is more ‘intelligent’, as in has more capability in providing support?
Do you feel one dialogue is more supportive than the other?
After which dialogue do you think the agent would be more ‘on the same page’ as you?


Data & analysis

We transcribed the focus group sessions and analyzed the transcriptions using inductive thematic analysis with the addition of triangulation with literature.
Date made available13 Apr 2024
PublisherTU Delft - 4TU.ResearchData
Date of data production2024 -

Cite this