Supporting Children’s Metacognition with a Facial Emotion Recognition based Intelligent Tutor System

Xingran Ruan*, Charaka Palansuriya, Aurora Constantin, Konstantinos Tsiakas

*Corresponding author for this work

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

16 Downloads (Pure)

Abstract

The present study aims to investigate the relationship between emotions experienced during learning and metacognition in typically developing (TD) children and those with autism spectrum disorder (ASD). This will assist us in using machine learning (ML) to develop a facial emotion recognition (FER) based intelligent tutor system (ITS) to support children’s metacognitive monitoring process in order to enhance their learning outcomes. In this paper, we first report the results of our preliminary research, which utilized an ML-based FER algorithm to detect four spontaneous epistemic emotions (i.e., neutral, confused, frustrated, and boredom) and six spontaneous basic emotions (i.e., anger, disgust, fear, happiness, sadness, and surprise). Subsequently, we adapted an application (‘BrainHood’) to create the ‘Meta-BrainHood’, that embedded our proposed ML-based FER algorithm to examine the relationship between facial emotion expressions and metacognitive monitoring performance in TD children and those with ASD. Finally, we outline the future steps in our research, which adopts the outcomes of the first two steps to construct an ITS to improve children’s metacognitive monitoring performance and learning outcomes.

Original languageEnglish
Title of host publicationProceedings of IDC 2023 - 22nd Annual ACM Interaction Design and Children Conference
Subtitle of host publicationRediscovering Childhood
Place of PublicationNew York
PublisherAssociation for Computing Machinery (ACM)
Pages502-506
Number of pages5
ISBN (Print)979-8-4007-0131-3
DOIs
Publication statusPublished - 2023
Event22nd Annual ACM Interaction Design and Children Conference: Rediscovering Childhood, IDC 2023 - Chicago, United States
Duration: 19 Jun 202322 Jun 2023

Conference

Conference22nd Annual ACM Interaction Design and Children Conference: Rediscovering Childhood, IDC 2023
Country/TerritoryUnited States
CityChicago
Period19/06/2322/06/23

Bibliographical note

Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

  • facial emotion recognition
  • Intelligent tutor system
  • learning outcomes
  • metacognitive monitoring process

Fingerprint

Dive into the research topics of 'Supporting Children’s Metacognition with a Facial Emotion Recognition based Intelligent Tutor System'. Together they form a unique fingerprint.

Cite this