Using Perceptual and Cognitive Explanations for Enhanced Human-Agent Team Performance

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

15 Citations (Scopus)

Abstract

Most explainable AI (XAI) research projects focus on well-delineated topics, such as interpretability of machine learning outcomes, knowledge sharing in a multi-agent system or human trust in agent’s performance. For the development of explanations in human-agent teams, a more integrative approach is needed. This paper proposes a perceptual-cognitive explanation (PeCoX) framework for the development of explanations that address both the perceptual and cognitive foundations of an agent’s behavior, distinguishing between explanation generation, communication and reception. It is a generic framework (i.e., the core is domain-agnostic and the perceptual layer is model-agnostic), and being developed and tested in the domains of transport, health-care and defense. The perceptual level entails the provision of an Intuitive Confidence Measure and the identification of the “foil” in a contrastive explanation. The cognitive level entails the selection of the beliefs, goals and emotions for explanations. Ontology Design Patterns are being constructed for the reasoning and communication, whereas Interaction Design Patterns are being constructed for the shaping of the multimodal communication. First results show (1) positive effects on human’s understanding of the perceptual and cognitive foundation of agent’s behavior, and (2) the need for harmonizing the explanations to the context and human’s information processing capabilities.

Original languageEnglish
Title of host publicationEngineering Psychology and Cognitive Ergonomics - 15th International Conference, EPCE 2018, Held as Part of HCI International 2018, Proceedings
EditorsDon Harris
Place of PublicationCham
PublisherSpringer
Pages204-214
Number of pages11
ISBN (Electronic)978-3-319-91122-9
ISBN (Print)978-3-319-91121-2
DOIs
Publication statusPublished - 2018
Event15th International Conference on Engineering Psychology and Cognitive Ergonomics, EPCE 2018 Held as Part of HCI International 2018 - Las Vegas, United States
Duration: 15 Jul 201820 Jul 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10906 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference15th International Conference on Engineering Psychology and Cognitive Ergonomics, EPCE 2018 Held as Part of HCI International 2018
CountryUnited States
CityLas Vegas
Period15/07/1820/07/18

Keywords

  • Cognitive engineering
  • Design patterns
  • Explainable AI
  • Human-agent teamwork
  • Ontologies

Fingerprint Dive into the research topics of 'Using Perceptual and Cognitive Explanations for Enhanced Human-Agent Team Performance'. Together they form a unique fingerprint.

Cite this