Allocation of moral decision-making in human-agent teams: a pattern approach

Jasper van der Waa*, Jurriaan van Diggelen, Luciano Cavalcante Siebert, Mark Neerincx, Catholijn Jonker

*Corresponding author for this work

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

8 Citations (Scopus)
106 Downloads (Pure)

Abstract

Artificially intelligent agents will deal with more morally sensitive situations as the field of AI progresses. Research efforts are made to regulate, design and build Artificial Moral Agents (AMAs) capable of making moral decisions. This research is highly multidisciplinary with each their own jargon and vision, and so far it is unclear whether a fully autonomous AMA can be achieved. To specify currently available solutions and structure an accessible discussion around them, we propose to apply Team Design Patterns (TDPs). The language of TDPs describe (visually, textually and formally) a dynamic allocation of tasks for moral decision making in a human-agent team context. A task decomposition is proposed on moral decision-making and AMA capabilities to help define such TDPs. Four TDPs are given as examples to illustrate the versatility of the approach. Two problem scenarios (surgical robots and drone surveillance) are used to illustrate these patterns. Finally, we discuss in detail the advantages and disadvantages of a TDP approach to moral decision making.

Original languageEnglish
Title of host publicationEngineering Psychology and Cognitive Ergonomics. Cognition and Design - 17th International Conference, EPCE 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Proceedings
EditorsDon Harris, Wen-Chin Li
PublisherSpringerOpen
Pages203-220
Number of pages18
ISBN (Print)9783030491826
DOIs
Publication statusPublished - 2020
Event17th International Conference on Engineering Psychology and Cognitive Ergonomics, EPCE 2020, held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020 - Copenhagen, Denmark
Duration: 19 Jul 202024 Jul 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12187 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference17th International Conference on Engineering Psychology and Cognitive Ergonomics, EPCE 2020, held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020
Country/TerritoryDenmark
CityCopenhagen
Period19/07/2024/07/20

Bibliographical note

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

  • Dynamic task allocation
  • Human Factors
  • Human-Agent Teaming
  • Machine Ethics
  • Meaningful human control
  • Moral decision-making
  • Team Design Patterns

Fingerprint

Dive into the research topics of 'Allocation of moral decision-making in human-agent teams: a pattern approach'. Together they form a unique fingerprint.

Cite this