How do you feel? Measuring User-Perceived Value for Rejecting Machine Decisions in Hate Speech Detection

Philippe Lammerts, Philip Lippmann, Yen Chia Hsu, Fabio Casati, Jie Yang

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

30 Downloads (Pure)

Abstract

Hate speech moderation remains a challenging task for social media platforms. Human-AI collaborative systems offer the potential to combine the strengths of humans' reliability and the scalability of machine learning to tackle this issue effectively. While methods for task handover in human-AI collaboration exist that consider the costs of incorrect predictions, insufficient attention has been paid to accurately estimating these costs. In this work, we propose a value-sensitive rejection mechanism that automatically rejects machine decisions for human moderation based on users' value perceptions regarding machine decisions. We conduct a crowdsourced survey study with 160 participants to evaluate their perception of correct and incorrect machine decisions in the domain of hate speech detection, as well as occurrences where the system rejects making a prediction. Here, we introduce Magnitude Estimation, an unbounded scale, as the preferred method for measuring user (dis)agreement with machine decisions. Our results show that Magnitude Estimation can provide a reliable measurement of participants' perception of machine decisions. By integrating user-perceived value into human-AI collaboration, we further show that it can guide us in 1) determining when to accept or reject machine decisions to obtain the optimal total value a model can deliver and 2) selecting better classification models as compared to the more widely used target of model accuracy.

Original languageEnglish
Title of host publicationAIES 2023 - Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society
Place of PublicationNew York
PublisherAssociation for Computing Machinery (ACM)
Pages834-844
Number of pages11
ISBN (Print)979-8-4007-0231-0
DOIs
Publication statusPublished - 2023
Event2023 AAAI / ACM Conference on Artificial Intelligence, Ethics, and Society, AIES 2023 - Montreal, Canada
Duration: 8 Aug 202310 Aug 2023

Conference

Conference2023 AAAI / ACM Conference on Artificial Intelligence, Ethics, and Society, AIES 2023
Country/TerritoryCanada
CityMontreal
Period8/08/2310/08/23

Keywords

  • crowdsourcing
  • hate speech
  • human-in-the-loop
  • machine confidence
  • rejection
  • value-sensitive machine learning

Fingerprint

Dive into the research topics of 'How do you feel? Measuring User-Perceived Value for Rejecting Machine Decisions in Hate Speech Detection'. Together they form a unique fingerprint.

Cite this