Abstract
Hate speech moderation remains a challenging task for social media platforms. Human-AI collaborative systems offer the potential to combine the strengths of humans' reliability and the scalability of machine learning to tackle this issue effectively. While methods for task handover in human-AI collaboration exist that consider the costs of incorrect predictions, insufficient attention has been paid to accurately estimating these costs. In this work, we propose a value-sensitive rejection mechanism that automatically rejects machine decisions for human moderation based on users' value perceptions regarding machine decisions. We conduct a crowdsourced survey study with 160 participants to evaluate their perception of correct and incorrect machine decisions in the domain of hate speech detection, as well as occurrences where the system rejects making a prediction. Here, we introduce Magnitude Estimation, an unbounded scale, as the preferred method for measuring user (dis)agreement with machine decisions. Our results show that Magnitude Estimation can provide a reliable measurement of participants' perception of machine decisions. By integrating user-perceived value into human-AI collaboration, we further show that it can guide us in 1) determining when to accept or reject machine decisions to obtain the optimal total value a model can deliver and 2) selecting better classification models as compared to the more widely used target of model accuracy.
Original language | English |
---|---|
Title of host publication | AIES 2023 - Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society |
Place of Publication | New York |
Publisher | Association for Computing Machinery (ACM) |
Pages | 834-844 |
Number of pages | 11 |
ISBN (Print) | 979-8-4007-0231-0 |
DOIs | |
Publication status | Published - 2023 |
Event | 2023 AAAI / ACM Conference on Artificial Intelligence, Ethics, and Society, AIES 2023 - Montreal, Canada Duration: 8 Aug 2023 → 10 Aug 2023 |
Conference
Conference | 2023 AAAI / ACM Conference on Artificial Intelligence, Ethics, and Society, AIES 2023 |
---|---|
Country/Territory | Canada |
City | Montreal |
Period | 8/08/23 → 10/08/23 |
Keywords
- crowdsourcing
- hate speech
- human-in-the-loop
- machine confidence
- rejection
- value-sensitive machine learning