Contestable Camera Cars: A Speculative Design Exploration of Public AI That Is Open and Responsive to Dispute

Kars Alfrink; A.I. Keller; N. Doorn; G.W. Kortuem

doi:10.1145/3544548.3580984

Contestable Camera Cars: A Speculative Design Exploration of Public AI That Is Open and Responsive to Dispute

Kars Alfrink, A.I. Keller, N. Doorn, G.W. Kortuem

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

1 Citation (Scopus)

84 Downloads (Pure)

Abstract

Local governments increasingly use artificial intelligence (AI) for automated decision-making. Contestability, making systems responsive to dispute, is a way to ensure they respect human rights to autonomy and dignity. We investigate the design of public urban AI systems for contestability through the example of camera cars: human-driven vehicles equipped with image sensors. Applying a provisional framework for contestable AI, we use speculative design to create a concept video of a contestable camera car. Using this concept video, we then conduct semi-structured interviews with 17 civil servants who work with AI employed by a large northwestern European city. The resulting data is analyzed using reflexive thematic analysis to identify the main challenges facing the implementation of contestability in public AI. We describe how civic participation faces issues of representation, public AI systems should integrate with existing democratic practices, and cities must expand capacities for responsible AI development and operation.

Original language	English
Title of host publication	CHI 2023 - Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Publisher	Association for Computing Machinery (ACM)
Number of pages	16
ISBN (Electronic)	978-1-4503-9421-5
DOIs	https://doi.org/10.1145/3544548.3580984
Publication status	Published - 2023
Event	CHI EA '23 - Hamburg, Germany Duration: 23 Apr 2023 → 28 Apr 2023 https://doi.org/10.1145/3544549.3573847

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	CHI EA '23
Country/Territory	Germany
City	Hamburg
Period	23/04/23 → 28/04/23
Internet address	https://doi.org/10.1145/3544549.3573847

Keywords

artifcial intelligence
automated decision-making
camera cars
con- testability
local government
machine learning
public administra- tion
public AI
speculative design
urban AI
urban sensing
vehic- ular urban sensing

Access to Document

10.1145/3544548.3580984

3544548.3580984Final published version, 5.64 MBLicence: CC BY

Cite this

Alfrink, K., Keller, A. I., Doorn, N., & Kortuem, G. W. (2023). Contestable Camera Cars: A Speculative Design Exploration of Public AI That Is Open and Responsive to Dispute. In CHI 2023 - Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems Article 8 (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery (ACM). https://doi.org/10.1145/3544548.3580984

@inproceedings{c18b4fcfe79f4b14aecd1cdf86b23b9a,

title = "Contestable Camera Cars: A Speculative Design Exploration of Public AI That Is Open and Responsive to Dispute",

abstract = "Local governments increasingly use artificial intelligence (AI) for automated decision-making. Contestability, making systems responsive to dispute, is a way to ensure they respect human rights to autonomy and dignity. We investigate the design of public urban AI systems for contestability through the example of camera cars: human-driven vehicles equipped with image sensors. Applying a provisional framework for contestable AI, we use speculative design to create a concept video of a contestable camera car. Using this concept video, we then conduct semi-structured interviews with 17 civil servants who work with AI employed by a large northwestern European city. The resulting data is analyzed using reflexive thematic analysis to identify the main challenges facing the implementation of contestability in public AI. We describe how civic participation faces issues of representation, public AI systems should integrate with existing democratic practices, and cities must expand capacities for responsible AI development and operation.",

keywords = "artifcial intelligence, automated decision-making, camera cars, con- testability, local government, machine learning, public administra- tion, public AI, speculative design, urban AI, urban sensing, vehic- ular urban sensing",

author = "Kars Alfrink and A.I. Keller and N. Doorn and G.W. Kortuem",

year = "2023",

doi = "10.1145/3544548.3580984",

language = "English",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery (ACM)",

booktitle = "CHI 2023 - Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems",

address = "United States",

note = "CHI EA '23 ; Conference date: 23-04-2023 Through 28-04-2023",

url = "https://doi.org/10.1145/3544549.3573847",

}

Alfrink, K , Keller, AI , Doorn, N & Kortuem, GW 2023, Contestable Camera Cars: A Speculative Design Exploration of Public AI That Is Open and Responsive to Dispute. in CHI 2023 - Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems., 8, Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery (ACM), CHI EA '23, Hamburg, Germany, 23/04/23. https://doi.org/10.1145/3544548.3580984

Contestable Camera Cars: A Speculative Design Exploration of Public AI That Is Open and Responsive to Dispute. / Alfrink, Kars ; Keller, A.I.; Doorn, N. et al.
CHI 2023 - Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery (ACM), 2023. 8 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Contestable Camera Cars

T2 - CHI EA '23

AU - Alfrink, Kars

AU - Keller, A.I.

AU - Doorn, N.

AU - Kortuem, G.W.

PY - 2023

Y1 - 2023

N2 - Local governments increasingly use artificial intelligence (AI) for automated decision-making. Contestability, making systems responsive to dispute, is a way to ensure they respect human rights to autonomy and dignity. We investigate the design of public urban AI systems for contestability through the example of camera cars: human-driven vehicles equipped with image sensors. Applying a provisional framework for contestable AI, we use speculative design to create a concept video of a contestable camera car. Using this concept video, we then conduct semi-structured interviews with 17 civil servants who work with AI employed by a large northwestern European city. The resulting data is analyzed using reflexive thematic analysis to identify the main challenges facing the implementation of contestability in public AI. We describe how civic participation faces issues of representation, public AI systems should integrate with existing democratic practices, and cities must expand capacities for responsible AI development and operation.

AB - Local governments increasingly use artificial intelligence (AI) for automated decision-making. Contestability, making systems responsive to dispute, is a way to ensure they respect human rights to autonomy and dignity. We investigate the design of public urban AI systems for contestability through the example of camera cars: human-driven vehicles equipped with image sensors. Applying a provisional framework for contestable AI, we use speculative design to create a concept video of a contestable camera car. Using this concept video, we then conduct semi-structured interviews with 17 civil servants who work with AI employed by a large northwestern European city. The resulting data is analyzed using reflexive thematic analysis to identify the main challenges facing the implementation of contestability in public AI. We describe how civic participation faces issues of representation, public AI systems should integrate with existing democratic practices, and cities must expand capacities for responsible AI development and operation.

KW - artifcial intelligence

KW - automated decision-making

KW - camera cars

KW - con- testability

KW - local government

KW - machine learning

KW - public administra- tion

KW - public AI

KW - speculative design

KW - urban AI

KW - urban sensing

KW - vehic- ular urban sensing

UR - http://www.scopus.com/inward/record.url?scp=85160011720&partnerID=8YFLogxK

U2 - 10.1145/3544548.3580984

DO - 10.1145/3544548.3580984

M3 - Conference contribution

T3 - Conference on Human Factors in Computing Systems - Proceedings

BT - CHI 2023 - Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery (ACM)

Y2 - 23 April 2023 through 28 April 2023

ER -

Alfrink K , Keller AI , Doorn N , Kortuem GW. Contestable Camera Cars: A Speculative Design Exploration of Public AI That Is Open and Responsive to Dispute. In CHI 2023 - Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery (ACM). 2023. 8. (Conference on Human Factors in Computing Systems - Proceedings). doi: 10.1145/3544548.3580984

Contestable Camera Cars: A Speculative Design Exploration of Public AI That Is Open and Responsive to Dispute

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Data Underlying the Publication: Contestable Camera Cars: A Speculative Design Exploration of Public AI That Is Open and Responsive to Dispute

Best Paper

Cite this

Contestable Camera Cars: A Speculative Design Exploration of Public AI That Is Open and Responsive to Dispute

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Datasets

Data Underlying the Publication: Contestable Camera Cars: A Speculative Design Exploration of Public AI That Is Open and Responsive to Dispute

Prizes

Best Paper

Cite this