TY - JOUR
T1 - Integrating Comprehensive Human Oversight in Drone Deployment
T2 - A Conceptual Framework Applied to the Case of Military Surveillance Drones
AU - Verdiesen, E.P.
AU - Aler Tubella, Andrea
AU - Dignum, M.V.
PY - 2021
Y1 - 2021
N2 - Accountability is a value often mentioned in the debate on intelligent systems and their increased pervasiveness in our society. When focusing specifically on autonomous systems, a critical gap emerges: although there is much work on governance and attribution of accountability, there is a significant lack of methods for the operationalisation of accountability within the socio-technical layer of autonomous systems. In the case of autonomous unmanned aerial vehicles- or drones—the critical question of how to maintain accountability as they undertake fully autonomous flights becomes increasingly important as their uses multiply in both the commercial and military fields. In this paper, we aim to fill the operationalisation gap by proposing a socio-technical framework to guarantee human oversight and accountability in drone deployments, showing its enforceability in the real case of military surveillance drones. By keeping a focus on accountability and human oversight as values, we align with the emphasis placed on human responsibility, while requiring a concretisation of what these principles mean for each specific application, connecting them with concrete socio-technical requirements. In addition, by constraining the framework to observable elements of pre- and post-deployment, we do not rely on assumptions made on the internal workings of the drone nor the technical fluency of the operator.
AB - Accountability is a value often mentioned in the debate on intelligent systems and their increased pervasiveness in our society. When focusing specifically on autonomous systems, a critical gap emerges: although there is much work on governance and attribution of accountability, there is a significant lack of methods for the operationalisation of accountability within the socio-technical layer of autonomous systems. In the case of autonomous unmanned aerial vehicles- or drones—the critical question of how to maintain accountability as they undertake fully autonomous flights becomes increasingly important as their uses multiply in both the commercial and military fields. In this paper, we aim to fill the operationalisation gap by proposing a socio-technical framework to guarantee human oversight and accountability in drone deployments, showing its enforceability in the real case of military surveillance drones. By keeping a focus on accountability and human oversight as values, we align with the emphasis placed on human responsibility, while requiring a concretisation of what these principles mean for each specific application, connecting them with concrete socio-technical requirements. In addition, by constraining the framework to observable elements of pre- and post-deployment, we do not rely on assumptions made on the internal workings of the drone nor the technical fluency of the operator.
KW - Accountability
KW - Autonomous systems
KW - Comprehensive human oversight
KW - Responsible AI
KW - Surveillance drones
UR - http://www.scopus.com/inward/record.url?scp=85115795760&partnerID=8YFLogxK
U2 - 10.3390/info12090385
DO - 10.3390/info12090385
M3 - Article
SN - 2078-2489
VL - 12
SP - 1
EP - 13
JO - Information (Switzerland)
JF - Information (Switzerland)
IS - 9
M1 - 385
ER -