POTs: Protective Optimization Technologies

Seda Gürses, Bogdan Kulynych, Rebekah Overdorf, Carmela Troncoso

Research output: Contribution to conferencePaperScientificpeer-review

Abstract

Algorithmic fairness aims to address the economic, moral, social, and political impact that digital systems have on populations through solutions that can be applied by service providers. Fairness frameworks do so, in part, by mapping these problems to a narrow definition and assuming the service providers can be trusted to deploy countermeasures. Not surprisingly, these decisions limit fairness frameworks' ability to capture a variety of harms caused by systems.
We characterize fairness limitations using concepts from requirements engineering and from social sciences. We show that the focus on algorithms' inputs and outputs misses harms that arise from systems interacting with the world; that the focus on bias and discrimination omits broader harms on populations and their environments; and that relying on service providers excludes scenarios where they are not cooperative or intentionally adversarial.
We propose Protective Optimization Technologies (POTs). POTs, provide means for affected parties to address the negative impacts of systems in the environment, expanding avenues for political contestation. POTs intervene from outside the system, do not require service providers to cooperate, and can serve to correct, shift, or expose harms that systems impose on populations and their environments. We illustrate the potential and limitations of POTs in two case studies: countering road congestion caused by traffic beating applications, and recalibrating credit scoring for loan applicants.
Original languageEnglish
Pages177-188
Number of pages12
DOIs
Publication statusPublished - 2020
EventACM Conference on Fairness, Accountability and Transparency - Barcelona, Barcelona, Spain
Duration: 28 Jan 202031 Jan 2020
https://facctconference.org

Conference

ConferenceACM Conference on Fairness, Accountability and Transparency
Abbreviated titleACM FAccT
CountrySpain
CityBarcelona
Period28/01/2031/01/20
Internet address

Keywords

  • machine learning
  • fairness
  • optimization
  • Protective Optimization Technologies
  • Fairness and Accountability

Fingerprint Dive into the research topics of 'POTs: Protective Optimization Technologies'. Together they form a unique fingerprint.

  • Cite this

    Gürses, S., Kulynych, B., Overdorf, R., & Troncoso, C. (2020). POTs: Protective Optimization Technologies. 177-188. Paper presented at ACM Conference on Fairness, Accountability and Transparency, Barcelona, Spain. https://doi.org/10.1145/3351095.3372853