Data Smells in Public Datasets

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

6 Downloads (Pure)

Abstract

The adoption of Artificial Intelligence (AI) in high-stakes domains such as healthcare, wildlife preservation, autonomous driving and criminal justice system calls for a data-centric approach to AI. Data scientists spend the majority of their time studying and wrangling the data, yet tools to aid them with data analysis are lacking. This study identifies the recurrent data quality issues in public datasets. Analogous to code smells, we introduce a novel catalogue of data smells that can be used to indicate early signs of problems or technical debt in machine learning systems. To understand the prevalence of data quality issues in datasets, we analyse 25 public datasets and identify 14 data smells.

Original languageEnglish
Title of host publicationProceedings - 1st International Conference on AI Engineering - Software Engineering for AI, CAIN 2022
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages205-216
Number of pages12
ISBN (Electronic)978-1-4503-9275-4
DOIs
Publication statusPublished - 2022
Event1st International Conference on AI Engineering - Software Engineering for AI, CAIN 2022 - Pittsburgh, United States
Duration: 16 May 202217 May 2022

Publication series

NameProceedings - 1st International Conference on AI Engineering - Software Engineering for AI, CAIN 2022

Conference

Conference1st International Conference on AI Engineering - Software Engineering for AI, CAIN 2022
Country/TerritoryUnited States
CityPittsburgh
Period16/05/2217/05/22

Bibliographical note

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

  • ai engineering
  • code smells
  • data quality
  • data smells

Fingerprint

Dive into the research topics of 'Data Smells in Public Datasets'. Together they form a unique fingerprint.

Cite this