Bias Detection and Generalization in AI Algorithms on Edge for Autonomous Driving

Dewant Katare, Nicolas Kourtellis, Souneil Park, Diego Perino, Marijn Janssen, Aaron Yi Ding

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

37 Downloads (Pure)

Abstract

A machine learning model can often produce biased outputs for a familiar group or similar sets of classes during inference over an unknown dataset. The generalization of neural networks have been studied to resolve biases, which has also shown improvement in accuracy and performance metrics, such as precision and recall, and refining the dataset's validation set. Data distribution and instances included in test and validation-set play a significant role in improving the generalization of neural networks. For producing an unbiased AI model, it should not only be trained to achieve high accuracy and minimize false positives. The goal should be to prevent the dominance of one class/feature over the other class/feature while calculating weights. This paper investigates state-of-art object detection/classification on AI models using metrics such as selectivity score and cosine similarity. We focus on perception tasks for vehicular edge scenarios, which generally include collaborative tasks and model updates based on weights. The analysis is performed using cases that include the difference in data diversity, the viewpoint of the input class and combinations. Our results show the potential of using cosine similarity, selectivity score and invariance for measuring the training bias, which sheds light on developing unbiased AI models for future vehicular edge services.
Original languageEnglish
Title of host publicationProceedings - 2022 IEEE/ACM 7th Symposium on Edge Computing, SEC 2022
Pages342-348
Number of pages7
ISBN (Electronic)9781665486118
DOIs
Publication statusPublished - 2023
EventIEEE/ACM Symposium on Edge Computing (SEC) - Seattle, United States
Duration: 5 Dec 20228 Dec 2022

Publication series

NameProceedings - 2022 IEEE/ACM 7th Symposium on Edge Computing, SEC 2022

Conference

ConferenceIEEE/ACM Symposium on Edge Computing (SEC)
Abbreviated titleACM/IEEE SEC 2022
Country/TerritoryUnited States
CitySeattle
Period5/12/228/12/22

Bibliographical note

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Fingerprint

Dive into the research topics of 'Bias Detection and Generalization in AI Algorithms on Edge for Autonomous Driving'. Together they form a unique fingerprint.

Cite this