A machine learning model can often produce biased outputs for a familiar group or similar sets of classes during inference over an unknown dataset. The generalization of neural networks have been studied to resolve biases, which has also shown improvement in accuracy and performance metrics, such as precision and recall, and refining the dataset's validation set. Data distribution and instances included in test and validation-set play a significant role in improving the generalization of neural networks. For producing an unbiased AI model, it should not only be trained to achieve high accuracy and minimize false positives. The goal should be to prevent the dominance of one class/feature over the other class/feature while calculating weights. This paper investigates state-of-art object detection/classification on AI models using metrics such as selectivity score and cosine similarity. We focus on perception tasks for vehicular edge scenarios, which generally include collaborative tasks and model updates based on weights. The analysis is performed using cases that include the difference in data diversity, the viewpoint of the input class and combinations. Our results show the potential of using cosine similarity, selectivity score and invariance for measuring the training bias, which sheds light on developing unbiased AI models for future vehicular edge services.
|Title of host publication||Proceedings - 2022 IEEE/ACM 7th Symposium on Edge Computing, SEC 2022|
|Number of pages||7|
|Publication status||Published - 2023|
|Event||IEEE/ACM Symposium on Edge Computing (SEC) - Seattle, United States|
Duration: 5 Dec 2022 → 8 Dec 2022
|Name||Proceedings - 2022 IEEE/ACM 7th Symposium on Edge Computing, SEC 2022|
|Conference||IEEE/ACM Symposium on Edge Computing (SEC)|
|Abbreviated title||ACM/IEEE SEC 2022|
|Period||5/12/22 → 8/12/22|
Bibliographical noteGreen Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.