Massively Parallel, Highly Efficient, but What about the Test Suite Quality? Applying Mutation Testing to GPU Programs

Qianqian Zhu, Andy Zaidman

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

2 Downloads (Pure)

Abstract

Thanks to rapid advances in programmability and performance, GPUs have been widely applied in High Performance Computing (HPC) and safety-critical domains. As such, quality assurance of GPU applications has gained increasing attention. This brings us to mutation testing, a fault-based testing technique that assesses the test suite quality by systematically introducing small artificial faults. It has been shown to perform well in exposing faults. In this paper, we investigate whether GPU programming can benefit from mutation testing. In addition to conventional mutation operators, we propose nine GPU-specific mutation operators based on the core syntax differences between CPU and GPU programming. We conduct a preliminary study on six CUDA systems. The results show that mutation testing can effectively evaluate the test quality of GPU programs: conventional mutation operators can guide the engineers to write simple direct tests, while GPU-specific mutation operators can lead to more intricate test cases which are better at revealing GPU-specific weaknesses.

Original languageEnglish
Title of host publicationProceedings - 2020 IEEE 13th International Conference on Software Testing, Verification and Validation, ICST 2020
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages209-219
Number of pages11
ISBN (Electronic)9781728157771
DOIs
Publication statusPublished - 2020
Event13th IEEE International Conference on Software Testing, Verification and Validation, ICST 2020 - Porto, Portugal
Duration: 23 Mar 202027 Mar 2020

Publication series

NameProceedings - 2020 IEEE 13th International Conference on Software Testing, Verification and Validation, ICST 2020

Conference

Conference13th IEEE International Conference on Software Testing, Verification and Validation, ICST 2020
CountryPortugal
CityPorto
Period23/03/2027/03/20

Fingerprint Dive into the research topics of 'Massively Parallel, Highly Efficient, but What about the Test Suite Quality? Applying Mutation Testing to GPU Programs'. Together they form a unique fingerprint.

  • Cite this

    Zhu, Q., & Zaidman, A. (2020). Massively Parallel, Highly Efficient, but What about the Test Suite Quality? Applying Mutation Testing to GPU Programs. In Proceedings - 2020 IEEE 13th International Conference on Software Testing, Verification and Validation, ICST 2020 (pp. 209-219). [9159103] (Proceedings - 2020 IEEE 13th International Conference on Software Testing, Verification and Validation, ICST 2020). Institute of Electrical and Electronics Engineers (IEEE). https://doi.org/10.1109/ICST46399.2020.00030