Naming Amplified Tests Based on Improved Coverage

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

3 Citations (Scopus)
94 Downloads (Pure)

Abstract

Test amplification generates new test cases that improve the coverage of an existing test suite. To convince developers to integrate these new test cases into their test suite, it is crucial to convey the behavior and the improvement in coverage that the amplified test case provides. In this paper, we present NATIC, an approach to generate names for amplified test cases based on the methods they additionally cover, compared to the existing test suite. In a survey among 16 participants with a background in Computer Science, we show that the test names generated by NATIC are valued similarly to names written by experts. According to the participants, the names generated by NATIC outperform expert-written names with respect to informing about coverage improvement, but lack in conveying a test's behavior. Finally, we discuss how a restriction to two mentioned methods per name would improve the understandability of the test names generated by NATIC.
Original languageEnglish
Title of host publication2021 IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM)
Place of PublicationPiscataway, NJ
PublisherIEEE Computer Society - Conference Publishing Services
Pages237-241
Number of pages5
ISBN (Electronic)9781665448970
ISBN (Print)978-1-6654-4897-0
DOIs
Publication statusPublished - 2021

Publication series

NameProceedings - IEEE 21st International Working Conference on Source Code Analysis and Manipulation, SCAM 2021

Bibliographical note

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Fingerprint

Dive into the research topics of 'Naming Amplified Tests Based on Improved Coverage'. Together they form a unique fingerprint.

Cite this