Developer-centric test amplification: The interplay between automatic generation human exploration

Carolin Brandt*, Andy Zaidman

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

58 Downloads (Pure)

Abstract

Automatically generating test cases for software has been an active research topic for many years. While current tools can generate powerful regression or crash-reproducing test cases, these are often kept separately from the maintained test suite. In this paper, we leverage the developer’s familiarity with test cases amplified from existing, manually written developer tests. Starting from issues reported by developers in previous studies, we investigate what aspects are important to design a developer-centric test amplification approach, that provides test cases that are taken over by developers into their test suite. We conduct 16 semi-structured interviews with software developers supported by our prototypical designs of a developer-centric test amplification approach and a corresponding test exploration tool. We extend the test amplification tool DSpot, generating test cases that are easier to understand. Our IntelliJ plugin TestCube[InlineMediaObject not available: see fulltext.] empowers developers to explore amplified test cases from their familiar environment. From our interviews, we gather 52 observations that we summarize into 23 result categories and give two key recommendations on how future tool designers can make their tools better suited for developer-centric test amplification.

Original languageEnglish
Article number96
Number of pages35
JournalEmpirical Software Engineering
Volume27
Issue number4
DOIs
Publication statusPublished - 2022

Keywords

  • Developer-centric design
  • Software testing
  • Test amplification
  • Test exploration
  • Test generation

Fingerprint

Dive into the research topics of 'Developer-centric test amplification: The interplay between automatic generation human exploration'. Together they form a unique fingerprint.

Cite this