Java Unit Testing Tool Competition - Seventh Round

Fitsum Kifetew, Xavier Devroey, Urko Rueda

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

112 Downloads (Pure)


We report on the results of the seventh edition of the JUnit tool competition. This year, four tools were executed on a benchmark with (i) new classes, selected from real-world software projects, and (ii) challenging classes from the previous edition. We use Randoop and manual test suites from the projects as baselines. Given the interesting findings of last year, we analyzed the effectiveness of the combined test suites generated by all competing tools and compared; results are confronted with the manual test suites of the projects, as well as those generated by the competing tools. This paper describes our methodology and the results, highlight challenges faced during the contest.
Original languageEnglish
Title of host publication2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing (SBST)
Subtitle of host publicationProceedings
Place of PublicationPiscataway
Number of pages6
ISBN (Electronic)978-1-7281-2233-5
ISBN (Print)978-1-7281-2234-2
Publication statusPublished - 2019
EventSBST '19: 12th International Workshop on Search-Based Software Testing - Montreal, Canada
Duration: 27 May 201927 May 2019
Conference number: 12


ConferenceSBST '19: 12th International Workshop on Search-Based Software Testing
Abbreviated titleSBST '19


  • Java
  • automation
  • benchmark
  • combined performance
  • mutation testing
  • statistical analysis
  • tool competition
  • unit testing

Fingerprint Dive into the research topics of 'Java Unit Testing Tool Competition - Seventh Round'. Together they form a unique fingerprint.

Cite this