Application Programming Interfaces (APIs) typically come with (implicit) usage constraints. The violations of these constraints (API misuses) can lead to software crashes. Even though there are several tools that can detect API misuses, most of them suffer from a very high rate of false positives. We introduce Catcher, a novel API misuse detection approach that combines static exception propagation analysis with automatic search-based test case generation to effectively and efficiently pinpoint crash-prone API misuses in client applications. We validate Catcher against 21 Java applications, targeting misuses of the Java platform’s API. Our results indicate that Catcher is able to generate test cases that uncover 243 (unique) API misuses that result in crashes. Our empirical evaluation shows that Catcher can detect a large number of misuses (77 cases) that would remain undetected by the traditional coverage-based test case generator EvoSuite. Additionally, on average, Catcher is eight times faster than EvoSuite in generating test cases for the identified misuses. Finally, we find that the majority of the exceptions triggered by Catcher are unexpected to developers, i.e., not only unhandled in the source code but also not listed in the documentation of the client applications.
|Title of host publication||ISSTA 2019|
|Subtitle of host publication||Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis|
|Editors||Anders Moller, Dongmei Zhang|
|Place of Publication||New York|
|Publisher||Association for Computing Machinery (ACM)|
|Number of pages||12|
|Publication status||Published - 2019|
|Event||ISSTA 2019: 28th ACM SIGSOFT International Symposium on Software Testing and Analysis - Beijing, China|
Duration: 15 Jul 2019 → 19 Jul 2019
Conference number: 28
|Conference||ISSTA 2019: 28th ACM SIGSOFT International Symposium on Software Testing and Analysis|
|Abbreviated title||ISSTA '19|
|Period||15/07/19 → 19/07/19|
- API misuse
- Search-based software testing
- Software crash
- Static exception propagation
FingerprintDive into the research topics of 'Effective and Efficient API Misuse Detection via Exception Propagation and Search-Based Testing'. Together they form a unique fingerprint.
Catcher, artifact of the paper: “Effective and Efficient API Misuse Detection via Exception Propagation and Search-based Testing”.