Multi-objective Black-box Test Case Prioritization based on Wordnet Distances

Imara van Dinten; A.E. Zaidman; A. Panichella

doi:10.1007/978-3-031-48796-5_7

Multi-objective Black-box Test Case Prioritization based on Wordnet Distances

Imara van Dinten, A.E. Zaidman, A. Panichella

Software Engineering

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

5 Downloads (Pure)

Abstract

Test case prioritization techniques have emerged as effective strategies to optimize this process and mitigate the regression testing costs. Commonly, black-box heuristics guide optimal test ordering, leveraging information retrieval (e.g., cosine distance) to measure the test case distance and sort them accordingly. However, a challenge arises when dealing with tests of varying granularity levels, as they may employ distinct vocabularies (e.g., name identifiers). In this paper, we propose to measure the distance between test cases based on the shortest path between their identifiers within the WordNet lexical database. This additional heuristic is combined with the traditional cosine distance to prioritize test cases in a multi-objective fashion. Our preliminary study conducted with two different Java projects shows that test cases prioritized with WordNet achieve larger fault detection capability (APFD _C ) compared to the traditional cosine distance used in the literature.

Original language	English
Title of host publication	Search-Based Software Engineering: 15th International Symposium, SSBSE 2023, San Francisco, CA, USA, December 8, 2023, Proceedings
Editors	Paolo Arcaini , Tao Yue, Erik M. Fredericks
Publisher	Springer
Pages	101-107
Number of pages	7
ISBN (Electronic)	978-3-031-48796-5
ISBN (Print)	978-3-031-48795-8
DOIs	https://doi.org/10.1007/978-3-031-48796-5_7
Publication status	Published - 2023
Event	15th International Symposium on Search-Based Software Engineering - San Francisco, United States Duration: 8 Dec 2023 → 8 Dec 2023 Conference number: 15 https://conf.researchr.org/home/ssbse-2023

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	14415 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	15th International Symposium on Search-Based Software Engineering
Abbreviated title	SSBSE 2023
Country/Territory	United States
City	San Francisco
Period	8/12/23 → 8/12/23
Internet address	https://conf.researchr.org/home/ssbse-2023

Keywords

Empirical Software Engineering
Search-Based Software Testing
Test Case Prioritization
Wordnet
Natural Language Processing

Access to Document

10.1007/978-3-031-48796-5_7

Cite this

van Dinten, I., Zaidman, A. E., & Panichella, A. (2023). Multi-objective Black-box Test Case Prioritization based on Wordnet Distances. In P. Arcaini , T. Yue, & E. M. Fredericks (Eds.), Search-Based Software Engineering: 15th International Symposium, SSBSE 2023, San Francisco, CA, USA, December 8, 2023, Proceedings (pp. 101-107). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14415 LNCS). Springer. https://doi.org/10.1007/978-3-031-48796-5_7

van Dinten, Imara ; Zaidman, A.E. ; Panichella, A. / Multi-objective Black-box Test Case Prioritization based on Wordnet Distances. Search-Based Software Engineering: 15th International Symposium, SSBSE 2023, San Francisco, CA, USA, December 8, 2023, Proceedings. editor / Paolo Arcaini ; Tao Yue ; Erik M. Fredericks. Springer, 2023. pp. 101-107 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{c9e12dcd42384effa6935f67c3ab649d,

title = "Multi-objective Black-box Test Case Prioritization based on Wordnet Distances",

abstract = "Test case prioritization techniques have emerged as effective strategies to optimize this process and mitigate the regression testing costs. Commonly, black-box heuristics guide optimal test ordering, leveraging information retrieval (e.g., cosine distance) to measure the test case distance and sort them accordingly. However, a challenge arises when dealing with tests of varying granularity levels, as they may employ distinct vocabularies (e.g., name identifiers). In this paper, we propose to measure the distance between test cases based on the shortest path between their identifiers within the WordNet lexical database. This additional heuristic is combined with the traditional cosine distance to prioritize test cases in a multi-objective fashion. Our preliminary study conducted with two different Java projects shows that test cases prioritized with WordNet achieve larger fault detection capability (APFD C ) compared to the traditional cosine distance used in the literature.",

keywords = "Empirical Software Engineering, Search-Based Software Testing, Test Case Prioritization, Wordnet, Natural Language Processing",

author = "{van Dinten}, Imara and A.E. Zaidman and A. Panichella",

year = "2023",

doi = "10.1007/978-3-031-48796-5_7",

language = "English",

isbn = "978-3-031-48795-8",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "101--107",

editor = "{Arcaini }, {Paolo } and Yue, {Tao } and Fredericks, {Erik M. }",

booktitle = "Search-Based Software Engineering: 15th International Symposium, SSBSE 2023, San Francisco, CA, USA, December 8, 2023, Proceedings",

note = "15th International Symposium on Search-Based Software Engineering, SSBSE 2023 ; Conference date: 08-12-2023 Through 08-12-2023",

url = "https://conf.researchr.org/home/ssbse-2023",

}

van Dinten, I , Zaidman, AE & Panichella, A 2023, Multi-objective Black-box Test Case Prioritization based on Wordnet Distances. in P Arcaini , T Yue & EM Fredericks (eds), Search-Based Software Engineering: 15th International Symposium, SSBSE 2023, San Francisco, CA, USA, December 8, 2023, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 14415 LNCS, Springer, pp. 101-107, 15th International Symposium on Search-Based Software Engineering, San Francisco, United States, 8/12/23. https://doi.org/10.1007/978-3-031-48796-5_7

Multi-objective Black-box Test Case Prioritization based on Wordnet Distances. / van Dinten, Imara ; Zaidman, A.E.; Panichella, A.
Search-Based Software Engineering: 15th International Symposium, SSBSE 2023, San Francisco, CA, USA, December 8, 2023, Proceedings. ed. / Paolo Arcaini ; Tao Yue; Erik M. Fredericks. Springer, 2023. p. 101-107 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14415 LNCS).

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Multi-objective Black-box Test Case Prioritization based on Wordnet Distances

AU - van Dinten, Imara

AU - Zaidman, A.E.

AU - Panichella, A.

N1 - Conference code: 15

PY - 2023

Y1 - 2023

N2 - Test case prioritization techniques have emerged as effective strategies to optimize this process and mitigate the regression testing costs. Commonly, black-box heuristics guide optimal test ordering, leveraging information retrieval (e.g., cosine distance) to measure the test case distance and sort them accordingly. However, a challenge arises when dealing with tests of varying granularity levels, as they may employ distinct vocabularies (e.g., name identifiers). In this paper, we propose to measure the distance between test cases based on the shortest path between their identifiers within the WordNet lexical database. This additional heuristic is combined with the traditional cosine distance to prioritize test cases in a multi-objective fashion. Our preliminary study conducted with two different Java projects shows that test cases prioritized with WordNet achieve larger fault detection capability (APFD C ) compared to the traditional cosine distance used in the literature.

AB - Test case prioritization techniques have emerged as effective strategies to optimize this process and mitigate the regression testing costs. Commonly, black-box heuristics guide optimal test ordering, leveraging information retrieval (e.g., cosine distance) to measure the test case distance and sort them accordingly. However, a challenge arises when dealing with tests of varying granularity levels, as they may employ distinct vocabularies (e.g., name identifiers). In this paper, we propose to measure the distance between test cases based on the shortest path between their identifiers within the WordNet lexical database. This additional heuristic is combined with the traditional cosine distance to prioritize test cases in a multi-objective fashion. Our preliminary study conducted with two different Java projects shows that test cases prioritized with WordNet achieve larger fault detection capability (APFD C ) compared to the traditional cosine distance used in the literature.

KW - Empirical Software Engineering

KW - Search-Based Software Testing

KW - Test Case Prioritization

KW - Wordnet

KW - Natural Language Processing

UR - http://www.scopus.com/inward/record.url?scp=85180543335&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-48796-5_7

DO - 10.1007/978-3-031-48796-5_7

M3 - Conference contribution

SN - 978-3-031-48795-8

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 101

EP - 107

BT - Search-Based Software Engineering: 15th International Symposium, SSBSE 2023, San Francisco, CA, USA, December 8, 2023, Proceedings

A2 - Arcaini , Paolo

A2 - Yue, Tao

A2 - Fredericks, Erik M.

PB - Springer

T2 - 15th International Symposium on Search-Based Software Engineering

Y2 - 8 December 2023 through 8 December 2023

ER -

van Dinten I , Zaidman AE , Panichella A. Multi-objective Black-box Test Case Prioritization based on Wordnet Distances. In Arcaini P, Yue T, Fredericks EM, editors, Search-Based Software Engineering: 15th International Symposium, SSBSE 2023, San Francisco, CA, USA, December 8, 2023, Proceedings. Springer. 2023. p. 101-107. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-48796-5_7

Multi-objective Black-box Test Case Prioritization based on Wordnet Distances

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Embargoed Document

Fingerprint

Cite this