SBST Tool Competition 2022

Alessio Gambi, Gunel Jahangirova, Vincenzo Riccio, Fiorella Zampetti

Publikation: Beitrag in Buch/Bericht/KonferenzbandKonferenzbeitragBegutachtung

Abstract

We report on the organization, challenges, and results of the tenth edition of the Java Unit Testing Competition as well as the second edition of the Cyber-Physical Systems (CPS) Testing Competition. Java Unit Testing Competition. Seven tools, i.e., BBC, EvoSuite, Kex, Kex-Reflection, Randoop, UTBot, and UTBot-Mocks, were executed on a benchmark with 65 classes sampled from four opensource Java projects, for two time budgets: 30 and 120 seconds. CPS Testing Tool Competition. Six tools, i.e., AdaFrenetic, Am bieGen, FreneticV, GenRL, EvoMBT and WOGAN competed on testing two driving agents by generating simulation-based tests. We considered one configuration for each test subject and evaluated the tools' effectiveness and efficiency as well as the failure diversity. This paper describes our methodology, the statistical analysis of the results together with the competing tools, and the challenges faced while running the competition experiments.
OriginalspracheEnglisch
TitelProceedings - 15th Search-Based Software Testing Workshop, SBST 2022
Erscheinungsort1601 Broadway, 10th Floor, NEW YORK, NY, UNITED STATES
Herausgeber (Verlag)IEEE
Seiten25-32
Seitenumfang8
ISBN (elektronisch)9781450393188
ISBN (Print)978-1-4503-9318-8
DOIs
PublikationsstatusVeröffentlicht - 3 Feb. 2022
Extern publiziertJa

Publikationsreihe

NameProceedings - 15th Search-Based Software Testing Workshop, SBST 2022

Fingerprint

Untersuchen Sie die Forschungsthemen von „SBST Tool Competition 2022“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren