Skip to main content

Artigo em periódicoOpen Access

Benchmarking of Java Verification Tools at the Software Verification Competition (SV-COMP)

CORDEIRO, L. C.2018CORDEIRO, L. C.; KROENING, DANIEL; SCHRAMMEL, P

2018 • ACM SIGSOFT Software Engineering Notes • 8 citações

Resumo

Resumo

Empirical evaluation of verification tools by benchmarking is a common method in software verification research. The Competition on Software Verification (SV-COMP) aims at standardization and reproducibility of benchmarking within the software verification community in an annual basis, through comparative evaluation of fully-automatic software verifiers for C programs. Building upon this success, we describe here how to re-use the ecosystem developed around SV-COMP for benchmarking Java verification tools. We provide a detailed description of the rules for benchmark verification tasks, the integration of new tools into SV-COMP's benchmarking framework and also give experimental results of a benchmarking run on three state-of-the-art Java verification tools, JPF-SE, JayHorn and JBMC.

palavras-chave

Palavras-chave

SV-COMPbenchmarkingsoftware verificationprogram verificationC programsbenchmarking frameworktool comparison

Volume

43

Número

4

Páginas

56-60

Editora

Association for Computing Machinery (ACM)

Status

Published

links

Artigo em periódico