ARCH-COMP17 Repeatability Evaluation Report

6 pages•Published: June 27, 2017

Abstract

This report presents the results of the repeatability evaluation for a friendly competition for formal verification of continuous and hybrid systems. The friendly competition took place as part of the workshop Applied Verification for Continuous and Hybrid Systems (ARCH) in 2017. In its first edition, thirteen tools have been applied to solve benchmark problems for the six competition categories, of which, ten tools were evaluated and passed the repeatability evaluation. The repeatability results represent a snapshot of the current landscape of tools and the types of benchmarks for which they are particularly suited and for which others may repeat their analyses. Due to the diversity of problems in verification of continuous and hybrid systems, as well as basing on standard practice in repeatability evaluations, we evaluate the tools with pass and/or failing being repeatable. These re- sults probably provide the most complete assessment of tools for the safety verification of continuous and hybrid systems up to this date.

Keyphrases: continuous systems, formal verification, hybrid systems, repeatability evaluation, reproducible research

In: Goran Frehse and Matthias Althoff (editors). ARCH17. 4th International Workshop on Applied Verification of Continuous and Hybrid Systems, vol 48, pages 175-180.

Links:	https://easychair.org/publications/paper/nMvb
	https://doi.org/10.29007/7hvk

BibTeX entry

@inproceedings{ARCH17:ARCH_COMP17_Repeatability_Evaluation,
  author    = {Taylor T. Johnson},
  title     = {ARCH-COMP17 Repeatability Evaluation Report},
  booktitle = {ARCH17. 4th International Workshop on Applied Verification of Continuous and Hybrid Systems},
  editor    = {Goran Frehse and Matthias Althoff},
  series    = {EPiC Series in Computing},
  volume    = {48},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2398-7340},
  url       = {/publications/paper/nMvb},
  doi       = {10.29007/7hvk},
  pages     = {175-180},
  year      = {2017}}

Download PDF Open PDF in browser