On the Risk of Tool Over-tuning in Run-time Verification  Competitions (position paper)

Domenico Bianculli; Srdjan Krstic

doi:10.29007/l43m

Download PDF Open PDF in browser

On the Risk of Tool Over-tuning in Run-time Verification Competitions (position paper)

4 pages•Published: December 14, 2017

Domenico Bianculli and Srdjan Krstic

Abstract

In this position paper we discuss the risk of tool over-tuning in
runtime verification competitions. We believe that the risk is
inherently enabled by the format of the competitions and we discuss it
in the context of the "First International Competition on Software
for Runtime Verification (CSRV~2014)", in which we participated.

Keyphrases: competition, over-tuning, run-time verification

In: Giles Reger and Klaus Havelund (editors). RV-CuBES 2017. An International Workshop on Competitions, Usability, Benchmarks, Evaluation, and Standardisation for Runtime Verification Tools, vol 3, pages 37--40

Links:	https://easychair.org/publications/paper/N6cC
	https://doi.org/10.29007/l43m

BibTeX entry

@inproceedings{RV-CuBES2017:On_Risk_of_Tool,
  author    = {Domenico Bianculli and Srdjan Krstic},
  title     = {On the Risk of Tool Over-tuning in Run-time Verification  Competitions (position paper)},
  booktitle = {RV-CuBES 2017. An International Workshop on Competitions, Usability, Benchmarks, Evaluation, and Standardisation for Runtime Verification Tools},
  editor    = {Giles Reger and Klaus Havelund},
  series    = {Kalpa Publications in Computing},
  volume    = {3},
  pages     = {37--40},
  year      = {2017},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2515-1762},
  url       = {https://easychair.org/publications/paper/N6cC},
  doi       = {10.29007/l43m}}

Download PDF Open PDF in browser