The SMT Execution Service: Features, Fairness, and the Future

1 pages•Published: May 15, 2012

Abstract

The SMT-Exec service is a benchmark repository, execution service, and competition infrastructure for the SMT community. Besides running the yearly competition and providing real-time (and also archival) results and analysis, SMT-Exec permits "private experiments" to be run year-round by researchers all over the world. These experiments are just like the yearly competition and run on the same computing cluster, but may be parameterized by users to run on benchmark and solver subsets of interest with a configurable timeout. Private solvers may be uploaded and tested against each other or against archival versions of competition solvers, and solvers and experiment results may be "published" so that they are publicly viewable. This talk describes SMT-Exec design highlights, challenges, growing pains, and current development plans for future versions of SMT-Exec.

Keyphrases: competition infrastructure, execution service, satisfiability modulo theories

In: Aaron Stump, Geoff Sutcliffe and Cesare Tinelli (editors). EMSQMS 2010. Workshop on Evaluation Methods for Solvers, and Quality Metrics for Solutions, vol 6, pages 41.

Links:	https://easychair.org/publications/paper/66PQ
	https://doi.org/10.29007/5pxg

BibTeX entry

@inproceedings{EMSQMS2010:SMT_Execution_Service_Features,
  author    = {Morgan Deters},
  title     = {The SMT Execution Service: Features, Fairness, and the Future},
  booktitle = {EMSQMS 2010. Workshop on Evaluation Methods for Solvers, and Quality Metrics for Solutions},
  editor    = {Aaron Stump and Geoff Sutcliffe and Cesare Tinelli},
  series    = {EPiC Series in Computing},
  volume    = {6},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2398-7340},
  url       = {/publications/paper/66PQ},
  doi       = {10.29007/5pxg},
  pages     = {41},
  year      = {2012}}

Download PDF Open PDF in browser