The 2019 Comparison of Tools for the Analysis of Quantitative Formal Models - (QComp 2019 Competition Report)

Ernst Moritz HahnErnst Moritz Hahn, Arnd HartmannsArnd Hartmanns, Christian HenselChristian Hensel, Michaela KlauckMichaela Klauck, Joachim KleinJoachim Klein, Jan KretínskýJan Kretínský, David ParkerDavid Parker, Tim QuatmannTim Quatmann, Enno RuijtersEnno Ruijters, Marcel SteinmetzMarcel Steinmetz

DOI Link

Ernst Moritz Hahn, Arnd Hartmanns, Christian Hensel, Michaela Klauck, Joachim Klein, Jan Kretínský, David Parker, Tim Quatmann, Enno Ruijters, Marcel Steinmetz
The 2019 Comparison of Tools for the Analysis of Quantitative Formal Models - (QComp 2019 Competition Report)
Proc. of Tools and Algorithms for the Construction and Analysis of Systems - 25 Years of TACAS: TOOLympics, Part III, volume 11429 of Lecture Notes in Computer Science, 69--92, 2019. Springer

Details
Bibtex

KurzfassungAbstract
Quantitative formal models capture probabilistic behaviour, real-time aspects, or general continuous dynamics. A number of tools support their automatic analysis with respect to dependability or performance properties. QComp 2019 is the first, friendly competition among such tools. It focuses on stochastic formalisms from Markov chains to probabilistic timed automata specified in the Jani model exchange format, and on probabilistic reachability, expected-reward, and steady-state properties. QComp draws its benchmarks from the new Quantitative Verification Benchmark Set. Participating tools, which include probabilistic model checkers and planners as well as simulation-based tools, are evaluated in terms of performance, versatility, and usability. In this paper, we report on the challenges in setting up a quantitative verification competition, present the results of QComp 2019, summarise the lessons learned, and provide an outlook on the features of the next edition of QComp.
Forschungsgruppe:Research Group: Algebraische und logische Grundlagen der InformatikAlgebraic and Logical Foundations of Computer Science

The final publication is available at Springer via http://dx.doi.org/10.1007/978-3-030-17502-3_5.

@inproceedings{HHHKKKPQRS2019,
  author    = {Ernst Moritz Hahn and Arnd Hartmanns and Christian Hensel and
               Michaela Klauck and Joachim Klein and Jan Kret{\'{\i}}nsk{\'{y}}
               and David Parker and Tim Quatmann and Enno Ruijters and Marcel
               Steinmetz},
  title     = {The 2019 Comparison of Tools for the Analysis of Quantitative
               Formal Models - (QComp 2019 Competition Report)},
  booktitle = {Proc. of Tools and Algorithms for the Construction and Analysis
               of Systems - 25 Years of {TACAS:} {TOOLympics,} Part {III}},
  series    = {Lecture Notes in Computer Science},
  volume    = {11429},
  publisher = {Springer},
  year      = {2019},
  pages     = {69--92},
  doi       = {10.1007/978-3-030-17502-3_5}
}