skip to main content
research-article

Optimizing Reachability Probabilities for a Restricted Class of Stochastic Hybrid Automata via Flowpipe Construction

Published:26 October 2023Publication History
Skip Abstract Section

Abstract

Stochastic hybrid automata (SHA) are a powerful tool to evaluate the dependability and safety of critical infrastructures. However, the resolution of nondeterminism, which is present in many purely hybrid models, is often only implicitly considered in SHA. This article instead proposes algorithms for computing maximum and minimum reachability probabilities for singular automata with urgent transitions and random clocks that follow arbitrary continuous probability distributions. We borrow a well-known approach from hybrid systems reachability analysis, namely flowpipe construction, which is then extended to optimize nondeterminism in the presence of random variables. First, valuations of random clocks that ensure reachability of specific goal states are extracted from the computed flowpipes, and second, reachability probabilities are computed by integrating over these valuations. We compute maximum and minimum probabilities for history-dependent prophetic and non-prophetic schedulers using set-based methods. The implementation featuring the library HyPro and the complexity of the approach are discussed in detail. Two case studies featuring nondeterministic choices show the feasibility of the approach.

Skip Supplemental Material Section

Supplemental Material

REFERENCES

  1. [1] Abate Alessandro, Katoen Joost-Pieter, Lygeros John, and Prandini Maria. 2010. Approximate model checking of stochastic hybrid systems. European Journal of Control 16, 6 (2010), 624641.Google ScholarGoogle ScholarCross RefCross Ref
  2. [2] Alur Rajeev, Courcoubetis Costas A., Halbwachs Nicolas, Henzinger Thomas A., Ho Pei-Hsin, Nicollin Xavier, Olivero Alfredo, Sifakis Joseph, and Yovine Sergio. 1995. The algorithmic analysis of hybrid systems. Theoretical Computer Science 138 (1995), 334.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. [3] Ballarini Paolo, Bertrand Nathalie, Horváth András, Paolieri Marco, and Vicario Enrico. 2013. Transient analysis of networks of stochastic timed automata using stochastic state classes. In 10th Int. Conf. on Quantitative Evaluation of Systems (QEST’13) (LNCS), Vol. 8054. Springer, 355371.Google ScholarGoogle Scholar
  4. [4] Bertrand Nathalie, Bouyer Patricia, Brihaye Thomas, Menet Quentin, Baier Christel, Größer Marcus, and Jurdzinski Marcin. 2014. Stochastic timed automata. Logical Methods in Computer Science 10, 4 (2014), 173.Google ScholarGoogle Scholar
  5. [5] Bohnenkamp Henrik, D’Argenio Pedro R., Hermanns Holger, and Katoen Joost-Pieter. 2006. MODEST: A compositional modeling formalism for hard and softly timed systems. IEEE Transactions on Software Engineering 32, 10 (2006), 812830.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. [6] Budde Carlos E., D’Argenio Pedro R., Hartmanns Arnd, and Sedwards Sean. 2018. A statistical model checker for nondeterminism and rare events. In 24th Int. Conf. on Tools and Algorithms for the Construction and Analysis of Systems (TACAS’18) (LNCS’18), Vol. 10806. Springer, 340358.Google ScholarGoogle Scholar
  7. [7] D’Argenio Pedro R., Gerhold Marcus, Hartmanns Arnd, and Sedwards Sean. 2018. A hierarchy of scheduler classes for stochastic automata. In 21st Int. Conf. on Foundations of Software Science and Computation Structures (FoSSaCS’18) (LNCS’18), Vol. 10803. Springer, 384402.Google ScholarGoogle Scholar
  8. [8] D’Argenio Pedro R. and Katoen Joost-Pieter. 2005. A theory of stochastic systems part I: Stochastic automata. Information and Computation 203, 1 (2005), 138.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. [9] Delicaris Joanna, Schupp Stefan, Ábrahám Erika, and Remke Anne. 2023. Maximizing reachability probabilities in rectangular automata with random clocks. In 17th Int. Symp. on Theoretical Aspects of Software Engineering (LNCS), Vol. 13931. Springer, 119.Google ScholarGoogle Scholar
  10. [10] Fourier Jean Babtiste Joseph. 1827. Analyse des Travaux de l’académie Royale des Sciences Pendant l’année 1824. Partie Mathématique (1827).Google ScholarGoogle Scholar
  11. [11] Fränzle Martin, Hahn E. Moritz, Hermanns Holger, Wolovick Nicolás, and Zhang Lijun. 2011. Measurability and safety verification for stochastic hybrid systems. In 14th ACM Int. Conf. on Hybrid Systems: Computation and Control (HSCC’11). ACM, 4352.Google ScholarGoogle Scholar
  12. [12] Frehse Goran. 2005. PHAVer: Algorithmic verification of hybrid systems past HyTech. In 8th Int. Workshop on Hybrid Systems: Computation and Control (HSCC’05) (LNCS’05), Vol. 3414. Springer, 258273.Google ScholarGoogle Scholar
  13. [13] Ghasemieh Hamed, Remke Anne, and Haverkort Boudewijn R.. 2013. Analysis of a sewage treatment facility using hybrid petri nets. In 7th EAI Int. Conf. on Performance Evaluation Methodologies and Tools (VALUETOOLS’13). ICST, 165174.Google ScholarGoogle Scholar
  14. [14] Gough Brian. 2009. Gnu Scientific Library Reference Manual. Network Theory Ltd.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. [15] Hahn E. Moritz, Hartmanns Arnd, and Hermanns Holger. 2014. Reachability and reward checking for stochastic timed automata. Electronic Communiations of the EASST 70 (2014).Google ScholarGoogle Scholar
  16. [16] Hahn E. Moritz, Hartmanns Arnd, Hermanns Holger, and Katoen Joost-Pieter. 2013. A compositional modelling and analysis framework for stochastic hybrid systems. Formal Methods in System Design 43, 2 (2013), 191232.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. [17] Henzinger Thomas A.. 2000. The theory of hybrid automata. In Verification of Digital and Hybrid Systems. NATO ASI Series, Vol. 170. Springer, 265292.Google ScholarGoogle ScholarCross RefCross Ref
  18. [18] Henzinger Thomas A., Kopke Peter W., Puri Anuj, and Varaiya Pravin. 1998. What’s decidable about hybrid automata? Journal of Computer and System Sciences 57, 1 (1998), 94124.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. [19] Heymann Michael, Lin Feng, Meyer George, and Resmerita Stefan. 2005. Analysis of Zeno behaviors in a class of hybrid systems. IEEE Transactions on Automated Control 50, 3 (2005), 376383.Google ScholarGoogle ScholarCross RefCross Ref
  20. [20] Hüls Jannik, Niehaus Henner, and Remke Anne. 2020. Hpnmg: A C++ tool for model checking hybrid petri nets with general transitions. In 12th Int. NASA Formal Methods Symp. (NFM’20) (LNCS’20), Vol. 12229. Springer, 369378.Google ScholarGoogle Scholar
  21. [21] Hüls Jannik, Pilch Carina, Schinke Patricia, Delicaris Joanna, and Remke Anne. 2019. State-space construction of hybrid petri nets with multiple stochastic firings. In 16th Int. Conf. on Quantitative Evaluation of Systems (QEST’19) (LNCS’19), Vol. 11785. Springer, 182199.Google ScholarGoogle Scholar
  22. [22] Hüls Jannik, Pilch Carina, Schinke Patricia, Niehaus Henner, Delicaris Joanna, and Remke Anne. 2021. State-space construction of hybrid petri nets with multiple stochastic firings. ACM Transactions on Modeling and Computer Simulation 31, 3 (2021), 137.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. [23] Hüls Jannik and Remke Anne. 2016. Coordinated charging strategies for plug-in electric vehicles to ensure a robust charging process. In 10th EAI Int. Conf. on Performance Evaluation Methodologies and Tools (VALUETOOLS’16). ICST.Google ScholarGoogle Scholar
  24. [24] Hüls Jannik and Remke Anne. 2016. Energy storage in smart homes: Grid-convenience versus self-use and survivability. In 24th IEEE Int. Symp. on Modeling, Analysis and Simulation of Computer and Telecommunication Systems. IEEE, 385390.Google ScholarGoogle Scholar
  25. [25] Koutsoukos Xenofon D. and Riley Derek. 2008. Computational methods for verification of stochastic hybrid systems. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 38, 2 (2008), 385396.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. [26] Kwiatkowska Marta Z., Norman Gethin, Segala Roberto, and Sproston Jeremy. 2000. Verifying quantitative properties of continuous probabilistic timed automata. In 11th Int. Conf. on Concurrency Theory (CONCUR’00) (LNCS’00), Vol. 1877. Springer, 123137.Google ScholarGoogle Scholar
  27. [27] Lepage G. Peter. 2021. Adaptive multidimensional integration: VEGAS enhanced. Journal of Computational Physics 439 (2021), 110386. arxiv:2009.05112 [hep-ph, physics:physics]Google ScholarGoogle ScholarCross RefCross Ref
  28. [28] Megiddo Nimrod. 1987. On the complexity of linear programming. In Advances in Economic Theory. Cambridge University Press, London, 225268.Google ScholarGoogle Scholar
  29. [29] Motzkin Theodore Samuel. 1936. Beitrage Zur Theorie Der Linearen Ungleichungen. Azriel.Google ScholarGoogle Scholar
  30. [30] Niehage Mathis, Hartmanns Arnd, and Remke Anne. 2021. Learning optimal decisions for stochastic hybrid systems. In 19th ACM-IEEE Int. Conf. on Formal Methods and Models for System Design (MEMOCODE’21). ACM, 4455.Google ScholarGoogle Scholar
  31. [31] Pilch Carina, Hartmanns Arnd, and Remke Anne. 2020. Classic and non-prophetic model checking for hybrid petri nets with stochastic firings. In 23rd ACM Int. Conf. on Hybrid Systems: Computation and Control (HSCC’20). ACM, 111.Google ScholarGoogle Scholar
  32. [32] Pilch Carina, Krause Maurice, Remke Anne, and Ábrahám Erika. 2020. A transformation of hybrid petri nets with stochastic firings into a subclass of stochastic hybrid automata. In 12th Int. NASA Formal Methods Symp. (NFM’20) (LNCS), Vol. 12229. Springer, 381400.Google ScholarGoogle Scholar
  33. [33] Pilch Carina, Schupp Stefan, and Remke Anne. 2021. Optimizing reachability probabilities for a restricted class of stochastic hybrid automata via flowpipe-construction. In 18th Int. Conf. on Quantitative Evaluation of Systems (QEST’21) (LNCS), Vol. 12846. Springer, Cham, 435456.Google ScholarGoogle Scholar
  34. [34] Prandini Maria and Hu Jianghai. 2006. A stochastic approximation method for reachability computations. In Stochastic Hybrid Systems: Theory and Safety Critical Applications. LNCIS, Vol. 337. Springer, 107139.Google ScholarGoogle Scholar
  35. [35] Schupp Stefan. 2019. State Set Representations and Their Usage in the Reachability Analysis of Hybrid Systems. Dissertation. RWTH Aachen University. http://publications.rwth-aachen.de/record/767529Google ScholarGoogle Scholar
  36. [36] Schupp Stefan, Ábrahám Erika, Makhlouf Ibtissem Ben, and Kowalewski Stefan. 2017. HyPro: A C++ library of state set representations for hybrid systems reachability analysis. In 9th Int. NASA Formal Methods Symp. (NFM’17) (LNCS), Vol. 10227. Springer, Cham, 288294.Google ScholarGoogle Scholar
  37. [37] Soudjani Sadegh E. Z., Gevaerts Caspar, and Abate Alessandro. 2015. FAUST2: Formal abstractions of uncountable-STate STochastic processes. In 21st Int. Conf. on Tools and Algorithms for the Construction and Analysis of Systems (TACAS’15) (LNCS), Vol. 9035. Springer, 272286.Google ScholarGoogle Scholar
  38. [38] Sproston Jeremy. 2000. Decidable model checking of probabilistic hybrid automata. In 6th Int. Symp. on Formal Techniques in Real-time and Fault-tolerant Systems (FTRTFT’00) (LNCS), Vol. 1926. Springer, 3145.Google ScholarGoogle Scholar
  39. [39] Zhang Lijun, She Zhikun, Ratschan Stefan, Hermanns Holger, and Hahn E. Moritz. 2012. Safety verification for probabilistic hybrid systems. European Journal of Control 18, 6 (2012), 572587.Google ScholarGoogle ScholarCross RefCross Ref
  40. [40] Ziegler Günter. 1995. Lectures on Polytopes. Graduate Texts in Mathematics, Vol. 152. Springer Science & Business Media.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Optimizing Reachability Probabilities for a Restricted Class of Stochastic Hybrid Automata via Flowpipe Construction

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Modeling and Computer Simulation
      ACM Transactions on Modeling and Computer Simulation  Volume 33, Issue 4
      October 2023
      175 pages
      ISSN:1049-3301
      EISSN:1558-1195
      DOI:10.1145/3630105
      • Editor:
      • Wentong Cai
      Issue’s Table of Contents

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 26 October 2023
      • Online AM: 11 July 2023
      • Accepted: 2 June 2023
      • Revised: 15 February 2023
      • Received: 16 January 2022
      Published in tomacs Volume 33, Issue 4

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    View Full Text