Román Cárdenas
Gabriel A. Wainer
Abstract
The DEVStone benchmark allows us to evaluate the performance of discrete-event simulators based on the Discrete Event System (DEVS) formalism. It provides model sets with different characteristics, enabling the analysis of specific issues of simulation engines. However, this heterogeneity hinders the comparison of the results among studies, as the results obtained on each research work depend on the chosen subset of DEVStone models. We define the DEVStone metric based on the DEVStone synthetic benchmark and provide a mechanism for specifying objective ratings for DEVS-based simulators. This metric corresponds to the average number of times that a simulator can execute a selection of 12 DEVStone models in 1 minute. The variety of the chosen models ensures that we measure different particularities provided by DEVStone. The proposed metric allows us to compare various simulators and to assess the impact of new features on their performance. We use the DEVStone metric to compare some popular DEVS-based simulators.
- [1] . 2018. Theory of Modeling and Simulation: Discrete Event and Iterative System Computational Foundations (3rd ed.). Academic Press, San Diego, CA.Google Scholar
- [2] . 2013. Interoperability, composability, and their implications for distributed simulation: Towards mathematical foundations of simulation interoperability. In Proceedings of the 17th International Symposium on Distributed Simulation and Real Time Applications. 3–9.
DOI: Google ScholarDigital Library
- [3] . 2009. DEVS namespace for interoperable DEVS/SOA. In Proceedings of the 2009 Winter Simulation Conference. IEEE, Los Alamitos, CA, 1311–1322.
DOI: Google ScholarCross Ref
- [4] . 2009. DEVS/SOA: Towards DEVS interoperability in distributed M&S. In Proceedings of the 13th IEEE/ACM International Symposium on Distributed Simulation and Real Time Applications. 144–153.
DOI: Google ScholarDigital Library - [5] . 2009. Introduction to Discrete Event Systems (2nd ed.). Springer Science & Business Media, Luxembourg.Google Scholar
- [6] . 2000. DEVS as a common denominator for multi-formalism hybrid systems modelling. In Proceedings of the IEEE International Symposium on Computer-Aided Control System Design. IEEE, Los Alamitos, CA, 129–134.
DOI: Google ScholarCross Ref - [7] . 2010. Modeling and simulation of nuclear medicine patient service management in DEVS. Simulation 86, 8--9 (2010), 481–501.
DOI: Google ScholarDigital Library - [8] . 2017. Advanced migraine prediction simulation system. In Proceedings of the 2017 Summer Simulation Multi-Conference.
DOI: Google ScholarDigital Library - [9] . 2010. Simulation of wind farm operations and maintenance using Discrete EVent System specification. Simulation 87, 12 (2010), 1093–1117.
DOI: Google ScholarDigital Library - [10] . 2016. Modeling and simulation of renewable energy sources in smart grid using DEVS formalism. Procedia Computer Science 83 (2016), 642–647.
DOI: Google ScholarCross Ref - [11] , 2000. Specifying truck movement in traffic models using Cell-DEVS. In Proceedings of the 33rd Annual Simulation Symposium. IEEE, Los Alamitos, CA, 66–73.
DOI: Google ScholarCross Ref - [12] . 1976. A synthetic benchmark. Computer Journal 19, 1 (1976), 43–49,
DOI: Google ScholarCross Ref - [13] . 2005. DEVStone: A benchmarking technique for studying performance of DEVS modeling and simulation environments. In Proceedings of the 9th IEEE International Symposium on Distributed Simulation and Real-Time Applications. IEEE, Los Alamitos, CA, 265–272.
DOI: Google ScholarDigital Library - [14] . 1994. Parallel DEVS: A parallel, hierarchical, modular modeling formalism. In Proceedings of the Winter Simulation Conference. IEEE, Los Alamitos, CA, 716–722.
DOI: Google ScholarCross Ref - [15] . 1999. adevs: A Discrete EVent System Simulator. Retrieved May 20, 2021 from https://web.ornl.gov/∼nutarojj/adevs/.Google Scholar
- [16] . 2019. Building DEVS models with the Cadmium tool. In Proceedings of the 2019 Winter Simulation Conference. IEEE, Los Alamitos, CA, 45–59.Google ScholarCross Ref
- [17] . 2014. The modular architecture of the Python (P) DEVS simulation kernel. In Proceedings of the 2014 Symposium on Theory of Modeling and Simulation-DEVS. Article 14, 6 pages.
DOI: Google ScholarDigital Library - [18] . 2014. xDEVS: M&S Framework. Retrieved May 20, 2021 from https://github.com/iscar-ucm/xdevs.Google Scholar
- [19] . 1997. The DEVS environment for high-performance modeling and simulation. IEEE Computational Science and Engineering 4, 3 (1997), 61–71.
DOI: Google ScholarDigital Library - [20] . 2004. A high performance simulation engine for large-scale cellular DEVS models. 2004. In Proceedings of the High Performance Computing Symposium (HPC’04). 3–8.Google Scholar
- [21] . 2005. Algorithms for efficient implementations of the DEVS & DSDEVS abstract simulators. In Proceedings of the 1st Open International Conference on Modeling and Simulation (OICMS’05). 273–279.Google Scholar
- [22] . 2015. Sequential PDEVS architecture. In Proceedings of the Symposium on Theory of Modeling and Simulation: DEVS Integrative Symposium. 165–172.
DOI: Google ScholarDigital Library - [23] . 2014. Decentralized approach for efficient simulation of DEVS models. In Proceedings of the IFIP International Conference on Advances in Production Management Systems. 336–343.
DOI: Google ScholarCross Ref - [24] . 2020. A DEVS simulation algorithm based on shared memory for enhancing performance. In Proceedings of the Winter Simulation Conference. IEEE, Los Alamitos, CA.Google ScholarDigital Library
- [25] . 2014. A survey of modelling and simulation software frameworks using Discrete EVent System specification. In Proceedings of the 2014 Imperial College Computing Student Workshop. 40–49.
DOI: Google ScholarCross Ref - [26] . 2017. An evaluation of DEVS simulation tools. Simulation 93, 2 (2017), 103–121.
DOI: Google ScholarCross Ref - [27] . 2017. Reconsidering the performance of DEVS modeling and simulation environments using the DEVStone benchmark. Simulation 93, 6 (2017), 459–476.
DOI: Google ScholarDigital Library - [28] . 1984. Dhrystone: A synthetic systems programming benchmark. Communications of the ACM 27, 10 (1984), 1012–1030.
DOI: Google ScholarDigital Library - [29] . 2018. Probability and Statistical Inference (10th ed.). Pearson/Prentice Hall, Upper Saddle River, NJ.Google Scholar
- [30] . 2020. DEVStone comparative. Retrieved May 20, 2021 from https://github.com/SimulationEverywhere/devstone-comparative.Google Scholar
- [31] . 2017. Simulation-Based Testing of Control Software. Technical Report ORNL/TM-2017/45. Oak Ridge National Laboratory, Oak Ridge, TN.Google ScholarCross Ref
- [32] . 2020. Development of a real-time DEVS kernel: RT-Cadmium. In Proceedings of the 2020 Spring Simulation Conference. IEEE, Los Alamitos, CA.Google ScholarDigital Library
- [33] . 2020. Unit testing platform to verify DEVS models. In Proceedings of the 2020 Summer Simulation Conference. IEEE, Los Alamitos, CA.Google ScholarDigital Library
Index Terms
- The DEVStone Metric: Performance Analysis of DEVS Simulation Engines
Recommendations
Conservative vs. optimistic parallel simulation of DEVS and Cell-DEVS: a comparative study
SCSC '10: Proceedings of the 2010 Summer Computer Simulation ConferenceThe conservative Parallel DEVS protocol offers a novel approach that allows conservative simulation of DEVS-based PDES systems. The protocol is based on the classical Chandy-Misra-Bryant synchronization mechanism, and it extends the DEVS abstract ...
Studying performance of DEVS modeling and simulation environments using the DEVStone benchmark
The Discrete Event System Specification (DEVS) formal modeling and simulation (M&S) framework (which supports hierarchical and modular model composition) has been widely used to understand, analyze and develop a variety of systems. Numerous DEVS ...
Tools for DEVS modeling, simulation and 3D visualization
Simutools '09: Proceedings of the 2nd International Conference on Simulation Tools and TechniquesCell-DEVS is an extension of the DEVS formalism which combines DEVS with Cellular Automata. It is particularly useful for defining spaces by decomposing them into individual cells. The CD++ Toolkit enables one to model and simulate a real or artificial ...
Comments