Abstract
Cyber-Physical Systems (CPS) are integral components of modern, interconnected environments, playing a crucial role in various applications such as smart infrastructure and autonomous systems. These systems operate in complex and ever-evolving settings, where resilience is an essential characteristic. Recently, several Machine Learning (ML) techniques have been proposed to design and implement resilience in CPS. However, this approach has often prioritized performance gains and adaptability enhancements, leading to a disregard for the potential dangers linked to centralized data processing, including data breaches and privacy infringements. To harness the full potential of ML in CPS, this paper introduces a distributed intelligence framework that equally prioritizes security, data privacy, and adaptability. The proposed framework is implemented through the integration of Federated Machine Learning techniques, where the CPS architecture is decentralized, allowing data processing to occur locally on individual nodes or devices. This decentralized approach facilitates the aggregation of insights from multiple sources without the need for centralized data processing, thereby minimizing the risks associated with data breaches and privacy violations. We further validate the viability of the proposed framework through its successful implementation in a real-world industrial CPS application, specifically focused on fault prediction within industrial CPS environments. In addition to its privacy and security benefits, our approach also achieved promising results in terms of accuracy and precision.
Similar content being viewed by others
References
Al Faruque, M., Regazzoni, F., Pajic, M.: Design methodologies for securing cyber-physical systems. In 2015 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ ISSS), pages 30–36. IEEE, (2015)
Awad, M., Khanna, R.: Efficient learning machines: theories, concepts, and applications for engineers and system designers. Springer, Cham (2015)
Azeri, N., Hioual, O., Hioual, O.: Towards an approach for modeling and architecting of self-adaptive cyber-physical systems. In 2022 4th International Conference on Pattern Analysis and Intelligent Systems (PAIS), pages 1–7. IEEE, (2022)
Azeri, N., Zouikri, Z., Rezgui, M., Hioual, O., Hioual, O.: Fault prediction using supervised and unsupervised learning algorithms in cyber physical systems. In 2022 2nd International Conference on New Technologies of Information and Communication (NTIC), pages 1–6. IEEE, (2022)
Babouche, S., Ouchani, S., Zghal, M. et al.: An adaptive attack prediction framework in cyber-physical systems. In 2022 Ninth International Conference on Software Defined Systems (SDS), pages 1–7. IEEE, (2022)
Bauer, M., Bui, N., De Loof, J., Magerkurth, C., Nettsträter, A., Stefa, J., Walewski, J.W.: Iot reference model. Enabling things to talk: designing IoT solutions with the IoT architectural reference model, pp. 113–162, (2013)
Carvalho, T.P., Soares, F.A.A.M.N., Vita, R., Francisco, Rd.P., Basto, J.P., Alcalá, S.G.S.: A systematic literature review of machine learning methods applied to predictive maintenance. Comput. Indust. Eng. 137, 106024 (2019)
Dafflon, B., Moalla, N., Ouzrout, Y.: The challenges, approaches, and used techniques of cps for manufacturing in industry 4.0: a literature review. Int. J. Adv. Manuf. Technol. 113, 2395–2412 (2021)
Diaz-Rozo, Javier, Bielza, Concha, Larrañaga, Pedro: Machine learning-based cps for clustering high throughput machining cycle conditions. Procedia Manufacturing 10, 997–1008 (2017)
Gerostathopoulos, Ilias, Skoda, Dominik, Plasil, Frantisek, Bures, Tomas, Knauss, Alessia: Tuning self-adaptation in cyber-physical systems through architectural homeostasis. J. Syst. Softw. 148, 37–55 (2019)
Graß, A., Beecks, C., Soto, J.A.C.: Unsupervised anomaly detection in production lines. In Machine learning for cyber physical systems: selected papers from the International Conference ML4CPS 2018, pp. 18–25. Springer, (2019)
Habibi, M.R., Baghaee, H.R., Dragičević, T., Blaabjerg, F.: Detection of false data injection cyber-attacks in dc microgrids based on recurrent neural networks. IEEE J. Emerg. Selected Topics Power Electron. 9(5), 5294–5310 (2020)
Jahromi, A.N., Karimipour, H., Dehghantanha, A., Choo, K.-K.R.: Toward detection and attribution of cyber-attacks in IoT-enabled cyber-physical systems. IEEE Internet Things J. 8(17), 13712–13722 (2021)
Keshk, M., Moustafa, N., Sitnikova, E., Turnbull, B.: Privacy-preserving big data analytics for cyber-physical systems. Wireless Networks, pp. 1–9, (2022)
Khan, W.Z., Ahmed, E., Hakak, S., Yaqoob, I., Ahmed, A.: Edge computing: a survey. Future Gen. Comput. Syst. 97, 219–235 (2019)
Kwon, S., Yoo, H., Shon, T.: Ieee 1815.1-based power system security with bidirectional rnn-based network anomalous attack detection for cyber-physical system. IEEE Access, 8:77572–77586, (2020)
Lesch, Veronika, Züfle, Marwin, Bauer, André, Iffländer, Lukas, Krupitzer, Christian, Kounev, Samuel: A literature review of IoT and cps-what they are, and what they are not. J. Syst. Softw. 200, 111631 (2023)
Liu, Ji., Huang, Jizhou, Zhou, Yang, Li, Xuhong, Ji, Shilei, Xiong, Haoyi, Dou, Dejing: From distributed machine learning to federated learning: a survey. Know. Inform. Syst. 64(4), 885–917 (2022)
Matzka, S.: Explainable artificial intelligence for predictive maintenance applications. In 2020 third international conference on artificial intelligence for industries (ai4i), pp. 69–74. IEEE, (2020)
McMahan, B., Moore, E., Ramage, D., Hampson, S., y Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics, pp. 1273–1282. PMLR, (2017)
Merabet, F.Z., Benmerzoug, D.: Qos prediction for service selection and recommendation with a deep latent features autoencoder. Comput. Sci. Inform. Syst. 19(2), 709–733 (2022)
Muccini, H., Sharaf, M., Weyns, D.: Self-adaptation for cyber-physical systems: a systematic literature review. In Proceedings of the 11th international symposium on software engineering for adaptive and self-managing systems, pp. 75–81, (2016)
Nayak, O., Lachure, J., Doriya, R.: Fog enabled cyber-physical attack detection using ensemble machine learning. In 2022 1st International Conference on Sustainable Technology for Power and Energy Systems (STPES), pp. 1–6. IEEE, (2022)
Papadopoulos, P., Abramson, W., Hall, A.J., Pitropakis, N., Buchanan, W.J.: Privacy and trust redefined in federated machine learning. Machine Learn. Knowl. Extr. 3(2), 333–356 (2021)
Ryalat, M., ElMoaqet, H., AlFaouri, M.: Design of a smart factory based on cyber-physical systems and internet of things towards industry 4.0. Appl. Sci. 13(4), 2156 (2023)
Sabatucci, L., Seidita, V., Cossentino, M.: The four types of self-adaptive systems: a metamodel. In Intelligent Interactive Multimedia Systems and Services 2017 10, pp. 440–450. Springer, (2018)
Samad, T.: Human-in-the-loop control and cyber–physical–human systems: applications and categorization. Cyber–Physical–Human Systems: Fundamentals and Applications, pp. 1–23, (2023)
Sunyaev, A., Sunyaev, A.: Cloud computing. Internet computing: principles of distributed systems and emerging internet-based technologies, pp. 195–236, (2020)
TFF. Tensorflow federated: Machine learning on decentralized data, (2023). https://www.tensorflow.org/federated
Wong, K.-S., Nguyen-Duc, M., Le-Huy, K., Ho-Tuan, L., Do-Danh, C., Le-Phuoc, D.: An empirical study of federated learning on iot-edge devices: Resource allocation and heterogeneity. arXiv preprint arXiv:2305.19831, (2023)
Wu, M., Song, Z., Moon, Y.B.: Detecting cyber-physical attacks in cybermanufacturing systems with machine learning methods. J. Intell. Manuf. 30, 1111–1123 (2019)
Acknowledgements
The author would like to thank the anonymous reviewers for their valuable comments and suggestions, which were helpful in improving the paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Azeri, N., Hioual, O. & Hioual, O. A distributed intelligence framework for enhancing resilience and data privacy in dynamic cyber-physical systems. Cluster Comput (2024). https://doi.org/10.1007/s10586-024-04349-y
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10586-024-04349-y