Skip to main content
SpringerLink
Log in

PerMl-Fed: enabling personalized multi-level federated learning within heterogenous IoT environments for activity recognition

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Federated Learning (FL) has emerged as a promising approach to addressing issues related to centralized machine learning such as data privacy, security and access. Nevertheless, it also brings new challenges incurred by heterogeneity among data statistical levels, devices and models in the context of multi-level federated learning (MlFed) architecture. In this paper, we conceive a new Personalized Multi-level Federated Learning (PerMl-Fed) framework, which extends existing MlFed architecture with three specialized personalized FL methods to address the three challenges. Specially, we design a Transfer Multi-level Federated Learning (TrMlFed) model to mitigate statistical heterogeneity across multiple layers of FL. We propose an Asynchronous Multi-level Federated Learning (AsMlFed) approach which allows asynchronous update in MlFed, thus alleviating device heterogeneity. We develop a Deep Mutual Multi-level Federated Learning (DmMlFed) method based on the concept of deep mutual learning to tackle model heterogeneity. We evaluate the PerMl-Fed framework and associated technologies on the public Wireless Sensor Data Mining (WISDM) dataset. Initial results demonstrate improved average accuracy of 7\(\%\) and achieves accuracy ranging from 84 to 92\(\%\) across eight different hierarchical group structures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Algorithm 1
Algorithm 2
Algorithm 3
Algorithm 4
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data availability

Enquiries about data availability should be directed to the authors.

References

  1. Tessa, S., Katrien, W., Søren B., et al.: Physical activity surveillance through smartphone apps and wearable trackers: examining the uk potential for nationally representative sampling. JMIR mHealth uHealth 7(1), e11898 (2019)

    Article  PubMed  PubMed Central  Google Scholar 

  2. Yiqiang, C., Xin, Q., Jindong, W., Yu C., Wen, G.: Fedhealth: a federated transfer learning framework for wearable healthcare. IEEE Intell. Syst. 35(4), 83–93 (2020)

    Article  Google Scholar 

  3. Ramamurthy, SR., Roy, N.: Recent trends in machine learning for human activity recognition-a survey. Wiley Interdiscipl. Rev. Data Min. Knowl. Discov. 8(4), e1254 (2018)

  4. Weiss, GM., Timko, JL., Gallagher, CM., Yoneda, K., Schreiber, AJ.: Smartwatch-based activity recognition: a machine learning approach. In 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), pp. 426–429. IEEE, (2016)

  5. Nithya, N., Nallavan, G.: Role of wearables in sports based on activity recognition and biometric parameters: a survey. In 2021 International Conference on Artificial Intelligence and Smart Systems (ICAIS), pp. 1700–1705. IEEE, (2021)

  6. Avci, A., Bosch, S., Marin-Perianu, M., Marin-Perianu, R., Havinga, P.: Activity recognition using inertial sensing for healthcare, wellbeing and sports applications: A survey. In 23th International conference on architecture of computing systems 2010, pp. 1–10. VDE, (2010)

  7. Amir, N., Ahmad, J., Kibum, K.: Accurate physical activity recognition using multidimensional features and markov model for smart health fitness. Symmetry 12(11), 1766 (2020)

    Article  ADS  Google Scholar 

  8. Ali, C., Matthias, P.: A machine learning approach for fall detection and daily living activity recognition. IEEE Access 7, 38670–38687 (2019)

    Article  Google Scholar 

  9. Sarah, F., Liming, C.: Computational sleep behavior analysis: a survey. IEEE Access 7, 142421–142440 (2019)

    Article  Google Scholar 

  10. Subasi, A., Khateeb, K., Brahimi, T., Sarirete, A.: Human activity recognition using machine learning methods in a smart healthcare environment. In Innovation in health informatics, pp. 123–144. Elsevier (2020)

  11. Zahin, A., Tan, LT., Hu, RQ.: Sensor-based human activity recognition for smart healthcare: a semi-supervised machine learning. In International conference on artificial intelligence for communications and networks, pp. 450–472. Springer (2019)

  12. Kaixuan, C., Dalin, Z., Lina, Y., Bin, G., Yu, Z., Yunhao, L.: Deep learning for sensor-based human activity recognition: overview, challenges, and opportunities. ACM Comput. Surv. (CSUR) 54(4), 1–40 (2021)

    Google Scholar 

  13. Ramanujam, E., Perumal, T., Padmavathi, S.: Human activity recognition with smartphone and wearable sensors using deep learning techniques: a review. IEEE Sens. J. 21(12), 13029–13040 (2021)

  14. Voigt, P., Bussche, AV.: The eu general data protection regulation (gdpr). a Practical Guide, 1st Ed., Cham: Springer, 10(3152676), 10–5555 (2017)

  15. Ismini, P., Liming, C., Oliver, A.: Privacy risk awareness in wearables and the internet of things. IEEE Pervasive Comput. 19(3), 60–66 (2020)

    Article  Google Scholar 

  16. McMahan, HB., Moore, E., Ramage, D., Arcas, BA.: Federated learning of deep networks using model averaging. arXiv preprint arXiv:1602.05629, 2, (2016)

  17. Konečnỳ, J., McMahan, HB., Ramage, D., Richtárik, P.: Federated optimization: distributed machine learning for on-device intelligence. arXiv preprint arXiv:1610.02527, (2016)

  18. Liu, L., Zhang, J., Song, SH., Letaief, KB.: Client-edge-cloud hierarchical federated learning. In ICC 2020-2020 IEEE International Conference on Communications (ICC), pp. 1–6. IEEE, (2020)

  19. Ren, J., Ni, W., Nie, G., Tian, H. Research on resource allocation for efficient federated learning. arXiv preprint arXiv:2104.09177, (2021)

  20. Mhaisen, N., Abdellatif, AA., Mohamed, A., Erbad, A., Guizani, M.: Optimal user-edge assignment in hierarchical federated learning based on statistical properties and network topology constraints. IEEE Transact. Netw. Sci. Eng. 9(1), 55–66 (2021)

  21. Oscar, LD., Miguel, LA.: A survey on human activity recognition using wearable sensors. IEEE Commun. Surv. Tutor. 15(3), 1192–1209 (2012)

    Article  Google Scholar 

  22. Chen, L., Hoey, J., Nugent, CD., Cook, DJ., Yu, Z.: Sensor-based activity recognition. IEEE Transact. Syst. Man Cybern. 42(6), 790–808 (2012)

  23. Hong, YJ., Kim, IJ., Ahn, SC., Kim, HG.: Mobile health monitoring system based on activity recognition using accelerometer. Simul. Model. Pract. Theory, 18(4), 446–455, (2010)

  24. Okeyo, G., Chen, L., Wang, H., Sterritt, R.: Ontology-based learning framework for activity assistance in an adaptive smart home. Activity recognition in pervasive intelligent environments, pp. 237–263, (2011)

  25. Xing, Su., Hanghang, T., Ping, J.: Activity recognition with smartphone sensors. Tsinghua science and technology 19(3), 235–249 (2014)

    Article  ADS  Google Scholar 

  26. Simon, C., Meessen, J., Vleeschouwer, CD.: Using decision trees to recognize visual events. In Proceedings of the 1st ACM workshop on Analysis and retrieval of events/actions and workflows in video streams, pp. 41–48, (2008)

  27. Wang, X., Ji, Q.: Learning dynamic bayesian network discriminatively for human activity recognition. In Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), pp. 3553–3556. IEEE, (2012)

  28. Tahir, SB., Jalal, A., Batool, M.: Wearable sensors for activity analysis using smo-based random forest over smart home and sports datasets. In 2020 3rd International Conference on Advancements in Computational Sciences (ICACS), pp. 1–6. IEEE, (2020)

  29. Xu, W., Pang, Y., Yang, Y., Liu, Y.: Human activity recognition based on convolutional neural network. In 2018 24th international conference on pattern recognition (ICPR), pp. 165–170. IEEE, (2018)

  30. Sannara, Ek., Portet, F., Lalanda, P., Vega. G.: Evaluation of federated learning aggregation algorithms: application to human activity recognition. In Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers, pp. 638–643, (2020)

  31. Arikumar, KS., Prathiba, SB., Alazab, M., Gadekallu, TR., Pandya, S., Khan, JS., Moorthy, RS. Fl-pmi: federated learning-based person movement identification through wearable devices in smart healthcare systems. Sensors 22(4), 1377 (2022)

  32. Yang, L., Yan, K., Chaoping, X., Tianjian, C., Qiang, Y.: A secure federated transfer learning framework. IEEE Intell. Syst. 35(4), 70–82 (2020)

    Article  Google Scholar 

  33. Jeong, E., Oh, S., Kim, H., Park, J., Bennis, M., Kim, SL.: Communication-efficient on-device machine learning: Federated distillation and augmentation under non-iid private data. arXiv preprint arXiv:1811.11479, 2018

  34. Zhu, Z., Hong, J., Zhou, J.: Data-free knowledge distillation for heterogeneous federated learning. In International Conference on Machine Learning, pp. 12878–12889. PMLR, (2021)

  35. Abad, MSH., Ozfatura, E., Gunduz, D., Ercetin, O. Hierarchical federated learning across heterogeneous cellular networks. In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 8866–8870. IEEE, (2020)

  36. Wang, J., Wang, S., Chen, RR., Ji, M., Local averaging helps: hierarchical federated learning and convergence analysis. arXiv preprint arXiv:2010.12998, (2020)

  37. Luo, S., Chen, XU., Wu, Q., Zhi, Z., Yu. S.: Hfel: Joint edge association and resource allocation for cost-efficient hierarchical federated edge learning. IEEE Transact. Wirel. Commun. 19(10), 6535–6548 (2020)

    Article  Google Scholar 

  38. McMahan, B., Moore, E., Ramage, D., Hampson, S., Arcas, BA. Communication-efficient learning of deep networks from decentralized data. Artif. Intell. Stat. pp. 1273–1282. PMLR, (2017)

  39. Lo, SN., Lu, Q., Wang, C., Paik, Y., Zhu, L.: A systematic literature review on federated machine learning: from a software engineering perspective. ACM Comput. Surv. 54(5), 1–39 (2021)

  40. Wei, K., Li, J., Ding, M., Ma, C., Yang, HH., Farokhi, F., Jin, S., Quek, TQS., Poor. HV.: Federated learning with differential privacy: algorithms and performance analysis. IEEE Trans. Inform. Forensics Secur. 15, 3454–3469 (2020)

  41. Zhang, C., Li, S., Xia, J., Wang, W., Yan, F., Liu, Y.: \(\{\)BatchCrypt\(\}\): Efficient homomorphic encryption for \(\{\)Cross-Silo\(\}\) federated learning. In 2020 USENIX annual technical conference (USENIX ATC 20), pp. 493–506, (2020)

  42. Wang, S., Lee, M., Hosseinalipour, S., Morabito, R., Chiang, M., Brinton. CG.: Device sampling for heterogeneous federated learning: Theory, algorithms, and implementation. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications, p. 1–10. IEEE, (2021)

  43. Chang, Z., Xiangzhu, M., Qiang, L., Wu., S., Liang, W., Huansheng, N.: Fedbrain: A robust multi-site brain network analysis framework based on federated learning for brain disease diagnosis. Neurocomputing 559, 126791 (2023)

    Article  Google Scholar 

  44. Zhang, Y., Xiang, T., Hospedales, TM., Lu, H.: Deep mutual learning. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4320–4328, (2018)

  45. Qianming, X., Wei, Z., Hongyuan, Z.: Improving domain-adapted sentiment classification by deep adversarial mutual learning. In Proceedings of the AAAI Conference on Artificial Intelligence 34, 9362–9369 (2020)

    Article  Google Scholar 

  46. Shen, T., Zhang, J., Jia, X., Zhang, F., Huang, G., Zhou, P., Kuang, K., Wu, F., Wu, C.: Federated mutual learning. arXiv preprint arXiv:2006.16765, (2020)

  47. Kwapisz, JR., Weiss, GM., Moore, SA..: Activity recognition using cell phone accelerometers. ACM SigKDD Explor. Newslett. 12(2), 74–82, (2011)

  48. Qiang, Y., Yang, L., Tianjian, C., Yongxin, T.: Federated machine learning: concept and applications. ACM Transact. Intell. Syst. Technol. 10(2), 1–19 (2019)

    Article  Google Scholar 

  49. Mahesh, P.: Random forest classifier for remote sensing classification. Int. J. Remote Sens. 26(1), 217–222 (2005)

    Article  ADS  Google Scholar 

  50. Noble, WS.: What is a support vector machine? Nat. Biotechnol. 24(12), 1565–1567 (2006)

  51. Min-Ling, Z., Zhi-Hua, Z.: Ml-knn: a lazy learning approach to multi-label learning. Pattern recognit. 40(7), 2038–2048 (2007)

    Article  ADS  Google Scholar 

  52. Albawi, S., Mohammed, TA., Al-Zawi, S.: Understanding of a convolutional neural network. In 2017 international conference on engineering and technology (ICET), pp. 1–6. Ieee, (2017)

Download references

Funding

The authors have not disclosed any funding.

Author information

Authors and Affiliations

  1. School of Computer and Communication Engineering, University of Science and Technology Beijing, Haidian District, Beijing, 100083, China

    Chang Zhang, Hangxing Wu & Huansheng Ning

  2. School of Computer, University of South China, Hunan Medical Big Data International Sci. &Tech. Innovation Cooperation Base, Hengyang, 421001, China

    Tao Zhu

Authors
  1. Chang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tao Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hangxing Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Huansheng Ning
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Chang Zhang: Methodology, Data curation, Writing - original draft. Tao Zhu: Methodology, Software, Data curation. Hangxing Wu: Supervision. Huansheng Ning: Writing - revicwing & editing.

Corresponding author

Correspondence to Hangxing Wu.

Ethics declarations

Competing interests

The authors have not disclosed any competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, C., Zhu, T., Wu, H. et al. PerMl-Fed: enabling personalized multi-level federated learning within heterogenous IoT environments for activity recognition. Cluster Comput (2024). https://doi.org/10.1007/s10586-024-04289-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10586-024-04289-7

Keywords

Search

Navigation