Skip to main content
SpringerLink
Log in

Dynamic Feature Selection Based on F-fuzzy Rough Set for Label Distribution Learning

  • Published:
International Journal of Fuzzy Systems Aims and scope Submit manuscript

Abstract

Label distribution learning(LDL) has been received widespread attention as an effective learning paradigm in the field of data mining. However, existing feature selection algorithms for LDL are performed under static conditions or semi-dynamic conditions, and the dynamic information of data is not considered sufficiently. To address these issues, a feature selection algorithm for LDL under dynamic conditions is proposed, which takes full use of dynamic information from data. Specially, a novel rough set model called F-double-fuzzy rough set is created to handle dynamic LDL data, which is extended from F-fuzzy rough set. Then, F-fuzzy-condition entropy is defined to fuse information together in F-double-fuzzy rough set, which is considered as a measure for feature selection. Thirdly, a dynamic feature selection algorithm for LDL is proposed with the F-fuzzy-condition entropy. Fourthly, a novel method of covering set is proposed to simulate dynamic LDL data, and its merits are explained intuitively. At last, experiments on 14 datasets with six widely used metrics demonstrate that the performance of the proposed algorithm has advantages over the state-of-the-art algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Algorithm 1
Algorithm 2
Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. http://palm.seu.edu.cn/xgeng/LDL.

References

  1. Zhao, X.Y., An, Y.X., Xu, N., Geng, X.: Continuous label distribution learning. Pattern Recogn. 133, 109056 (2023)

    Article  Google Scholar 

  2. Geng, X., Xu, N.: Label distribution learning and label enhancement. Sci. China Inf. Sci. 48(5), 521–530 (2018)

    Google Scholar 

  3. Xu, N., Liu, Y.P., Geng, X.: Label distribution learning for label enhancement. IEEE Trans. Knowl. Data Eng. 33(4), 1632–1643 (2021)

    Article  Google Scholar 

  4. Zhang, P.F., Li, T.R., Yuan, Z., Deng, Z.X., et al.: A possibilistic information fusion-based unsupervised feature selection method using information quality measures. IEEE Trans. Fuzzy Syst. 31(9), 2975–2988 (2023)

    Article  Google Scholar 

  5. Zhang, P., Gao, W., Hu, J., Li, Y.: Multi-label feature selection based on the division of label topics. Inf. Sci. 553, 129–153 (2021)

    Article  MathSciNet  Google Scholar 

  6. Li, W.T., Xu, W.H., Zhang, X.Y., Zhang, J.: Updating approximations with dynamic objects based on local multigranulation rough sets in ordered information systems. Artif. Intell. Rev. 55(8), 1821–1855 (2022)

    Article  Google Scholar 

  7. Zhang, P.F., Li, T.R., Yuan, Z., Luo, C., et al.: A data-level fusion model for unsupervised attribute selection in multi-source homogeneous data. Inf. Fus. 80, 87–103 (2022)

    Article  Google Scholar 

  8. Li, D., Gong, L.L., Liu, S.L., Sun, X., Gu, M., Qian, K.: Continual learning classification method with single-label memory cells based on the intelligent mechanism of the biological immune system. J. Intell. Fuzzy Syst. Appl. Eng. Technol. 42(4), 3975–3991 (2022)

    Google Scholar 

  9. Li, R.X., Du, J.X., Ding, J.M., Jia, L.Y., Chen, Y.N., Shang, Z.H.: Semi-supervised multi-label dimensionality reduction learning by instance and label correlations. Mathematics 11(3), 1–25 (2023)

    Article  Google Scholar 

  10. Li, W.T., Deng, C.J., Pedrycz, W., Castillo, O., Zhang, C., Zhan, T.: Double-quantitative feature selection approach for multi-granularity ordered decision systems. IEEE Trans. Artif. Intell. (2023). https://doi.org/10.1109/TPAMI.2022.3219121

    Article  Google Scholar 

  11. Zhang, P.F., Li, T.R., Yuan, Z., Luo, C., et al.: Heterogeneous feature selection based on neighborhood combination entropy. IEEE Trans. Neural Netw. Learn. Syst. (2022). https://doi.org/10.1109/TNNLS.2022.3193929

    Article  Google Scholar 

  12. Zhao, T.N., Zhang, Y.J., Miao, D.Q., Zhang, H.Y.: Multi-granular labels with three-way decisions for multi-label classification. Int. J. Mach. Learn. Cybern. 14, 3737–3752 (2023)

    Article  Google Scholar 

  13. Geng, X.: Label distribution learning. IEEE Trans. Knowl. Data Eng. 28(7), 1734–1748 (2016)

    Article  Google Scholar 

  14. Kou, Y., Lin, G.P., Qian, Y.H., Liao, S.J.: A novel multi-label feature selection method with association rules and rough set. Inf. Sci. 624, 299–323 (2023)

    Article  Google Scholar 

  15. Xu, J.H.: A weighted linear discriminant analysis framework for multi-label feature extraction. Neurocomputing 275, 107–120 (2018)

    Article  Google Scholar 

  16. Wang, C.Z., Wang, Y., Shao, M.W., Qian, Y.H., Chen, D.G.: Fuzzy rough attribute reduction for categorical data. IEEE Trans. Fuzzy Syst. 28(5), 818–830 (2020)

    Article  Google Scholar 

  17. Li, W.T., Zhai, S.C., Xu, W.H., et al.: Feature selection approach based on improved fuzzy c-means with principle of refined justifiable granularity. IEEE Trans. Fuzzy Syst. 31(7), 2112–2126 (2023)

    Article  Google Scholar 

  18. Suo, M.L., Tao, L.F., Zhu, B.L., Chen, Y., Lu, C., Ding, Y.: Soft decision-making based on decision-theoretic rough set and Takagi-Sugeno fuzzy model with application to the autonomous fault diagnosis of satellite power system. Aerosp. Sci. Technol. 106, 1–17 (2020)

    Article  Google Scholar 

  19. Qian, W.B., Xiong, Y.S., Yang, J., Shu, W.H.: Feature selection for label distribution learning via feature similarity and label correlation. Inf. Sci. 582, 38–59 (2022)

    Article  MathSciNet  Google Scholar 

  20. Dai, J., Chen, J.: Feature selection via normative fuzzy information weight with application into tumor classification. Appl. Soft Comput. 92, 106299 (2020)

    Article  Google Scholar 

  21. Yuan, Z., Chen, H.M., Zhang, P.F., Wan, J.H., Li, T.R.: A novel unsupervised approach to heterogeneous feature selection based on fuzzy mutual information. Trans. Fuzzy Syst. 30(9), 3395–3409 (2022)

    Article  Google Scholar 

  22. Yang, X., Chen, H., Li, T., Wang, J., Sang, B.: Neighborhood rough sets with distance metric learning for feature selection. Knowl.-Based Syst. 224, 107076 (2021)

    Article  Google Scholar 

  23. Li, W.T., Wei, Y.L., Xu, W.H.: General expression of knowledge granularity based on a fuzzy relation matrix. Fuzzy Sets Syst. 440, 149–163 (2022)

    Article  MathSciNet  Google Scholar 

  24. Deng, Z.X., Li, T.R., Zhang, F., Deng, D.Y.: Feature selection based on probability and mathematical expectation. Int. J. Mach. Learn. Cybern. 15, 477–491 (2024)

    Article  Google Scholar 

  25. You, D.L., Wang, Y., Xiao, J.W., et al.: Online multi-label streaming feature selection with label correlation. IEEE Trans. Knowl. Data Eng. 35(3), 2901–2915 (2023)

    Article  Google Scholar 

  26. Gao, W.F., Pan, H.L.: Multi-label feature selection based on min-relevance label. IEEE Access 11, 410–420 (2023)

    Article  Google Scholar 

  27. L.Li, F.Liu, J.P.Huang, A label similarity attention mechanism for multi-label emotion recognition. In: 2022 3rd International Conference on Electronic Communication and Artificial Intelligence(IWECAI) pp. 392-396 (2022)

  28. Hu, L., Gao, L., Li, Y., Zhang, P., Gao, W.: Feature-specific mutual information variation for multi-label feature selection. Inf. Sci. 593, 449–471 (2022)

    Article  Google Scholar 

  29. Xiong, C.Z., Qian, W.B., Wang, Y.L., Huang, J.T.: Feature selection based on label distribution and fuzzy mutual information. Inf. Sci. 574, 297–319 (2021)

    Article  MathSciNet  Google Scholar 

  30. Li, F., Miao, D.Q., Pedrycz, W.: Granular multi-label feature selection based on mutual information. Pattern Recogn. 67, 410–423 (2017)

    Article  Google Scholar 

  31. Li, W.T., Zhan, T.: Multi-granularity probabilistic rough fuzzy sets for interval-valued fuzzy decision systems. Int. J. Fuzzy Syst. 25(8), 3061–3073 (2023)

    Article  Google Scholar 

  32. Li, W.T., Zhou, H.X., Xu, W.H., Wang, X.Z., Pedrycz, W.: Interval dominance-based feature selection for interval-valued ordered data. IEEE Trans. Neural Netw. Learn. Syst. 34(10), 6898–6912 (2023)

    Article  MathSciNet  Google Scholar 

  33. Huang, Z.H., Li, J.J.: Multi-level granularity entropies for fuzzy coverings and feature subset selection. Artif. Intell. Rev. 56, 12171–12200 (2023)

    Article  Google Scholar 

  34. Wang, Y.Y., Dai, J.H.: Label distribution feature selection based on mutual information in fuzzy rough set theory. In: 2019 International Joint Conference on Neural Networks(IJCNN) pp. 1-2 (2019)

  35. Wang, C.Z., Qian, Y.H., Ding, W.P., Fan, X.D.: Feature selection with fuzzy-rough minimum classification error criterion. Trans. Fuzzy Syst. 30(8), 2930–2942 (2022)

    Article  Google Scholar 

  36. Zhang, X., Mei, C.L., Li, J.H., Yang, Y.Y., Qian, T.: Instance and feature selection using fuzzy rough sets: a bi-selection approach for data reduction. Trans. Fuzzy Syst. 31(6), 1981–1994 (2023)

    Article  Google Scholar 

  37. Qian, W.B., Huang, J.T., Wang, Y.L., Shu, W.H.: Mutual information-based label distribution feature selection for multi-label learning. Knowl.-Based Syst. 195, 105684 (2020)

    Article  Google Scholar 

  38. Liu, J.H., Lin, Y.J., Ding, W.P., Zhang, H.B., Wang, C., Du, J.X.: Multi-label feature selection based on label distribution and neighborhood rough set. Neurocomputing 524, 142–157 (2023)

    Article  Google Scholar 

  39. Qian, W.B., Long, X.D., Wang, Y.L., Xie, Y.H.: Multi-label feature selection based on label distribution and feature complementarity. Appl. Soft Comput. 90, 106167 (2020)

    Article  Google Scholar 

  40. Deng, D.Y., Xu, X.Y., Pei, M.H.: Fuzzy rough set and its simplification. J. Zhejiang Normal Univ.(Nat. Sci.) 38(1), 58–66 (2015)

    Google Scholar 

  41. Deng, Z.X., Zheng, Z.L., Deng, D.Y.: F-neighborhood rough set and their approximation. IEEE/CAA J. Automatica Sinica 47(3), 695–705 (2021)

    Google Scholar 

  42. Deng, Z.X., Li, T.R., Deng, D.Y., Liu, K.Y., Zhang, P.F., Zhang, S.M., Luo, Z.P.: Feature selection for label distribution learning using dual-similarity based neighborhood fuzzy entropy. Inf. Sci. 615, 385–404 (2022)

    Article  Google Scholar 

  43. Zhang, X., Mei, C.L., Chen, D.G., Yang, Y.Y.: Active incremental feature selection using a fuzzy-rough-set-based information entropy. IEEE Trans. Fuzzy Syst. 28(5), 901–915 (2020)

    Article  Google Scholar 

  44. Eisen, M.B., Spellman, P.T., Brown, P.O., Botstein, D.: Cluster analysis and display of genome-wide expression patterns. Proc. Natl. Acad. Sci. U.S.A. 95(25), 14863–14868 (1998)

    Article  Google Scholar 

  45. Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)

    Article  Google Scholar 

  46. Lee, J., Lim, H., Kim, D.W.: Approximating mutual information for multi-label feature selection. Electron. Lett. 48, 929–930 (2012)

    Article  Google Scholar 

  47. Lee, J., Kim, D.W.: Mutual information-based multi-label feature selection using interaction information. Expert Syst. Appl. 42(4), 2013–2025 (2015)

    Article  Google Scholar 

  48. Lee, J., Kim, D.W.: Feature selection for multi-label classification using multivariate mutual information. Pattern Recogn. Lett. 34(3), 349–357 (2013)

    Article  Google Scholar 

  49. Lee, J., Kim, D.W.: Scls: multi-label feature selection based on scalable criterion for large label set. Pattern Recogn. 66, 342–352 (2017)

    Article  MathSciNet  Google Scholar 

  50. Zhang, J., Luo, Z., Li, C., Zhou, C., Li, S.: Manifold regularized discriminative feature selection for multi-label learning. Pattern Recogn. 95, 136–150 (2019)

    Article  Google Scholar 

  51. Zhang, J., Lin, Y., Jiang, M., Li, S., Tan, K.C.: Multi-label feature selection via global relevance and redundancy optimization. In: Twenty-Ninth International Joint Conference on Artificial Intelligence and Seventeenth Pacific Rim International Conference on Artificial Intelligence IJCAI-PRICAI-20 (2020)

  52. Wang, J.Q.: Models and algorithms for the set coverage problem. Comput. Eng. Appl. 49(17), 15–17 (2013)

    Google Scholar 

  53. Darzi, E.E.L., Mitra, G.: Set covering and set partitioning: a collection of test problems. Omega 18(2), 195–201 (1990)

    Article  Google Scholar 

  54. Friedman, M.: A comparison of alternative tests of significance for the problem of m rankings. Ann. Math. Stat. 11(1), 86–92 (1940)

    Article  MathSciNet  Google Scholar 

  55. Demiar, J., Schuurmans, D.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7(1), 1–30 (2006)

    MathSciNet  Google Scholar 

Download references

Acknowledgements

This work was supported by the Postdoctoral Fellowship Program of CPSF (Nos.GZB20230092, GZB20230091), the China Postdoctoral Science Foundation (Nos.2023M740383, 2023M730378, 2023MD744127), the Natural Science Foundation of Sichuan Province (No.24NSFSC1654).

Author information

Authors and Affiliations

  1. Xingzhi College, Zhejiang Normal University, Lanxi, 321100, China

    Dayong Deng

  2. School of Computer Science and Technology (School of Artificial Intelligence), Zhejiang Normal University, Jinhua, 321004, China

    Dayong Deng & Tong Chen

  3. Zhejiang Province Intelligent Education Technology and Application Key Laboratory, School of Computer, Zhejiang Normal University, Jinhua, 321004, China

    Dayong Deng

  4. School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu, 611756, China

    Zhixuan Deng

  5. School of Computer, Jiangsu University of Science and Technology, Zhenjiang, 212100, China

    Keyu Liu

  6. School of Intelligent Medicine, Chengdu University of Traditional Chinese Medicine, Chengdu, 611137, China

    Pengfei Zhang

Authors
  1. Dayong Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tong Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhixuan Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Keyu Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Pengfei Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Zhixuan Deng or Pengfei Zhang.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Deng, D., Chen, T., Deng, Z. et al. Dynamic Feature Selection Based on F-fuzzy Rough Set for Label Distribution Learning. Int. J. Fuzzy Syst. (2024). https://doi.org/10.1007/s40815-024-01715-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s40815-024-01715-1

Keywords

Search

Navigation