Skip to main content
SpringerLink
Log in

Online rule fusion model based on formal concept analysis

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

A rule is an effective representation of knowledge in formal concept analysis (FCA), which can express the relations between concepts. One of the main research directions of FCA is to develop rule-based classification algorithms. Rule-based algorithms in FCA lack effective methods for analyze their generalization capability, which can provide an effective learning guarantee for the algorithm. To solve this problem and effectively improve the classification performance of rule-based algorithms in terms of speed and accuracy, this paper combines formal concept analysis with online learning theory to design an online rule fusion model based on FCA, named ORFM. First, the weak granular decision rule is proposed based on rule confidence. Second, the purpose of each iteration is to reduce the difference between the prediction rules extracted from the ORFM and the weak granular decision rules as much as possible so that the classifier model can be adjusted to the direction of the minimum regret growth rate, and the regret growth rate is 0 under the ideal state at the end of iteration. Third, it is proven that the regret of ORFM has an upper bound; that is, in an ideal state, the regret growth rate decreases rapidly with the increase in the number of iterations, eventually making the regret of the model no longer grow. This provides an effective learning guarantee for ORFM. Finally, experimental results on 16 datasets show that ORFM has better classification performance than other classifier models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Wille R (1982) Restructuring theory: an approach based on hierarchies of concepts. Ordered Sets Reidel 83:445–470

    Article  MathSciNet  MATH  Google Scholar 

  2. Ganter B, Wille R (1999) Formal concept analysis: mathematical foundations. Springer, Berlin

    Book  MATH  Google Scholar 

  3. Carpineto C, Romano G (1996) A lattice conceptual clustering system and its application to browsing retrieval. Mach Learn 24(2):95–122

    Article  Google Scholar 

  4. Nguyenp PHP, Corbett D (2006) A basic mathematical framework for conceptual graphs. IEEE Trans Knowl Data Eng 18(2):261–271

    Article  Google Scholar 

  5. Liu Y, Kang XP, Miao DQ et al (2019) A knowledge acquisition method based on concept lattice and inclusion degree for ordered information systems. Int J Mach Learn Cybern 10(11):3245–3261

    Article  Google Scholar 

  6. Guo XR, Liu AJ, Li X et al (2020) Research on the intelligent fault diagnosis of medical devices based on a dematel-fuzzy concept lattice. Int J Fuzzy Syst 5:1–16

    Google Scholar 

  7. Tu XD, Wang YL, Zhang ML et al (2016) Using formal concept analysis to identify negative correlations in gene expression data. IEEE/ACM Trans Comput Biol Bioinform 13(2):380–391

    Article  Google Scholar 

  8. Zou CF, Zhang DQ, Wan JF et al (2017) Using concept lattice for personalized recommendation system design. IEEE Syst J 11(1):305–314

    Article  Google Scholar 

  9. Sampath S, Sprenkle S, Gibson E et al (2007) Applying concept analysis to user-session-based testing of web applications. IEEE Trans Softw Eng 33(10):643–658

    Article  Google Scholar 

  10. Li JH, Mei CL, Wang JH, Zhang X (2014) Rule-preserved object compression in formal decision contexts using concept lattices. Knowl-Based Syst 71:435–445

    Article  Google Scholar 

  11. Li LJ, Mi JS, Xie B (2014) Attribute reduction based on maximal rules in decision formal context. Int J Comput Intell Syst 7(6):1044–1053

    Article  Google Scholar 

  12. Shao MW, Leung L, Wu WZ (2014) Rule acquisition and complexity reduction in formal decision contexts. Int J Approx Reason 55(1):259–274

    Article  MathSciNet  MATH  Google Scholar 

  13. Wei L, Liu L, Qi JJ et al (2020) Rules acquisition of formal decision contexts based on three-way concept lattices. Inf Sci 516:529–544

    Article  MathSciNet  MATH  Google Scholar 

  14. Yang HZ, Yee L, Shao MW (2011) Rule acquisition and attribute reduction in real decision formal contexts. Soft Comput 15(6):1115–1128

    Article  MATH  Google Scholar 

  15. Zhang XY, Wei L, Xu WH (2016) Attributes reduction and rules acquisition in an lattice-valued information system with fuzzy decision. Int J Mach Learn Cybern 8(1):135–147

    Article  Google Scholar 

  16. Li JH, Mei CL, Lv YJ (2011) Knowledge reduction in decision formal contexts. Knowl-Based Syst 24(5):709–715

    Article  MATH  Google Scholar 

  17. Li JH, Wei L, Zhang Z et al (2020) Concept lattice theory and method and their research prospect. Pattern Recognit Artif Intell 33(7):619–642

    Google Scholar 

  18. Chen JK, Mi JS, Xie B et al (2021) Attribute reduction in formal decision contexts and its application to finite topological spaces. Int J Mach Learn Cybern 12(1):39–52

    Article  Google Scholar 

  19. Sêrgio MD, Newton JV (2017) A methodology for analysis of concept lattice reduction. Inf Sci 396:202–217

    Article  MathSciNet  MATH  Google Scholar 

  20. Shao MW, Leung Y, Wang XZ et al (2016) Granular reducts of formal fuzzy contexts. Knowl-Based Syst 114:156–166

    Article  Google Scholar 

  21. Qin KY, Lin H, Jiang Y (2020) Local attribute reductions of formal contexts. Int J Mach Learn Cybern 11(1):81–93

    Article  Google Scholar 

  22. Wang Z, Wei L, Qi J et al (2020) Attribute reduction of SE-ISI concept lattices for incomplete contexts. Soft Comput 20(1):1–16

    MATH  Google Scholar 

  23. Antoni L, Cornejo ME, Medina J et al (2020) Attribute classification and reduct computation in multi-adjoint concept lattices. IEEE Trans Fuzzy Syst 99:1–1

    Google Scholar 

  24. Wu WZ, Leung Y, Mi JS (2009) Granular computing and knowledge reduction in formal contexts. Trans Knowl Data Eng 21(10):1461–1474

    Article  Google Scholar 

  25. Li JH, Mei CL, Lv YJ (2011) A heuristic knowledge-reduction method for decision formal contexts. Comput Math Appl 61:1096–1106

    Article  MathSciNet  MATH  Google Scholar 

  26. Yan EL, Yu CG, Lu LM et al (2021) Incremental concept cognitive learning based on three-way partial order structure. Knowl-Based Syst 5:106898

    Article  Google Scholar 

  27. Zou CF, Deng HF, Wan JF et al (2018) Mining and updating association rules based on fuzzy concept lattice. Future Gener Comput Syst Fgcs 82:698–706

    Article  Google Scholar 

  28. Zou LG, Zhang ZP, Long J (2015) A fast incremental algorithm for constructing concept lattices. Expert Syst Appl 42:4474–4481

    Article  Google Scholar 

  29. Shi Y, Mi YL, Li JH et al (2021) Concept-cognitive learning model for incremental concept learning. IEEE Trans Syst Man Cybern Syst 51(2):809–821

    Article  Google Scholar 

  30. Xu WH, Pang JZ, Luo SQ (2014) A novel cognitive system model and approach to transformation of information granules. Int J Approx Reason 55(3):853–866

    Article  MathSciNet  MATH  Google Scholar 

  31. Niu JJ, Chen DG, Li JH et al (2022) A dynamic rule-based classification model via granular computing. Inf Sci 584:325–341

    Article  Google Scholar 

  32. Xu WH, Li WT (2016) Granular computing approach to two-way learning based on formal concept analysis in fuzzy datasets. IEEE Trans Cybern 46(2):366–379

    Article  MathSciNet  Google Scholar 

  33. Xu WH, Guo DD, Qian YH, Ding WP (2022) Two-way concept-cognitive learning method: a fuzzy-based progressive learning. IEEE Trans Fuzzy Syst. https://doi.org/10.1109/TFUZZ.2022.3216110

    Article  Google Scholar 

  34. Guo DD, Jiang CM, Sheng RX, Liu SS (2022) A novel outcome evaluation model of three-way decision: a change viewpoint. Inf Sci 607:1089–1110

    Article  Google Scholar 

  35. Yuan KH, Xu WH, Li WT, Ding WP (2022) An incremental learning mechanism for object classification based on progressive fuzzy three-way concept. Inf Sci 584:127–147

    Article  Google Scholar 

  36. Kivinen J, Smola AJ, Williamson RC (2004) Online learning with kernels. IEEE Trans Signal Process 52(8):2165–2176

    Article  MathSciNet  MATH  Google Scholar 

  37. Crammer K, Dekel O, Keshet J et al (2006) Online passive-aggressive algorithms. J Mach Learn Res 7(3):551–585

    MathSciNet  MATH  Google Scholar 

  38. Tibshirani R (2011) Regression shrinkage and selection via the lasso: a retrospective. J Royal Stat Soc: Ser B (Stat Methodol) 73(3):267–288

    MathSciNet  MATH  Google Scholar 

  39. Langford J, Li L, Zhang T (2009) Sparse online learning via truncated gradient. J Mach Learn Res 10(2):777–801

    MathSciNet  MATH  Google Scholar 

  40. Duchi J, Singer Y (2009) Efficient online and batch learning using forward backward splitting. J Mach Learn Res 10(18):2899–2934

    MathSciNet  MATH  Google Scholar 

  41. Shwartz S, Singer Y, Srebro N et al (2011) Pegasos: primal estimated sub-gradient solver for SVM. Math Program 127:3–30

    Article  MathSciNet  MATH  Google Scholar 

  42. Bubeck S, Eldan R, Lee YT (2016) Kernel-based methods for bandit convex optimization. ACM STOC pp.72–85

  43. Zhang L, Liu TY, Zhou ZH (2019) Adaptive regret of convex and smooth functions. In Proceedings of the 36th ICML pp.7414-7423

  44. Zhang L, Lu S, Zhou ZH (2018) Adaptive online learning in dynamic environments. Adv Neural Inf Process Syst 31:1323–1333

    Google Scholar 

Download references

Acknowledgements

This work was supported by the National Key R &D Program of China (2020YFB1707802) and National Natural Science Foundation of China (No. 12071131).

Author information

Authors and Affiliations

  1. School of Control and Computer Engineering, North China Electric Power University, Beijing, 102206, Beijing, China

    Xiaohe Zhang

  2. School of Mathematics and Physics, North China Electric Power University, Beijing, 102206, Beijing, China

    Degang Chen

  3. School of Mathematical Sciences, Hebei Normal University, Shijiazhuang, 050024, Hebei, China

    Jusheng Mi

  4. Hebei Key Laboratory of Computational Mathematics and Applications, Hebei Normal University, Shijiazhuang, 050024, Hebei, China

    Jusheng Mi

Authors
  1. Xiaohe Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Degang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jusheng Mi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaohe Zhang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, X., Chen, D. & Mi, J. Online rule fusion model based on formal concept analysis. Int. J. Mach. Learn. & Cyber. 14, 2483–2497 (2023). https://doi.org/10.1007/s13042-023-01777-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-023-01777-x

Keywords

Search

Navigation