Skip to main content
SpringerLink
Log in

Random clustering forest for extended belief rule-based system

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

The extended belief rule-based (EBRB) system is an enhancement of the traditional belief rule-based (BRB) system, which extends the belief distribution of the antecedent attributes. Compared with BRB system, EBRB system has stronger knowledge expression ability. EBRB system uses relational data to generate rules based on traditional belief rule base, which is simple and effective. However, EBRB system needs to traverse all the rules in the rule base and has the problems of inefficiency and inconsistency. Although the existing search optimization methods can solve this problem to some extent, they generally have the shortcomings of insufficient generalization ability. In view of this, this paper proposes a new rule search optimization algorithm based on K-means clustering tree (KMT-EBRB). By combining with the bagging algorithm, an EBRB system based on random clustering forest (RKMF-EBRB) is implemented. To evaluate the performance of the developed model, this paper chooses 12 common UCI datasets for two groups of experiments. Firstly, the properties of EBRB system based on K-means tree and K-means forest are studied, and then the new method is compared with existing methods. The experimental results show that K-means tree can improve the search efficiency of EBRB system, while random K-means clustering forest can further improve the accuracy and stability of EBRB reasoning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  • Abualigah LM, Khader AT (2017) Unsupervised text feature selection technique based on hybrid particle swarm optimization algorithm with genetic operators for the text clustering. J Supercomput 73(11):4773–4795

    Article  Google Scholar 

  • Abualigah LM, Khader AT, Hanandeh ES (2018a) A combination of objective functions and hybrid krill herd algorithm for text document clustering analysis. Eng Appl Artif Intell 73:111–125

    Article  Google Scholar 

  • Abualigah LM, Khader AT, Hanandeh ES (2018b) Hybrid clustering analysis using improved krill herd algorithm. Appl Intell 48(11):4047–4071

    Article  Google Scholar 

  • Abualigah LM, Khader AT, Hanandeh ES (2018c) A new feature selection method to improve the document clustering using particle swarm optimization algorithm. J Comput Sci 25:456–466

    Article  Google Scholar 

  • Abualigah LMQ (2019) Feature selection and enhanced krill herd algorithm for text document clustering. Springer, Berlin

    Book  Google Scholar 

  • Abualigah LMQ, Hanandeh ES (2015) Applying genetic algorithms to information retrieval using vector space model. Int J Comput Sci Eng Appl 5(1):19

    Google Scholar 

  • Breiman L (1996) Bagging predictors. Mach Learn 24(2):123–140

    MATH  Google Scholar 

  • Calzada A, Liu J, Wang H, Kashyap A (2014) A new dynamic rule activation method for extended belief rule-based systems. IEEE Trans Knowl Data Eng 27(4):880–894

    Article  Google Scholar 

  • Chang LL, Zhou Y, Jiang J, Li MJ, Zhang XH (2013) Structure learning for belief rule base expert system: a comparative study. Knowl Based Syst 39:159–172

    Article  Google Scholar 

  • Chang R, Zhang S (2011) An algorithm for training parameters in belief rule-bases based on gradient methods and optimization step size. J North China Inst Water Conserv Hydroelectr Power 1:154–157

    Google Scholar 

  • Chen YW, Yang JB, Xu DL, Zhou ZJ, Tang DW (2011) Inference analysis and adaptive training for belief rule based systems. Expert Syst Appl 38(10):12845–12860

    Article  Google Scholar 

  • Dempster AP (1968) A generalization of Bayesian inference. J Roy Stat Soc Ser B (Methodol) 30(2):205–232

    MathSciNet  MATH  Google Scholar 

  • Frank, Asuncion (2007) UCI machine learning repository. School Computer Science, University California, Los Angeles, 2010

  • Fukunage K, Narendra PM (1975) A branch and bound algorithm for computing k-nearest neighbors. IEEE Trans Comput 24(7):750–753

    Article  Google Scholar 

  • Hahmann S, Miksch J, Resch B, Lauer J, Zipf A (2018) Routing through open spaces-a performance comparison of algorithms. Geo Spat Inf Sci 21(3):247–256

    Article  Google Scholar 

  • Hwang CL, Yoon K (1981) Methods for multiple attribute decision making. In: Multiple attribute decision making. Springer, Berlin, pp 58–191

  • Jiao LM, Pan Q, Denœux T, Liang Y, Feng XX (2015) Belief rule-based classification system: extension of FRBCS in belief functions framework. Inf Sci 309:26–49

    Article  Google Scholar 

  • Lin YQ, Fu YG (2018) A rule activation method for extended belief rule base based on improved similarity measures. J Univ Sci Technol China 48(1):20–27

    MathSciNet  Google Scholar 

  • Lin YQ, Fu YG, Su Q, Wang YM, Gong XT (2017) A rule activation method for extended belief rule base with VP-tree and MVP-tree. J Intell Fuzzy Syst 33(6):3695–3705

    Article  Google Scholar 

  • Liu J, Martinez L, Calzada A, Wang H (2013) A novel belief rule base representation, generation and its inference methodology. Knowl Based Syst 53:129–141

    Article  Google Scholar 

  • MacQueen J et al (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, Oakland, CA, USA, vol 1, pp 281–297

  • Muja M, Lowe DG (2014) Scalable nearest neighbor algorithms for high dimensional data. IEEE Trans Pattern Anal Mach Intell 36(11):2227–2240

    Article  Google Scholar 

  • Rota GC (1977) In: Shafer G (ed) A mathematical theory of evidence. Princeton University Press, 1976, 297 pp

  • Su Q, Yang LH, Fu YG et al (2014) Parameter training approach based on variable particle swarm optimization for belief rule base. J Comput Appl 34(8):2161–2165

    Google Scholar 

  • Su Q, Yang LH, Fu YG, Yu RY (2016) Structure optimization framework of extended belief rule based on BK-tree. J Front Comput Sci Technol 10(2):257–267

    Google Scholar 

  • Sun Z, Ye Y, Deng W, Huang Z (2011) A cluster tree method for text categorization. Procedia Eng 15(1):3785–3790

    Article  Google Scholar 

  • Wang HJ, Yang LH, Fu YG et al (2015) Differential evolution algorithm for parameter training of belief rule base under expert intervention. Comput Sci 42(5):88–93

    Google Scholar 

  • Wang YM, Yang JB, Xu DL, Chin KS (2009) Consumer preference prediction by using a hybrid evidential reasoning and belief rule-based methodology. Expert Syst Appl 36(4):8421–8430

    Article  Google Scholar 

  • Wang YM, Yang LH, Chang LL, Fu YG (2014) Rough set method for rule reduction in belief rule base. Control Decis 29(11):1943–1950

    MATH  Google Scholar 

  • Xu DL, Liu J, Yang JB, Liu GP, Wang J, Jenkinson I, Ren J (2007) Inference and learning methodology of belief-rule-based expert system for pipeline leak detection. Expert Syst Appl 32(1):103–113

    Article  Google Scholar 

  • Yang JB, Liu J, Wang J, Sii HS, Wang HW (2006) Belief rule-base inference methodology using the evidential reasoning approach-RIMER. IEEE Trans Syst Man Cybern Part A Syst Hum 36(2):266–285

    Article  Google Scholar 

  • Yang JB, Liu J, Xu DL, Wang J, Wang H (2007) Optimization models for training belief-rule-based systems. IEEE Trans Syst Man Cybern Part A Syst Hum 37(4):569–585

    Article  Google Scholar 

  • Yang JB, Wang YM, Xu DL, Chin KS, Chatton L (2012) Belief rule-based methodology for mapping consumer preferences and setting product targets. Expert Syst Appl 39(5):4749–4759

    Article  Google Scholar 

  • Yang LH, Cai ZL, Huang ZX, He X, Fu YG (2015a) Belief rule-base inference methodology for predicting probability of taking taxi. J Front Comput Sci Technol 8:985–994

    Google Scholar 

  • Yang LH, Wang XD, Fu YG (2015b) Rule reduction approach to belief rule base using correlation coefficient and standard deviation integrated method. Inf Control 44(1):21–28

    Google Scholar 

  • Yang LH, Wang YM, Su Q, Fu YG, Chin KS (2016) Multi-attribute search framework for optimizing extended belief rule-based systems. Inf Sci 370:159–183

    Article  Google Scholar 

  • Yang LH, Wang YM, Fu YG (2018) A consistency analysis-based rule activation method for extended belief-rule-based systems. Inf Sci 445:50–65

    Article  MathSciNet  Google Scholar 

  • Zadeh LA, Klir GJ, Yuan B (1996) Fuzzy sets, fuzzy logic, and fuzzy systems: selected papers, vol 6. World Scientific, Singapore

    Book  Google Scholar 

  • Zhou ZJ, Yang JB, Hu CH, Xu DL (2011) Belief rule base expert system and complex system modeling. Belief Rule Base Expert Syst Complex Syst Model

Download references

Acknowledgements

This research was supported by the National Natural Science Foundation of China (No. 61773123) and the Natural Science Foundation of Fujian Province, China (No. 2019J01647).

Author information

Authors and Affiliations

  1. College of Mathematics and Computer Science, Fuzhou University, 350116, Fuzhou, Fujian, China

    Nan-Nan Chen, Chun-Yang Zhang & Yang-Geng Fu

  2. Decision Sciences Institute, Fuzhou University, 350116, Fuzhou, Fujian, China

    Xiao-Ting Gong & Ying-Ming Wang

Authors
  1. Nan-Nan Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiao-Ting Gong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ying-Ming Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chun-Yang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yang-Geng Fu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yang-Geng Fu.

Ethics declarations

Conflict of interest

All authors declare that there is no conflict of interests regarding the publication of this manuscript.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Communicated by V. Loia.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, NN., Gong, XT., Wang, YM. et al. Random clustering forest for extended belief rule-based system. Soft Comput 25, 4609–4619 (2021). https://doi.org/10.1007/s00500-020-05467-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-020-05467-6

Keywords

Search

Navigation