Skip to main content
Log in

Hierarchical fuzzy design by a multi-objective evolutionary hybrid approach

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

This paper presents a new tree hierarchical representation of type-2 fuzzy systems. The proposed system is called the type-2 hierarchical flexible beta fuzzy system (T2HFBFS) and is trained based on two-phase optimization mechanism. The first optimization step is a multi-objective structural learning phase. This phase is based on the multi-objective extended immune programming algorithm and aims to obtain an improved T2HFBFS structure with good interpretability-accuracy trade-off. The second optimization step is a parameter tuning phase. Using a hybrid evolutionary algorithm, this phase allows the adjustment of antecedent and consequent membership function parameters of the obtained T2HFBFS. By interleaving the two learning steps, an optimal and accurate hierarchical type-2 fuzzy system is derived with the least number of possible rules. The performance of the system is evaluated by conducting case studies for time series prediction problems and high-dimensional classification problems. Results prove that the T2HFBFS could attain superior performance than other existing approaches in terms of achieving high accuracy with a significant rule reduction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  • Aliev RA, Guirimov BG, Aliev RR (2009) Evolutionary algorithm-based learning of fuzzy neural networks, part 2: recurrent fuzzy neural networks. Fuzzy Set Syst 160(17):2553–2566

    MathSciNet  MATH  Google Scholar 

  • Alimi AM (1997) Beta fuzzy basis functions for the design of universal robust neuro-fuzzy controllers. In: Proceeding of Séminaire sur la Commande Robuste ses Applications: SCRA’97, Nabeul, Tunisia, pp C1–C5

  • Alimi AM (2000) The beta system: toward a change in our use of neuro-fuzzy systems. Int J Manag 15–19

  • Alimi AM (2003) Beta neuro-fuzzy systems. TASK Q J Spec Issue Neural Netw 7(1):23–41

    Google Scholar 

  • Almaraashi M, John R (2011) Tuning of type-2 fuzzy systems by simulated annealing to predict time series. In: Proceedings of the world congress on engineering, London, UK, vol 2, pp 976–980

  • Almaraashi M, John R, Hopgood A, Ahmadi S (2016) Learning of interval and general type-2 fuzzy logic systems using simulated annealing: theory and practice. Inf Sci 360:21–42

    Google Scholar 

  • Ammar M, Bouaziz S, Alimi AM, Abraham A (2013) Hybrid harmony search algorithm for global optimization. In: Fifth world congress on nature and biologically inspired computing, pp 69–75, Fargo, USA

  • Ayat S, Rahi M (2014) Application of ant colony algorithm and principal components analysis in the diagnosis of lung cancer. J Math Comput Sci (JMCS) 13:343–352

    Google Scholar 

  • Balazs K, Botzheim J, Koczy LT (2010) Hierarchical fuzzy system modeling by genetic and bacterial programming approaches. In: International conference on fuzzy systems, pp 1–6. IEEE

  • Benítez AD, Casillas J (2013) Multi-objective genetic learning of serial hierarchical fuzzy systems for large-scale problems. Soft Comput 17(1):165–194

    Google Scholar 

  • Bouaziz S, Alimi AM, Abraham A (2013) Evolving flexible beta basis function neural tree for nonlinear systems. In: The 2013 international joint conference on neural networks (IJCNN), pp 1–8, Dallas, Texas

  • Bouaziz S, Dhahri H, Alimi AM, Abraham A (2016) Evolving flexible beta basis function neural tree using extended genetic programming & hybrid Artificial Bee Colony. Appl Soft Comput 47:653–668

    Google Scholar 

  • Boutleux E, Dubuisson B (1996) Fuzzy pattern recognition to characterize evolutionary complex systems. Application to the French telephone network. In: The fifth IEEE international conference on fuzzy systems fuzz-IEEE ‘96, vol 2, pp 780–785

  • Box GEP, Jenkins GM (1976) Time series analysis forecasting and control. Holden Day, San Francisco

    MATH  Google Scholar 

  • Chellapilla K (1998) Evolving computer programs without subtree crossover. IEEE Trans Evol Comput 1(3):209–216

    Google Scholar 

  • Chen Y, Dong J, Yang B (2004) Automatic design of hierarchical TS–FS model using ant programming and PSO algorithm. In: International conference on artificial intelligence: methodology, systems, and applications, pp 285–294. Springer

  • Chen Y, Yang B, Dong J, Abraham A (2005) Time-series forecasting using flexible neural tree model. Inf Sci 174:219–235

    MathSciNet  Google Scholar 

  • Chen Y, Yang B, Dong J (2006) Time-series prediction using a local linear wavelet neural network. Neurocomputing 69(4–6):449–456

    Google Scholar 

  • Chen Y, Yang B, Abraham A, Peng L (2007) Automatic design of hierarchical Takagi-Sugeno type fuzzy systems using evolutionary algorithms. IEEE Trans Fuzzy Syst 15(3):385–397

    Google Scholar 

  • Chen YW, Yang JB, Xu DL, Yang SL (2013) On the inference and approximation properties of belief rule based systems. Inf Sci 234:121–135

    MathSciNet  MATH  Google Scholar 

  • Cheong F, Lai R (2007) Designing a hierarchical fuzzy logic controller using the differential evolution approach. Appl Soft Comput 7(2):481–491

    Google Scholar 

  • Chiu S (1994) Fuzzy model identification based on cluster estimation. J Intell Fuzzy Syst 2(3):267–278

    Google Scholar 

  • da Silva CG (2008) Time series forecasting with a non-linear model and the scatter search meta-heuristic. Inf Sci 178(16):3288–3299 (Including Special Issue: Recent advances in granular computing)

    MathSciNet  MATH  Google Scholar 

  • Deb K, Agrawal S, Pratap A, Meyarivan T (2002) A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: NSGA-II. IEEE Trans Evol Comput 6(2):182–197

    Google Scholar 

  • Dhahri H, Alimi AM, Abraham A (2012) Designing beta basis function neural network for optimization using Artificial Bee Colony (ABC). In: WCCI 2012 IEEE world congress on computational intelligence, pp. 1–7, Brisbane, Australia

  • Dhahri H, Alimi AM, Abraham A (2013) Hierarchical particle swarm optimization for the design of beta basis function neural network. In: Abraham A, Thampi S (eds) Intelligent informatics. Springer, Berlin, pp 193–205

    Google Scholar 

  • Di Martino F, Loia V, Sessa S (2011) Fuzy transforms method in prediction data analysis. Fuzzy Sets Syst 180(1):146–163

    MATH  Google Scholar 

  • Eyoh I, John R, De Maere G, Kayacan E (2018) Hybrid learning for interval type-2 intuitionistic fuzzy logic systems as applied to identification and prediction problems. IEEE Trans Fuzzy Syst 26(5):2672–2685

    Google Scholar 

  • Fernández A, del Jesus MJ, Herrera F (2009) Hierarchical fuzzy rule based classification systems with genetic rule selection for imbalanced data-sets. Int J Approx Reason 50(3):561–577

    MATH  Google Scholar 

  • Geem ZW, Kim JH, Loganathan GV (2001) A new heuristic optimization algorithm: harmony search. Simulation 76(2):60–68

    Google Scholar 

  • Hagras H (2004) Hierarchical type-2 fuzzy logic control architecture for autonomous mobile robots. IEEE Trans Fuzzy Syst 12(4):524–539

    Google Scholar 

  • Huerta EB, Duval B, Hao JK (2008) Gene selection for microarray data by a LDA-based genetic algorithm. In: IAPR international conference on pattern recognition in bioinformatics, pp 250–261, Springer

  • Hüllermeier E (2005) Fuzzy methods in machine learning and data mining: status and prospects. Fuzzy Set Syst 156(3):387–406

    MathSciNet  Google Scholar 

  • Hurrell JW, van Loon H (1997) Decadal variations in climate associated with the North Atlantic Oscillation. Clim Change 36:301–326

    Google Scholar 

  • Innocent N, Kurian M (2014) Cancer prediction based on gene expression data through association rule based classification and fuzzy rough set attribute reduction on information gain ratio. Int J Res Appl Sci Eng Technol 2(4):42–46

    Google Scholar 

  • Izeman AJ (1985) J. R. Wolf, the Zurich sunspot relative numbers. Math Intel 7(1):27–33

    MATH  Google Scholar 

  • Jahromi MZ, Moosavi MR (2011) Designing cost-sensitive fuzzy classification systems using rule-weight. In: The first international conference on advances in information mining and management (IMMM 2011), pp 168–173

  • Jarraya Y, Bouaziz S, Alimi AM, Abraham A (2013) Fuzzy modeling system based on hybrid evolutionary approach. In: 13th International conference on hybrid intelligent systems (HIS), Yassmine Hamammet, Tunisia

  • Jarraya Y, Bouaziz S, Alimi AM, Abraham A (2014) Multi-agent evolutionary design of beta fuzzy systems. In: The 2014 IEEE international conference on fuzzy systems (FUZZ-IEEE 2014), Beijing, China

  • Jarraya Y, Bouaziz S, Alimi AM, Abraham A (2015) Evolutionary multi-objective optimization for evolving hierarchical fuzzy system. In: 2015 IEEE congress on evolutionary computation (CEC 2015), Sendai, Japan

  • Leite D, Gomide F, Ballini R, Costa P (2011) Fuzzy granular evolving modeling for time series prediction. In: 2011 IEEE international conference on fuzzy systems, Taipei, Taiwan

  • León IC, Taylor PC (2015) Memetic type-2 fuzzy system learning for load forecasting. In: 2015 Conference of the international fuzzy systems association and the European Society for Fuzzy Logic and Technology (IFSA-EUSFLAT-15), Gijon, Spain

  • Liang Q, Mendel JM (1999) An introduction to type-2 TSK fuzzy logic systems. In: Proceedings IEEE international conference on fuzzy systems, vol 3, pp 1534–1539. Seoul, South Korea

  • Lin LC, Lee GY (1999) Hierarchical fuzzy control for C-axis of CNC tuning centers using genetic algorithms. J Intell Robot Syst 25(3):255–275

    MATH  Google Scholar 

  • Mackey MC, Glass L (1977) Oscillation and chaos in physiological control systems. Science 197(4300):287–289

    MATH  Google Scholar 

  • Mahdavi M, Fesanghary M, Damangir E (2007) An improved harmony search algorithm for solving optimization problems. Appl Math Comput 188(2):1567–1579

    MathSciNet  MATH  Google Scholar 

  • Mendel J, John R (2002) Type-2 fuzzy sets made simple. IEEE Trans Fuzzy Syst 10(2):117–127

    Google Scholar 

  • Musilek P, Lau A, Reformat M, Wyard-scot L (2006) Immune programming. Inf Sci 176(8):972–1002

    MathSciNet  MATH  Google Scholar 

  • Ojha V, Snasel V, Abraham A (2017) Multiobjective programming for type-2 hierarchical fuzzy inference trees. IEEE Trans Fuzzy Syst 26(2):915–936

    Google Scholar 

  • Pang S, Havukkala I, Hu Y, Kasabov N (2007) Classification consistency analysis for bootstrapping gene selection. Neural Comput Appl 16:527–539

    Google Scholar 

  • Paul S, Kumar S (2002) Subsethood-product fuzzy neural inference system (SuPFuNIS). IEEE Trans Neural Netw 13(3):578–599

    Google Scholar 

  • Pohjalainen J, Räsänen O, Kadioglu S (2015) Feature selection methods and their combinations in high-dimensional classification of speaker likability, intelligibility and personality traits. Comput Speech Lang 29:145–171

    Google Scholar 

  • Raju GVS, Zhou J (1993) Adaptive hierarchical fuzzy controller. IEEE Trans Syst Man Cybern 23(4):973–980

    Google Scholar 

  • Salgado P (2008) Rule generation for hierarchical collaborative fuzzy system. Appl Math Model 32:1159–1178

    MathSciNet  MATH  Google Scholar 

  • Samanta B (2011) Prediction of chaotic time series using computational intelligence. Expert Syst Appl 38:11406–11411

    Google Scholar 

  • Shimojima K, Fukuda T, Hasegawa Y (1995) Self-tuning fuzzy modeling with adaptive membership function, rules, and hierarchical structure based on genetic algorithm. Fuzzy Sets Syst 71(3):295–309

    Google Scholar 

  • Singhala P, Shah DN, Patel B (2014) Temperature control using fuzzy logic. Int J Instrum Control Syst (IJICS) 4(1)

  • Tanaka K, Sano M (1994) A robust stabilization problem of fuzzy control systems and its application to backing up control of a truck-trailer. IEEE Trans Fuzzy Syst 2:119–134

    Google Scholar 

  • Tang Y, Zhang YQ, Huang Z, Hu X (2005) Granular SVM-RFE gene selection algorithm for reliable prostate cancer classification on microarray expression data. In: Proceedings of the 5th IEEE symposium on bioinformatics and bioengineering (BIBE’05), pp 290–293

  • Uslan V, Seker H, John R (2014) A support vector-based interval type-2 fuzzy system. In: IEEE international conference on fuzzy systems, pp 2396–2401, Beijing, China

  • Wadhawan S, Goel G, Kaushik S (2013) Data driven fuzzy modeling for Sugeno and Mamdani type fuzzy model using memetic algorithm. Int J Inf Technol Comput Sci 5(8):24–37

    Google Scholar 

  • Wang LX, Mendel JM (1992) Generating fuzzy rules by learning from examples. IEEE Trans Syst Man Cybern 22(6):1414–1427

    MathSciNet  Google Scholar 

  • Wang Z, Palade V (2011) Building interpretable fuzzy models for high dimensional data analysis in cancer diagnosis. In: BMC genomics, vol 12, no 2, p S5, BioMed Central

  • Yilmaz S, Oysal Y (2010) Fuzzy wavelet neural network models for prediction and identification of dynamical systems. IEEE Trans Neural Netw 21:1599–1609

    Google Scholar 

  • Zadeh LA (1975) The concept of a linguistic variable and its application to approximate reasoning. Inf Sci 8(3):199–249

    MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yosra Jarraya.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Communicated by V. Loia.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jarraya, Y., Bouaziz, S., Alimi, A.M. et al. Hierarchical fuzzy design by a multi-objective evolutionary hybrid approach. Soft Comput 24, 3615–3630 (2020). https://doi.org/10.1007/s00500-019-04129-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-019-04129-6

Keywords

Navigation