Abstract
Fuzzy memberships can be understood as coverage functions of random sets. This interpretation makes sense in the context of fuzzy rule learning: a random-sets-based semantic of the linguistic labels is compatible with the use of fuzzy statistics for obtaining knowledge bases from data. In particular, in this paper we formulate the learning of a fuzzy-rule-based classifier as a problem of statistical inference. We propose to learn rules by maximizing the likelihood of the classifier. Furthermore, we have extended this methodology to interval-censored data, and propose to use upper and lower bounds of the likelihood to evolve rule bases. Combining descent algorithms and a co-evolutionary scheme, we are able to obtain rule-based classifiers from imprecise data sets, and can also identify the conflictive instances in the training set: those that contribute the most to the indetermination of the likelihood of the model.
Similar content being viewed by others
References
Alcala J et al (2009) KEEL: a software tool to assess evolutionary algorithms for data mining problems. Soft Comput 13:3 307–318
Chi Z, Yan H, Pham T (1996) Fuzzy algorithms: with applications to image processing and pattern recognition. World Scientific, Singapore
Cordón O, Jesus MJ, Herrera F (1999) A proposal on reasoning methods in fuzzy rule-based classification systems. Int J Approx Reason 20(1):21–45
Cordón O, Herrera F, Hoffmann F, Magdalena L (2001) Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases. World Scientific, Singapore
De Jong KA, Spears WM, Gordon DF (1993) Using genetic algorithms for concept learning. Mach Learn 13:161–188
Dubois D, Prade H (1997) The three semantics of fuzzy sets. Fuzzy Sets Syst 90:141–150
Dubois D, Moral S, Prade H (1997) A semantics for possibility theory based on likelihoods. J Math Anal Appl 205:359–380
Goodman IR, Nguyen NT (1985) Uncertainty models for knowledge-based systems. North-Holland, Amsterdam
Hand DJ (1981) Discrimination and classification. Wiley, London
Haykin S (1999) Neural networks, a comprehensive foundation. Prentice-Hall, Englewood Cliffs
Herrera F (2008) Genetic fuzzy systems: taxonomy, current research trends and prospects. Evol Intell 1:27–46
Huynh VN, Nakamori Y, Lawry J (2006) Ranking fuzzy numbers using targets. In: Proceedings of IPMU 2006, pp 140–149
Ho T (2008) Data complexity analysis: linkage between context and solution in classification. SSPR/SPR 2008, pp 986–995
Ishibuchi H, Nakashima T, Murata T (1995) A fuzzy classifier system that generates fuzzy if-then rules for pattern classification problems. In: Proceedings of 2nd IEEE CEC, pp 759–764
Ishibuchi H, Nakashima T, Murata T (1999) Performance evaluation of fuzy classifier systems for multidimensional pattern classification problems. IEEE Trans Syst Man Cybern B Cybern 29(5):601–618
Ishibuchi H, Takashima T (2001) Effect of rule weights in fuzzy rule-based classification systems. IEEE Trans Fuzzy Syst 3(3):260–270
Ishibuchi H, Yamamoto T (2005) Rule weight specification in fuzzy rule-based classification systems. IEEE Trans Fuzzy Syst 13(4):260–270
Ishibuchi H, Nakashima T, Morisawa T (1999) Voting in fuzzy rule-based systems for pattern classification problems. Fuzzy Sets Syst 103(2):223–239
Koeppen M, Franke K, Nickolay B (2003) Fuzzy-Pareto-Dominance driven multi-objective genetic algorithm. In: Proceedings of 10th International Fuzzy Systems Association World Congress (IFSA), Istanbul, Turkey, 2003, pp 450–453
Limbourg P (2005) Multi-objective optimization of problems with epistemic uncertainty. In: EMO 2005, pp 413–427
Luenberger DG (1984) Linear and nonlinear programming. Addison-Wesley, Reading
Michalewicz Z (1992) Genetic algorithms + data structures = evolution programs. Springer, Berlin
Pal SK, Mandal DP (1992) Linguistic recognition system based in approximate reasoning. Inform Sci 61:135–161
Potter M, De Jong K (2006) A cooperative coevolutionary approach to function optimization. In: Lecture Notes in Computer Science vol 866, pp 249–257
Ruspini EH (1969) A new approach to clustering. Inf Control 15:22–32
Ratschek H (1988) Some recent aspects of interval algorithms for global optimization. In: Moore RE (ed) Reliability in computing: the role of interval methods in scientific computing. Academic Press, New York, pp 325–339
Sánchez L (1998) A random sets-based method for identifying fuzzy models. Fuzzy Sets Syst 98(3):343–354
Sánchez L, Casillas J, Cordón O, del Jesus MJ (2002) Some relationships between fuzzy and random classifiers and models. Int J Approx Reason 29:175–213
Sánchez L, Couso I, Casillas J (2007) Modeling vague data with genetic fuzzy systems under a combination of crisp and imprecise criteria. In: First IEEE symposium on computational intelligence in multi-criteria decision-making (MCDM 2007). Honolulu, HI, USA
Sánchez L, Couso I, Casillas J (2009) Genetic learning of fuzzy rules based on low quality data. Fuzzy Sets Syst 160(17):2524–2552
Acknowledgments
This work was supported by the Spanish Ministry of Science and Innovation, under grants TIN2008-06681-C06-04 and TIN2007-67418-C03-03.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sánchez, L., Couso, I. Obtaining fuzzy rules from interval-censored data with genetic algorithms and a random sets-based semantic of the linguistic labels. Soft Comput 15, 1945–1957 (2011). https://doi.org/10.1007/s00500-010-0627-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-010-0627-6