Abstract
The automatic generation of fuzzy systems have been widely investigated with several proposed approaches in the literature. Since for most methods the generation process complexity increases exponentially with the number of features, a previous feature selection can highly improve the process. Filters, wrappers and embedded methods are used for feature selection. For fuzzy systems it would be desirable to take the fuzzy granulation of the features domains into account for the feature selection process. In this paper a fuzzy wrapper, previously proposed by the authors, and a fuzzy C4.5 decision tree are used to select features. They are compared with three classic filters and the features selected by the original C4.5 decision tree algorithm, as an embedded method. Results using 10 datasets indicate that the use of the fuzzy granulation of features domains is an advantage to select features for the purpose of inducing fuzzy rule bases.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cordon, O., Gomide, F.A.C., Herrera, F., Hoffmann, F., Magdalena, L.: Ten years of genetic fuzzy systems: Current framework and new trends. Fuzzy Sets and Systems 141(1), 5–31 (2004)
Dumitrescu, D., Lazzerini, B., Jair, L.: Fuzzy Sets and Their Application to Clustering and Training. Int. Series on Computational Intelligence. CBC Press (2000)
Zadeh, L.: Fuzzy sets. Information and Control 8, 338–353 (1965)
Sanchez, L., Villar, J.R., Couso, I.: Genetic feature selection for fuzzy discretized data. In: Proc. of the IPMU 2008, pp. 1159–1166 (2008)
Choi, Y.S., Moon, B.R.: Feature selection in genetic fuzzy discretization for pattern classification problems. IEICE - Trans. Inf. Syst. E90-D(7), 1047–1054 (2007)
Li, R.P., Mukaidono, M., Turksen, I.B.: A fuzzy neural network for pattern classification and feature selection. Fuzzy Sets and Systems 130(1), 101–108 (2002)
Grande, J., del Rosario Suarez, M., Villar, J.R.: Advances in Soft Computing - A Feature Selection Method Using a Fuzzy Mutual Information Measure, vol. 44. Springer, Heidelberg (2007)
Sánchez, L., Suárez, M.R., Villar, J.R., Couso, I.: Mutual information-based feature selection and fuzzy discretization of vague data. International Journal of Approximate Reasoning 49(3), 607–622 (2008)
Alonso, J.M., Magdalena, L.: An interpretability-guided modeling process for learning comprehensible fuzzy rule-based classifiers. In: International Conference on Intelligent Systems Design and Applications, pp. 432–437 (2009)
Cintra, M.E., de Arruda Camargo, H., Monard, M.C.: Fuzzy feature subset selection using the Wang & Mendel method. In: HIS 2008, vol. 1, pp. 590–595 (2008)
Wang, L.: The WM method completed: a flexible fuzzy system approach to data mining. IEEE Transactions on Fuzzy Systems 11, 768–782 (2003)
Yu, L., Liu, H.: Efficient feature selection via analysis of relevance and redundancy. The Journal of Machine Learning Research 5, 1205–1224 (2004)
Hall, M.A.: Correlation-based feature selection for discrete and numeric class Machine Learning. In: Proceedings of the 17th International Conference on Machine Learning, pp. 359–366. Morgan Kaufmann, San Francisco (2000)
Kira, K., Rendell, L.: A practical approach to feature selection. International Conference on Machine Learning 1, 368–377 (1992)
Liu, H., Setiono, R.: A probabilistic approach to feature selection - a filter solution. In: Proceedings of the 13th International Conference on Machine Learning, vol. 1, pp. 319–327 (1996)
Das, S.: Filters, wrappers and a boosting-based hybrid for feature selection. In: Proceedings of the 18th Int. Conf. on Machine Learning, pp. 74–81 (2001)
Cintra, M.E., Martin, T.P., Monard, M.C., Camargo, H.A.: Feature subset selection using a fuzzy method. In: International Conference on Intelligent Human-Machine Systems and Cybernetics, vol. 2, pp. 214–217 (2009)
Quinlan, J.R.: C4.5 Programs for Machine Learning. Morgan Kaufmann, CA (1988)
Quinlan, J.R.: Bagging, boosting and c4.5. In: Proceedings of the 13th Conf. Artificial Intelligence, pp. 725–730 (1996)
Olaru, C., Wehenkel, L.: A complete fuzzy decision tree technique. Fuzzy Sets and Systems 138(2), 221–254 (2003)
Kazunor, H., Motohide, U., Hiroshi, S., Yuushi, U.: Fuzzy C4.5 for generating fuzzy decision trees and its improvement. Faji Shisutemu Shinpojiumu Koen Ronbunshu 15, 515–518 (1999)
Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations, 2nd edn. Morgan Kaufmann, San Francisco (2005)
Asuncion, A., Newman, D.: UCI machine learning repository (2007)
Cintra, M.E., Camargo, H.A., Martin, T.P.: Optimising the fuzzy granulation of attribute domains. In: International Fuzzy Systems Association World Conference, pp. 742–747 (2009)
Demšar, J.: Statistical comparison of classifiers over multiple data sets. Journal of Machine Learning Research 7(1), 1–30 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cintra, M.E., Camargo, H.A. (2010). Feature Subset Selection for Fuzzy Classification Methods. In: Hüllermeier, E., Kruse, R., Hoffmann, F. (eds) Information Processing and Management of Uncertainty in Knowledge-Based Systems. Theory and Methods. IPMU 2010. Communications in Computer and Information Science, vol 80. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14055-6_33
Download citation
DOI: https://doi.org/10.1007/978-3-642-14055-6_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14054-9
Online ISBN: 978-3-642-14055-6
eBook Packages: Computer ScienceComputer Science (R0)