Abstract
Many attribute reduction methods have been proposed for decision-theoretic rough set model based on different definitions of attribute reduct, while an attribute reduct can be seen as an attribute subset that satisfies specific criteria. Most reducts are defined on the basis of a single criterion, which may result in the difficulty for users to choose appropriate reduct to design related reduction algorithm. To address this problem, we propose a multi-objective attribute reduction method based on NSGA-II for decision-theoretic rough set model. Three different definitions of attribute reduct based on positive region, decision cost and mutual information are considered and transferred to a multi-objective optimization problem. Experimental results show that the multi-objective reduction method can obtain a robust and better classification performance.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Pawlak, Z.: Rough sets. Int. J. Comput. Inf. Sci. 11(5), 341–356 (1982)
Li, W., Huang, Z., Jia, X., Cai, X.: Neighborhood based decision-theoretic rough set models. Int. J. Approx. Reason. 69(C), 1–17 (2016)
Yao, Y.: Decision-theoretic rough set models. In: Yao, J.T., Lingras, P., Wu, W.-Z., Szczuka, M., Cercone, N.J., Ślȩzak, D. (eds.) RSKT 2007. LNCS, vol. 4481, pp. 1–12. Springer, Heidelberg (2007). doi:10.1007/978-3-540-72458-2_1
Yao, Y., Zhao, Y.: Attribute reduction in decision-theoretic rough set models. Inf. Sci. 178(17), 3356–3373 (2008)
Krawczak, M., Szkatuła, G.: An approach to dimensionality reduction in time series. Inf. Sci. 260, 15–36 (2014)
Mac Parthaláin, N., Jensen, R.: Unsupervised fuzzy-rough set-based dimensionality reduction. Inf. Sci. 229, 106–121 (2013)
Jia, X., Shang, L., Zhou, B., Yao, Y.: Generalized attribute reduct in rough set theory. Knowl.-Based Syst. 91, 204–218 (2016)
Li, H., Zhou, X., Zhao, J., Liu, D.: Non-monotonic attribute reduction in decision-theoretic rough sets. Fundamenta Informaticae 126(4), 415–432 (2013)
Ma, X., Wang, G., Hong, Y., Li, T.: Decision region distribution preservation reduction in decision-theoretic rough set model. Inf. Sci. 278, 614–640 (2014)
Zhang, X., Miao, D.: Region-based quantitative and hierarchical attribute reduction in the two-category decision theoretic rough set model. Knowl.-Based Syst. 71, 146–161 (2014)
Jia, X., Liao, W., Tang, Z., Shang, L.: Minimum cost attribute reduction in decision-theoretic rough set models. Inf. Sci. 219, 151–167 (2013)
Min, F., Qinghua, H., Zhu, W.: Feature selection with test cost constraint. Int. J. Approx. Reason. 55(1), 167–179 (2012)
Liao, S., Zhu, Q., Min, F.: Cost-sensitive attribute reduction in decision-theoretic rough set models. Math. Probl. Eng. 2014(2), 1–9 (2014)
Qian, Y., Liang, J., Pedrycz, W., Dang, C.: Positive approximation: an accelerator for attribute reduction in rough set theory. Artif. Intell. 174(9–10), 597–618 (2010)
Feifei, X., Bi, Z., Lei, J.: Cost minimization attribute reduction based on mutual information. In: International Conference on Fuzzy Systems and Knowledge Discovery, vol. 2015, pp. 215–219 (2015)
Wang, B., Li, X., Zhang, S.: An improved heuristic minimal attribute reduction algorithm based on condition information entropy. In: International Conference on Machinery, Materials and Information Technology Applications, vol. 2015, pp. 538–543 (2015)
Yang, M.: A novel algorithm for attribute reduction based on consistency criterion. Chin. J. Comput. 33(2), 231–239 (2010)
Fang, Y., Liu, Z.-H., Min, F.: A PSO algorithm for multi-objective cost-sensitive attribute reduction on numeric data with error ranges. Soft Comput. (2016). doi:10.1007/s00500-016-2260-5
Deb, K., Agrawal, S., Pratap, A., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6(2), 182–197 (2002)
Yao, Y.: Three-way decisions with probabilitic rough sets. Inf. Sci. 18, 341–353 (2010)
Miao, D., Hu, G.: A heuristic algorithm for reduction of knowledge. J. Comput. Res. Dev. 36(6), 681–684 (1999)
Deb, K., Kalyanmoy, D.: Multi-objective optimization using evolutionary algorithms, vol. 2. Wiley, Hoboken (2001)
Blake, C.L., Merz, C.J.: UCI repository of machine learning databases. http://www.ics.uci.edu/mlearn/MLRepository.html
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The WEKA data mining software: an update. ACM SIGKDD Explor. Newsl. 11(1), 10–18 (2009)
Acknowledgment
This paper is supported by the National Natural Science Foundations of China (Grant Nos. 61403200, 71671086), the Natural Science Foundation of Jiangsu Province (Grant No. BK20140800), and Key Laboratory of Oceanographic Big Data Mining & Application of Zhejiang Province (Grant No. OBDMA201602).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Wang, L., Li, W., Jia, X., Zhou, B. (2017). A Multi-objective Attribute Reduction Method in Decision-Theoretic Rough Set Model. In: Li, G., Ge, Y., Zhang, Z., Jin, Z., Blumenstein, M. (eds) Knowledge Science, Engineering and Management. KSEM 2017. Lecture Notes in Computer Science(), vol 10412. Springer, Cham. https://doi.org/10.1007/978-3-319-63558-3_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-63558-3_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-63557-6
Online ISBN: 978-3-319-63558-3
eBook Packages: Computer ScienceComputer Science (R0)