Skip to main content
SpringerLink
Log in

Incremental attribute reduction with rough set for dynamic datasets with simultaneously increasing samples and attributes

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Attribute reduction with rough set is a popular data analysis methodology for data dimensionality reduction. For dynamic datasets, the existing research has mainly focused on incremental attribute reduction with increasing samples (rows) or attributes (columns), but there is hardly any further research on attribute reduction for dynamic datasets with simultaneously increasing samples and attributes. This paper presents a novel incremental algorithm for attribute reduction with rough set. Firstly, the definition of discernibility relation is proposed based on the improved discernibility matrix. Then, the incremental mechanisms of samples and attributes are studied in terms of discernibility relation under a unified framework. On the basis of two incremental mechanisms, a unified incremental mechanism is introduced for dynamic datasets with simultaneously increasing samples and attributes, and the incremental algorithm is developed according to the unified incremental mechanism. The proposed algorithm has the solid mathematical foundation, which is also suitable for datasets with massive samples and attributes. Finally, compared experimentally with other algorithms, the efficiency of the developed incremental algorithm is demonstrated in terms of running time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Bazan J (2000) Chapter 17 A comparison of dynamic and non-dynamic rough set methods for extracting laws from decision tables. Rough sets in knowledge discovery 1. Physica-Verlag HD

  2. Bang W, Bien Z (2007) Incremental inductive learning algorithm in the framework of rough set theory and its application. Int J Fuzzy Syst 1:25–36

    Google Scholar 

  3. Chen DG, Yang YY (2014) Attribute reduction for heterogeneous data based on the combination of classical and fuzzy rough set models. IEEE Trans Fuzzy Syst 22(5):1325–1334

    Google Scholar 

  4. Chen DG (2013) Fuzzy rough set theory and method. Beijing, China

    Google Scholar 

  5. Chen DG, Zhao SY, Zhang L, Yang YY, Zhang X (2012) Sample pair selection for attribute reduction with rough set. IEEE Trans Knowl Data Eng 24(11):2080–2093

    Google Scholar 

  6. Chen DG, Zhang L, Zhao SY, Hu QH, Zhu P (2012) A novel algorithm for finding reducts with fuzzy rough sets. IEEE Trans Fuzzy Syst 20(2):385–389

    Google Scholar 

  7. Guan L (2009) An incremental updating algorithm of attribute reduction set in decision tables. In: International conference on fuzzy systems and knowledge discovery. Tianjin, China, vol 6, pp 421–425

  8. Hao C, Li JH, Fan M, Liu WQ, Tsang Eric CC (2017) Optimal scale selection in dynamic multi-scale decision tables based on sequential three-wan decisions. Inf Sci 415:213–232

    Google Scholar 

  9. Hu F, Dai J, Wang G (2007) Incremental algorithms for attribute reduction in the decision table. Control Decis 22(3):268–277

    MATH  Google Scholar 

  10. Hu F, Wang G, Huang H, Wu Y (2005) Incremental attribute reduction based on elementary sets. In: Proceedings of 10th International Conference on Rough Sets. Fussy Sets. Data Mining and Granular Computing. Regina. pp 185–193

  11. Hu QH, Yu DR, Xie ZX, Li XD (2007) EROS: ensemble rough subspaces. Pattern Recognit 40(12):3728–3739

    MATH  Google Scholar 

  12. Hu QH, Zhang L, Chen DG, Pedrycz W, Yu DR (2010) Gaussian kernel based fuzzy rough sets: model, uncertainty measures and applications. Int J Approx Reason 51(4):453–471

    MATH  Google Scholar 

  13. Hu QH, Yu DR, Pedrycz W, Chen DG (2011) Kernelized fuzzy rough sets and their applications. IEEE Trans Knowl Data Eng 23(11):1649–1667

    Google Scholar 

  14. Blaszczynski J, Slowinski R (2003) Incremental induction of decision rules from dominance-based rough approximations. Electron Notes Theor Comput Sci 84(4):40–51

    MATH  Google Scholar 

  15. Jing Y, Li T, Fujita H, Wang B, Cheng C (2018) An incremental attribute reduction method for dynamic data mining. Inf Sci 465:202–218

    MathSciNet  Google Scholar 

  16. Jing Y, Li T, Huang J, Zhang Y (2016) An incremental attribute reduction approach based on knowledge granularity under the attribute generalization. Int J Approx Reason 76:80–95

    MathSciNet  MATH  Google Scholar 

  17. Luo C, Li T, Chen H, Liu D (2012) An incremental approach for updating approximations based on set-valued ordered information systems. In: International conference on rough sets and current trends in computing, Springer, Berlin, pp 363–369

  18. Li JH, Aswani Kumar C, Mei CL, Wang XZ (2017) Comparison of reduction in formal decision contexts. Int J Approx Reason 80:100–122

    MathSciNet  MATH  Google Scholar 

  19. Li WT, Pedrycz W, Xue XP, Xu WH, Fan BJ (2019) Fuzziness and incremental information of disjoint regions in double-quantitative decision-theoretic rough set model. Int J Mach Learn Cybernet 10:2669–2690

    Google Scholar 

  20. Li T, Ruan D, Geert W, Song J, Xu Y (2007) A rough sets based characteristic relation approach for dynamic attribute generalization in data mining. Knowl-Based Syst 20(5):485–494

    Google Scholar 

  21. Liang J, Wang F, Dang C, Qian Y (2014) A group incremental approach to feature selection applying rough set technique. IEEE Trans Knowl Data Eng 26(2):294–308

    Google Scholar 

  22. Liu ZT (1999) An incremental arithmetic for the smallest reduction of attributes. Acta Electron Sinica 27(11):96–98

    Google Scholar 

  23. Miao D, Zhao Y, Yao Y, Li H, Xu F (2009) Relative reducts in consistent and inconsistent decision tables of the Pawlak rough set model. Inf Sci 179(24):4140–4150

    MathSciNet  MATH  Google Scholar 

  24. Modrzejewski M (1993) Feature selection using rough sets theory. Machine learning: ECML-93. In: European conference on machine learning, Vienna, Austria, pp 213–226

  25. Orlowska M, Orlowski M (1992) Maintenance of knowledge in dynamic information systems. Intelligent decision support. Springer, Netherlands, pp 315–329

    Google Scholar 

  26. Pawlak Z (1982) Rough sets. Int J Comput Inform Sci 11(5):341–356

    MATH  Google Scholar 

  27. Pawlak Z (1991) Rough sets: theoretical aspects of reasoning about data. Kluwer Academic Publishers, Berlin

    MATH  Google Scholar 

  28. Riza LS, Janusz A, Bergmeir C, Cornelis C, Herrera F, Slezak D, Benitez JM (2014) Implementing algorithms of rough set theory and fuzzy rough set theory in the R package ‘‘RoughSets’’. Inf Sci 287:68–89

    Google Scholar 

  29. Rahman M, Islam M (2014) FIMUS: a framework for imputing missing values using co-appearance, correlation and similarity analysis. Knowl Based Syst 56:311–327

    Google Scholar 

  30. Skowron A, Rauszer C (1992) The discernibility matrices and functions in information systems. Intell Decis Support 11:331–362

    Google Scholar 

  31. Susmaga R (1998) Experiments in incremental computation of reducts. Methodol Appl 18:530–553

    MATH  Google Scholar 

  32. Swiniarski RW, Skowron A (2003) Rough set methods in feature selection and recognition. Pattern Recogn Lett 24(6):833–849

    MATH  Google Scholar 

  33. Shan N, Ziarko W (2010) Data-based acquisition and incremental modification of classification rules. Comput Intell 11(2):357–370

    Google Scholar 

  34. Shu W, Shen H (2014) Updating attribute reduction in incomplete decision systems with the variation of attribute set. Int J Approx Reason 55(3):867–884

    MathSciNet  MATH  Google Scholar 

  35. Stawicki S, Ślęzak D (2013) Recent advances in decision bireducts: complexity, heuristics and streams. Rough sets and knowledge technology. Springer, Berlin

    Google Scholar 

  36. Teng S, Liu M, Yang A, Zhang J, Nian Y, He M (2016) Efficient attribute reduction from the viewpoint of discernibility. Inf Sci 326:297–314

    MathSciNet  MATH  Google Scholar 

  37. Wang CZ, Huang Y, Shao MW, Fan XD (2019) Fuzzy rough set-based attribute reduction using distance measures. Knowl-Based Syst 164:205–212

    Google Scholar 

  38. Wang CZ, Huang Y, Shao MW, Hu QH, Chen DG (2019) Feature selection based on neighborhood self-information. https://doi.org/10.1109/tcyb.2019.2923430xv

  39. Wang CZ, Shi YP, Fan XD, Shao MW (2019) Attribute reduction based on k-nearest neighborhood rough sets. Int J Approx Reason 106:18–31

    MathSciNet  MATH  Google Scholar 

  40. Wang CZ, Wang Y, Shao MW, Qian YH, Chen DG (2019) Fuzzy rough attribute reduction for categorical data. IEEE Trans Fuzzy Syst. https://doi.org/10.1109/tfuzz.2019.2949765

    Article  Google Scholar 

  41. Wang F, Liang J, Qian Y (2013) Attribute reduction: a dimension incremental strategy. Knowl-Based Syst 39(2):95–108

    Google Scholar 

  42. Wang Q, Li JH, Wei L, Qian T (2020) Optimal granule level selection: a granule description accuracy viewpoint. Int J Approx Reason 116:85–105

    MathSciNet  MATH  Google Scholar 

  43. Yang M (2007) An incremental updating algorithm for attributes reduction based on the improved discernibility matrix. Chin J Comput 30(3):815–822

    MathSciNet  Google Scholar 

  44. Yao YY, Zhao Y (2008) Attribute reduction in decision-theoretic rough set models. Inf Sci 178(17):3356–3373

    MathSciNet  MATH  Google Scholar 

  45. Yang Y, Chen D, Wang H (2017) Active sample selection based incremental algorithm for attribute reduction with rough sets. IEEE Trans Fuzzy Syst 25(4):825–838

    Google Scholar 

  46. Zhao SY, Tsang ECC, Chen DG (2010) The model of fuzzy variable precision rough sets. IEEE Trans Fuzzy Syst 17(2):451–471

    Google Scholar 

  47. Zhao SY, Chen H, Li CP, Zhai MY, Du XY (2013) RFRR:robust fuzzy rough reduction. IEEE Trans Fuzzy Syst 21(5):825–841

    Google Scholar 

  48. Zhao SY, Tsang ECC, Chen DG, Wang XZ (2010) Building a rule-based classifier-a fuzzy-rough set approach. IEEE Trans Knowl Data Eng 22(5):624–638

    Google Scholar 

  49. Zhao SY, Chen H, Li CP, Du XY, Sun H (2015) A novel approach to building a robust fuzzy rough classifier. IEEE Trans Fuzzy Syst 23(4):769–786

    Google Scholar 

Download references

Acknowledgements

This work is supported by the fund ofNorth China Electric Power University and the Fundamental Research Funds for the Central Universities (2018QN050).

Author information

Authors and Affiliations

  1. School of Control and Computer Engineering, North China Electric Power University, Beijing, 102206, China

    Lianjie Dong

  2. College of Science, HeBei Agricultural University, Baoding, 071001, China

    Lianjie Dong

  3. School of Mathematics and Physics, North China Electric Power University, Beijing, 102206, China

    Degang Chen

Authors
  1. Lianjie Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Degang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lianjie Dong.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dong, L., Chen, D. Incremental attribute reduction with rough set for dynamic datasets with simultaneously increasing samples and attributes. Int. J. Mach. Learn. & Cyber. 11, 1339–1355 (2020). https://doi.org/10.1007/s13042-020-01065-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-020-01065-y

Keywords

Search

Navigation