Skip to main content

Advertisement

Springer Nature Link
Log in

Entropy based optimal scale combination selection for generalized multi-scale information tables

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

In many real-life applications, data are often hierarchically structured at different levels of granulations. A multi-scale information table is a special hierarchical data set in which each object can take on as many values as there are scales under the same attribute. An important issue in such a data set is to select optimal scale combination in order to keep certain condition for final decision. In this paper, by employing Shannon’s entropy, we study the selection of optimal scale combination to maintain uncertain measure of a knowledge from a generalized multi-scale information table. We first review the concept of entropy and its basic properties in information tables. We then introduce the notion of scale combinations in a generalized multi-scale information table. We further define entropy optimal scale combination in generalized multi-scale information tables and generalized multi-scale decision tables. Finally, we examine relationship between the entropy optimal scale combination and the classical optimal scale combination. We show that, in either a generalized multi-scale information table or a consistent generalized multi-scale decision table, the entropy optimal scale combination and the classical optimal scale combination are equivalent. And in an inconsistent generalized multi-scale decision table, a scale combination is generalized decision optimal if and only if it is a generalized decision entropy optimal.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Beaubouef T, Petry FE, Arora G (1998) Information-theoretic measures of uncertainty for rough sets and rough relational databases. Inf Sci 109:185–195

    Article  Google Scholar 

  2. Bianucci B, Cattaneo G, Ciucci D (2007) Entropies and co-entropies of coverings with application to incomplete information systems. Fundam Inf 75:77–105

    MathSciNet  MATH  Google Scholar 

  3. Chen YS, Li JJ, Huang JX (2019) Matrix method for the optimal scale selection of multi-scale information decision systems. Mathematics 7:290

    Article  Google Scholar 

  4. Chen PCL, Zhang CY (2014) Data intensive applications, challenges, techniques and technologies: a survey on big data. Inf Sci 275:314–347

    Article  Google Scholar 

  5. Gu SM, Wu WZ (2013) On knowledge acquisition in multi-scale decision systems. Int J Mach Learn Cybern 4:477–486

    Article  Google Scholar 

  6. Hao C, Li JH, Fan M, Liu WQ, Tsang ECC (2017) Optimal scale selection in dynamic multi-scale decision tables based on sequential three-way decisions. Inf Sci 415:213–232

    Article  Google Scholar 

  7. Huang ZH, Li JJ, Dai WZ, Lin RD (2019) Generalized multi-scale decision tables with multi-scale decision attributes. Int J Approx Reason 115:194–208

    Article  MathSciNet  Google Scholar 

  8. Huang B, Li HX, Feng GF, Zhou XZ (2019) Dominance-based rough sets in multi-scale intuitionistic fuzzy decision tables. Appl Math Comput 348:487–512

    MathSciNet  MATH  Google Scholar 

  9. Huang B, Wu WZ, Yan JJ, Li HX, Zhou XZ (2020) Inclusion measure-based multi-granulation decision-theoretic rough sets in multi-scale intuitionistic fuzzy information tables. Inf Sci 507:421–448

    Article  Google Scholar 

  10. Komorowski J, Pawlak Z, Polkowski L, Skowron A (1999) Rough sets: tutorial. In: Pal SK, Skowron A (eds) Rough fuzzy hybridization, a new trend in decision making. Springer, Berlin, pp 3–98

    Google Scholar 

  11. Li F, Hu BQ (2017) A new approach of optimal scale selection to multi-scale decision tables. Inf Sci 381:193–208

    Article  Google Scholar 

  12. Li F, Hu BQ, Wang J (2017) Stepwise optimal scale selection for multi-scale decision tables via attribute significance. Knowl-Based Syst 129:4–16

    Article  Google Scholar 

  13. Li JH, Ren Y, Mei CL, Qian YH, Yang XB (2016) A comparative study of multigranulation rough sets and concept lattices via rule acquisition. Knowl-Based Syst 91:152–164

    Article  Google Scholar 

  14. Li ZW, Zhang GQ, Wu WZ, Xie NX (2020) Measures of uncertainty for knowledge bases. Knowl Inf Syst 62:611–637

    Article  Google Scholar 

  15. Liang JY, Li DY (2005) Uncertainty and knowledge acquisition in information systems (in Chinese). Science Press, Beijing

    Google Scholar 

  16. Liang JY, Qian YH, Li DY, Hu QH (2015) Theory and method of granular computing for big data mining. Sci Sin Inf 45:1355–1369

    Article  Google Scholar 

  17. Liang JY, Shi ZZ (2004) The information entropy, rough entropy and knowledge granulation in rough set theory. Int J Uncertain, Fuzz Knowl-Based Syst 12:37–46

    Article  MathSciNet  Google Scholar 

  18. Luo C, Li TR, Huang YY, Fujita H (2019) Updating three-way decisions in incomplete multi-scale information systems. Inf Sci 476:274–289

    Article  Google Scholar 

  19. Miao DQ, Li DY, Yao YY et al (2011) Uncertainty and granular computing. Science Press, Beijing

    Google Scholar 

  20. Miao DQ, Wang J (2011) On the relationships between information entropy and roughness of knowledge in rough set theory. Pattern Recognit Artif Intell 11:34–40

    Google Scholar 

  21. Pawlak Z (1991) Rough sets: theoretical aspects of reasoning about data. Kluwer Academic Publishers, Boston

    Book  Google Scholar 

  22. Qian YH, Liang JY, Dang CY (2010) Incomplete multigranulation rough set. IEEE Trans Syst, Man Cybern-Part A 40:420–431

    Article  Google Scholar 

  23. Qian YH, Liang JY, Yao YY, Dang CY (2010) MGRS: a multi-granulation rough set. Inf Sci 180:949–970

    Article  MathSciNet  Google Scholar 

  24. Shannon CE (1948) The mathematical theory of communication. Bell Syst Tech J 27:373–423

    Article  MathSciNet  Google Scholar 

  25. She YH, Li JH, Yang HL (2015) A local approach to rule induction in multi-scale decision tables. Knowl-Based Syst 89:398–410

    Article  Google Scholar 

  26. Sun L, Zhang XY, Qian YH, Xu JC, Zhang SG (2019) Feature selection using neighborhood entropy-based uncertainty measures for gene expression data classification. Inf Sci 502:18–41

    Article  MathSciNet  Google Scholar 

  27. Wang GY (2003) Rough reduction in algebra view and information view. Int J Intell Syst 18:679–688

    Article  Google Scholar 

  28. Wang GY, Yu H, Yang DC (2002) Decision table reduction based on conditional information entropy. Chin J Comput 25:759–766

    MathSciNet  Google Scholar 

  29. Wu WZ, Chen CJ, Li TJ, Xu YH (2016) Comparative study on optimal granularities in inconsistent multi-granular labeled decision systems. Pattern Recognit Artif Intell 29:1103–1111

    Google Scholar 

  30. Wu WZ, Leung Y (2020) A comparison study of optimal scale combination selection in generalized multi-scale decision tables. Int J Mach Learn Cyber 11:961–972

    Article  Google Scholar 

  31. Wu WZ, Leung Y (2011) Theory and applications of granular labelled partitions in multi-scale decision tables. Inf Sci 181:3878–3897

    Article  Google Scholar 

  32. Wu WZ, Leung Y (2013) Optimal scale selection for multi-scale decision tables. Int J Approx Reason 54:1107–1129

    Article  MathSciNet  Google Scholar 

  33. Wu WZ, Qian YH, Li TJ, Gu SM (2017) On rule acquisition in incomplete multi-scale decision tables. Inf Sci 378:282–302

    Article  MathSciNet  Google Scholar 

  34. Xie JP, Yang MH, Li JH, Zheng Z (2018) Rule acquisition and optimal scale selection in multi-scale formal decision contexts and their applications to smart city. Future Gener Comput Syst 83:564–581

    Article  Google Scholar 

  35. Xu YH, Wu WZ, Tan AH (2017) Optimal scale selections in consistent generalized multi-scale decision tables. In: Proceedings of International Joint Conference on Rough Sets, July 3-7, 2017, Olsztyn, Poland. Lecture Notes in Artificial Intelligence. Springer, Berlin, 10313: 185–198

  36. Zadeh LA (1997) Towards a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst 90:111–127

    Article  MathSciNet  Google Scholar 

  37. Zhang GQ, Li ZW, Wu WZ, Liu XF, Xie NX (2018) Information structures and uncertainty measures in a fully fuzzy information system. Int J Approx Reason 101:119–149

    Article  MathSciNet  Google Scholar 

  38. Zhang QH, Wang GY, Hu J (2013) Multigranularity knowledge acquisition and uncertainty measurement (in Chinese). Science Press, Beijing

    Google Scholar 

  39. Zhang XQ, Zhang QH, Cheng YL, Wang GY (2020) Optimal scale selection by integrating uncertainty and cost-sensitive learning in multi-scale decision tables. Int J Mach Learn Cybern 11:1095–1114

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by grants from the National Natural Science Foundation of China (grant numbers 61976194, 41631179, 62076221 and 61773349) and the Zhejiang Provincial Natural Science Foundation of China (grant number LY18F030017).

Author information

Authors and Affiliations

  1. School of Mathematics, Physics and Information Science, Zhejiang Ocean University, Zhoushan, Zhejiang, 316022, PR China

    Han Bao, Wei-Zhi Wu, Jia-Wen Zheng & Tong-Jun Li

  2. Key Laboratory of Oceanographic Big Data Mining and Application of Zhejiang Province, Zhejiang Ocean University, Zhoushan, Zhejiang, 316022, PR China

    Han Bao, Wei-Zhi Wu, Jia-Wen Zheng & Tong-Jun Li

Authors
  1. Han Bao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wei-Zhi Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jia-Wen Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tong-Jun Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wei-Zhi Wu.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bao, H., Wu, WZ., Zheng, JW. et al. Entropy based optimal scale combination selection for generalized multi-scale information tables. Int. J. Mach. Learn. & Cyber. 12, 1427–1437 (2021). https://doi.org/10.1007/s13042-020-01243-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-020-01243-y

Keywords