Skip to main content
SpringerLink
Log in

Classification-level and Class-level Complement Information Measures Based on Neighborhood Decision Systems

  • Published:
Cognitive Computation Aims and scope Submit manuscript

Abstract

Information measures in neighborhood decision systems underlie information processing and uncertainty measurement, especially regarding neighborhood rough sets. Their constructions on covering structuring and neighborhood counting can acquire theoretical extensions and practical compactness but become difficult and rare when comparing the sample counting approach and its defects. In terms of three-way information measures (i.e., information entropy, conditional entropy, and mutual information), classification-level and class-level complement information measures are established by extending equivalence decision systems to neighborhood decision systems; thus, the construction on nonrepetitive neighborhoods becomes ingenious, and the study of criss-cross structuring and granulation properties becomes valuable. At the classification level, neighborhood-complement information measures are proposed by imitation; they perfectly expand existing complement information measures, and thus, they offer an extended isomorphism regarding systematicity. At the class level, neighborhood-complement information measures are determined by decomposition to generate a hierarchical isomorphism, and they also induce equivalence-complement information measures to yield a degenerate isomorphism. Then, granulation nonmonotonicity and monotonicity of neighborhood-complement information measures are revealed at these two levels, and their uncertainty mechanisms are analyzed deeply by three-level granular structures. Finally, all complement measures are calculated programmatically, and their relationships and nonmonotonicity or monotonicity are effectively verified by virtue of table examples and data experiments. In summary, systematically, there are four criss-cross modes of three-way complement information measures based on two knowledge granulations and two decision levels; the variably extended and degenerated isomorphisms and hierarchically decomposed and integrated isomorphisms are thoroughly uncovered, the granulation nonmonotonicity and monotonicity are deeply mined, and all achievements are found to have good application prospects for feature reduction and rule induction in machine learning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Acharjya DP, Abraham A. Rough computing – A review of abstraction, hybridization and extent of applications. Eng Appl Artif Intell. 2020;96:103924.

  2. Azam N, Zhang Y, Yao JT. Evaluation functions and decision conditions of three-way decisions with game-theoretic rough sets. Eur J Oper Res. 2017;261(2):704–14.

    Article  MathSciNet  MATH  Google Scholar 

  3. Bianucci D, Cattaneo G. Information entropy and granulation co-entropy of partitions and coverings: A summary. In: Peters JF, Skowron A, Wolski M, Chakraborty MK, Wu WZ (eds) Transactions on Rough Sets X. Lecture Notes in Computer Science. 2009; 5656:15–66.

  4. Blaszczynski J, Greco S, Slowinski R, Szelg M. Monotonic variable consistency rough set approaches. Int J Approx Reason. 2009;50(7):979–99.

    Article  MathSciNet  MATH  Google Scholar 

  5. Borowska K, Stepaniuk J. A rough-granular approach to the imbalanced data classification problem. Appl Soft Comput. 2019;83:105607.

    Article  Google Scholar 

  6. Calvanese D, Dumas M, Laurson U, Maggi FM, Montali MI. Teinemaa, Semantics, analysis and simplification of DMN decision tables. Inf Syst. 2018;78:112–25.

    Article  Google Scholar 

  7. Campagner A, Ciucci D. Measuring uncertainty in orthopairs. In: Antonucci A, Cholvy L, Papini O (eds) Symbolic and Quantitative Approaches to Reasoning with Uncertainty (ECSQARU 2017). Lecture Notes in Computer Science. 2017;10369:423–432.

  8. Campagner A, Ciucci D. Orthopartitions and soft clustering: Soft mutual information measures for clustering validation. Knowl-Based Syst. 2019;180:51–61.

    Article  Google Scholar 

  9. Campagner A, Ciucci D, Hullermeier E. Feature reduction in superset learning using rough sets and evidence theory. In: Information Processing and Management of Uncertainty in Knowledge-Based Systems. 2020. pp. 471–484.

  10. Chakraborty DB, Pal SK. Neighborhood rough filter and intuitionistic entropy in unsupervised tracking. IEEE Trans Fuzzy Syst. 2018;26(4):2188–200.

    Article  Google Scholar 

  11. Chen YM, Qin N, Li W, Xu FF. Granule structures, distances and measures in neighborhood systems. Knowl-Based Syst. 2019;165:268–81.

    Article  Google Scholar 

  12. Chen YM, Xue Y, Ma Y, Xu FF. Measures of uncertainty for neighborhood rough sets. Knowl-Based Syst. 2017;120:226–35.

    Article  Google Scholar 

  13. Chen YM, Zeng ZQ, Zhu QX, Tang CH. Three-way decision reduction in neighborhood systems. Appl Soft Comput. 2016;38:942–54.

    Article  Google Scholar 

  14. Dai JH, Wei BJ, Zhang XH, Zhang QL. Uncertainty measurement for incomplete interval-valued information systems based on a-weak similarity. Knowl-Based Syst. 2017;136:159–71.

    Article  Google Scholar 

  15. Dua D, Graff C. UCI Machine Learning Repository [http://archive.ics.uci.edu/ml]. School of Information and Computer Science, University of California. Irvine, CA, 2019.

  16. Eissa MM, Elmogy M, Hashem M. Rough-Granular Computing knowledge discovery models for medical classification. Egypt Inform J. 2016;17(3):265–72.

    Article  Google Scholar 

  17. Fan XD, Zhao WD, Wang CZ, Huang Y. Attribute reduction based on max-decision neighborhood rough set model. Knowl-Based Syst. 2018;151:16–23.

    Article  Google Scholar 

  18. Gao C, Lai ZH, Zhou J, Wen JJ, Wong WK. Granular maximum decision entropy-based monotonic uncertainty measure for attribute reduction. Int J Approx Reason. 2019;104:9–24.

    Article  MathSciNet  MATH  Google Scholar 

  19. Hu MJ, Yao YY. Structured approximations as a basis for three-way decisions in rough set theory. Knowl-Based Syst. 2019;165:92–109.

    Article  Google Scholar 

  20. Hu QH, Pedrycz W, Yu DR, Lang J. Selecting discrete and continuous features based on neighborhood decision error minimization. IEEE Trans Syst Man Cybern B Cybern. 2010;40(1):137–150.

  21. Hu QH, Yu DR. Neighborhood entropy. Proceedings of the Eighth International Conference on Machine Learning and Cybernetics. IEEE. 2009;1776–1782.

  22. Hu QH, Zhang L, Zhang D, Pan W, An S, Pedrycz W. Measuring relevance between discrete and continuous features based on neighborhood mutual information. Expert Systems with Applications. 2011;38(9):10737–10750.

  23. Huang B, Li HX, Feng GF, Zhou XZ. Dominance-based rough sets in multi-scale intuitionistic fuzzy decision tables. Appl Math Comput. 2019;348:487–512.

    MathSciNet  MATH  Google Scholar 

  24. Jiang F, Sui YF, Zhou L. A relative decision entropy-based feature selection approach. Pattern Recognit. 2015;48(7):2151–63.

    Article  MATH  Google Scholar 

  25. Kumar SU, Inbarani HH. PSO-based feature selection and neighborhood rough set based classification for BCI multiclass motor imagery task. Neural Comput Applic. 2017;28(11):3239–58.

    Article  Google Scholar 

  26. Liang JY, Shi ZZ. The information entropy, rough entropy and knowledge granulation in rough set theory. Int J Uncertainty Fuzziness Knowledge Based Syst. 2004;12(1):37–46.

    Article  MathSciNet  MATH  Google Scholar 

  27. Liang JY, Shi ZZ, Li DY, Wierman MJ. Information entropy rough entropy and knowledge granulation in incomplete information systems. Int J Gen Syst. 2006;35(6):641–54.

    Article  MathSciNet  MATH  Google Scholar 

  28. Liang JY, Wang JH, Qian YH. A new measure of uncertainty based on knowledge granulation for rough sets[J]. Inf Sci. 2009;179(4):458–70.

    Article  MathSciNet  MATH  Google Scholar 

  29. Lin YJ, Hu QH, Liu JH, Chen JK, Duan J. Multi-label feature selection based on neighborhood mutual information. Appl Soft Comput. 2016;38:244–56.

    Article  Google Scholar 

  30. Liu Y, Xie H, Chen YH, Tan KZ, Wang LG, Xie W. Neighborhood mutual information and its application on hyperspectral band selection for classification. Chemom Intell Lab Syst. 2016;157:140–51.

    Article  Google Scholar 

  31. Liu D, Yang X, Li TR. Three-way decisions: beyond rough sets and granular computing. Int J Mach Learn Cybern. 2020;11:989–1002.

    Article  Google Scholar 

  32. Ma XA. Fuzzy entropies for class-specific and classification-based attribute reducts in three-way probabilistic rough set models. Int J Mach Learn Cybern. 2021;12:433–57.

    Article  Google Scholar 

  33. Meng J, Zhang J, Luan YS. Gene selection integrated with biological knowledge for plant stress response using neighborhood system and rough set theory. IEEE/ACM Trans Comput Biol Bioinform. 2015;1–2(2):433–44.

    Article  Google Scholar 

  34. Miao DQ. Rough set theory and its application in machine learning. Beijing: Institute of Automation, The Chinese Academy of Sciences; 1997.

    Google Scholar 

  35. Miao DQ, Zhao Y, Yao YY, Li HX, Xu FF. Relative reducts in consistent and inconsistent decision tables of the Pawlak rough set model. Inform Sci. 2009;179(24):4140–50.

    Article  MathSciNet  MATH  Google Scholar 

  36. Mu TP, Zhang XY, Mo ZW. Double-granules conditional-entropies based on three-level granular structures. Entropy. 2019;21(7):657.

    Article  MathSciNet  Google Scholar 

  37. Pawlak Z. Rough Sets: Theoretical Aspects of Reasoning about Data. Dordrecht: Kluwer Academic Publishers; 1991.

    Book  MATH  Google Scholar 

  38. Shiraz RK, Fukuyama H, Tavana M, Caprio DD. An integrated data envelopment analysis and free disposal hull framework for cost-efficiency measurement using rough sets. Appl Soft Comput. 2016;46:204–19.

    Article  Google Scholar 

  39. Skowron A, Stepaniuk J, Swiniarski R. Modeling rough granular computing based on approximation spaces. Inform Sci. 2012;184(1):20–43.

    Article  MATH  Google Scholar 

  40. Slezak D. Approximate entropy reducts. Fund Inform. 2020;53:365–90.

    MathSciNet  MATH  Google Scholar 

  41. Sun L, Wang LY, Ding WP, Qian YH, Xu JC. Feature selection using fuzzy neighborhood entropy-based uncertainty measures for fuzzy neighborhood multigranulation rough sets. IEEE Trans Fuzzy Syst. 2021;29(1):19–33.

    Article  Google Scholar 

  42. Tang LY, Zhang XY, Mo ZW. A weighted complement-entropy system based on tri-level granular structures. Int J Gen Syst. 2020;49(8):872–905.

    Article  MathSciNet  Google Scholar 

  43. Thuy NN, Wongthanavasu S. On reduction of attributes in inconsistent decision tables based on information entropies and stripped quotient sets. Expert Systems with Applications. 2019;137:308–23.

    Article  Google Scholar 

  44. Wang CZ, Huang Y, Ding WP, Cao ZH. Attribute reduction with fuzzy rough self-information measures. Inform Sci. 2021;549:68–86.

    Article  MathSciNet  MATH  Google Scholar 

  45. Wang CZ, Huang Y, Shao MW, Hu QH, Chen DG. Feature selection based on neighborhood self-information. IEEE Trans Cybern. 2020;50(9):4031–42.

    Article  Google Scholar 

  46. Wang GY, Ma XA, Yu H. Monotonic uncertainty measures for attribute reduction in probabilistic rough set model. Int J Approx Reason. 2015;59:41–67.

    Article  MathSciNet  MATH  Google Scholar 

  47. Wang GY, Zhao J, An JJ, Wu Y. A comparative study of algebra viewpoint and information viewpoint in attribute reduction. Fund Inform. 2005;68(3):289–301.

    MathSciNet  MATH  Google Scholar 

  48. Wang Q, Qian YH, Liang XY, Guo Q, Liang JY. Local neighborhood rough set. Knowl-Based Syst. 2018;153:53–64.

    Article  Google Scholar 

  49. Wang ZH, Yue HF, Deng JP. An uncertainty measure based on lower and upper approximations for generalized rough set models. Fund Inform. 2019;166(3):273–96.

    MathSciNet  MATH  Google Scholar 

  50. Yang L, Xu WH, Zhang XY, Sang BB. Multi-granulation method for information fusion in multi-source decision information system. Int J Approx Reason. 2020;122:47–65.

    Article  MathSciNet  MATH  Google Scholar 

  51. Yao JT, Azam N. Web-based medical decision support systems for three-way medical decision making with game-theoretic rough sets. IEEE Trans Fuzzy Syst. 2015;23(1):3–15.

    Article  Google Scholar 

  52. Yao JT, Vasilakos AV, Pedrycz W. Granular computing: perspectives and challenges. IEEE Trans Cybern. 2013;43(6):1977–89.

    Article  Google Scholar 

  53. Yao YY. Three-way decision and granular computing. Int J Approx Reason. 2018;103:107–23.

    Article  MATH  Google Scholar 

  54. Yao YY. Three-way granular computing, rough sets, and formal concept analysis. Int J Approx Reason. 2020;116:106–25.

    Article  MathSciNet  MATH  Google Scholar 

  55. Yao YY. Tri-level thinking: Models of three-way decision. Int J Mach Learn Cybern. 2020;11:947–59.

    Article  Google Scholar 

  56. Yao YY, Zhang XY. Class-specific attribute reducts in rough set theory. Inform Sci. 2017;418–419:601–18.

    Article  MATH  Google Scholar 

  57. Yuan Z, Zhang XY, Feng S. Hybrid data-driven outlier detection based on neighborhood information entropy and its developmental measures. Expert Systems with Applications. 2018;112:243–57.

    Article  Google Scholar 

  58. Yue XD, Chen YF, Miao DQ, Fujita H. Fuzzy neighborhood covering for three-way classification. Inform Sci. 2020;507:795–808.

    Article  MathSciNet  MATH  Google Scholar 

  59. Zadeh LA. Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst. 1997;90(2):111–27.

    Article  MathSciNet  MATH  Google Scholar 

  60. Zhang QH, Zhao F, Yang J, Wang GY. Three-way decisions of rough vague sets from the perspective of fuzziness. Inform Sci. 2020;523:111–32.

    Article  MathSciNet  MATH  Google Scholar 

  61. Zhang XY, Gou HY, Lv ZY, Miao DQ. Double-quantitative distance measurement and classification learning based on the tri-level granular structure of neighborhood system. Knowl-Based Systems. 2021;217:106799.

    Article  Google Scholar 

  62. Zhang XY, Miao DQ. Quantitative/qualitative region-change uncertainty/certainty in attribute reduction: Comparative region-change analyses based on granular computing. Inform Sci. 2016;334–335:174–204.

    Article  Google Scholar 

  63. Zhang XY, Miao DQ. Three-layer granular structures and three-way informational measures of a decision table. Inform Sci. 2017;412–413:67–86.

    Article  Google Scholar 

  64. Zhang XY, Yao H, Lv ZY, Miao DQ. Class-specific information measures and attribute reducts for hierarchy and systematicness. Inform Sci. 2021;563:196–225.

    Article  MathSciNet  Google Scholar 

  65. Zhang Y, Yao JT. Game theoretic approach to shadowed sets: A three-way tradeoff perspective. Inform Sci. 2020;507:540–52.

    Article  MATH  Google Scholar 

  66. Zhang YL, Li CQ, Lin ML, Lin YJ. Relationships between generalized rough sets based on covering and reflexive neighborhood system. Inform Sci. 2015;319:56–67.

    Article  MathSciNet  MATH  Google Scholar 

  67. Zheng TT, Zhu LY. Uncertainty measures of neighborhood system-based rough sets. Knowl-Based Syst. 2015;86:57–65.

    Article  Google Scholar 

  68. Zhu P, Wen QY. Entropy and co-entropy of a covering approximation space. Int J Approx Reason. 2012;53(4):528–40.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

The authors would like to thank both the editors and reviewers for their valuable suggestions, which substantially improve this paper.

Funding

This work was supported by National Natural Science Foundation of China (61673285, 11671284), Sichuan Science and Technology Program of China (2021YJ0085, 2019YJ0529), and A Joint Research Project of Laurent Mathematics Center of Sichuan Normal University and National-Local Joint Engineering Laboratory of System Credibility Automatic Verification.

Author information

Authors and Affiliations

  1. School of Mathematical Sciences & Laurent Mathematics Center, Sichuan Normal University, Chengdu, 610066, China

    Xianyong Zhang, Yunrui Fan, Shuai Chen & Lingyu Tang

  2. Institute of Intelligent Information and Quantum Information, Sichuan Normal University, Chengdu, 610066, China

    Xianyong Zhang, Yunrui Fan, Shuai Chen & Lingyu Tang

  3. School of Management, Chengdu University of Information Technology, Chengdu, 610225, China

    Zhiying Lv

Authors
  1. Xianyong Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yunrui Fan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shuai Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lingyu Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zhiying Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xianyong Zhang.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, X., Fan, Y., Chen, S. et al. Classification-level and Class-level Complement Information Measures Based on Neighborhood Decision Systems. Cogn Comput 13, 1530–1555 (2021). https://doi.org/10.1007/s12559-021-09921-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12559-021-09921-x

Keywords

Search

Navigation