Abstract
Three-way decisions (3WDs) is a typical method for dealing with uncertain issues. It is essentially an extension of two-way decisions (2WDs). What is the superiority of 3WDs/S3WDs over traditional 2WDs? Only a few studies have analyzed the theoretical superiority of 3WDs over traditional 2WDs. The motivation of this paper is to theoretically analyze the superiority of 3WDs over 2WDs in dealing with classification problems. From the perspective of probability, 3WDs is compared with 2WDs for a thorough discussion and analysis of the superiority of 3WDs in this paper. First, it is proved that increasing information can effectively improve classification precision in terms of the sample mean, misclassification probability, and interval of uncertain classification. Second, a novel 3WDs model/sequential three-way decisions model (3WDM-CLSM/S3WDM-CLSM) based on confidence level and sample mean is proposed, and the corresponding method for calculating the pair of thresholds based on the confidence level is presented. Third, the superiority of 3WDs compared to 2WDs is analyzed in terms of classification precision and cost of information acquisition (CIA). Finally, experiments are completed to show that the 3WDs model can effectively reduce the CIA, and its classification accuracy is close to that of the 2WDs model.
Similar content being viewed by others
References
Afridi MK, Azam N, Yao JT (2020) Variance based three-way clustering approaches for handling overlapping clustering. Int J Approx Reason 118:47–63
Aranda-Corral GA, Borrego-Diaz J, Paez JG (2018) A model of three-way decisions for knowledge harnessing. Knowl-Based Syst 160(15):136–143
Azam N, Yao JT (2014) Game-theoretic rough sets for recommender systems. Knowl-Based Syst 72:96–107
Campagner A, Cabitza F, Ciucci D (2020a) Three-way decision for handling uncertainty in machine learning: a narrative review. Rough Sets Int Joint Conf 12179:137–152
Campagner A, Cabitza F, Ciucci D (2020b) The three-way-in and three-way-out framework to treat and exploit ambiguity in data. Int J Approx Reason 119:292–312
Campagner A, Cabitza F, Ciucci D (2021) Three-way decision and conformal prediction: isomorphisms, differences and theoretical properties of cautious learning approaches. Inf Sci 579:347–367
Chu XL, Sun BZ, Huang QC, Zhang Y (2020) Preference degree-based multi-granularity sequential three-way group conflict decisions approach to the integration of tcm and western medicine. Comput Ind Eng 143:106393
Dai D, Li HX, Jia XY, Zhou XZ, Huang B (2020) A co-training approach for sequential threeway decisions. Int J Mach Learn Cyber 11(5):1129–1139
Fang Y, Min F (2019) Cost-sensitive approximate attribute reduction with three-way decisions. Int J Approx Reason 104:148–165
Feller W (1976) An introduction to probability theory and its applications, 3rd edn. Wiley, New York, pp 57–70
Fujita H, Gaeta A, Loia V, Orciuoli F (2020) Hypotheses analysis and assessment in counterterrorism activities: a method based on OWA and fuzzy probabilistic rough sets. IEEE Trans Fuzzy Syst 28:831–845
Hu BQ (2014) Three-way decisions space and three-way decisions. Inf Sci 281:21–52
Hu BQ, Wong H, You KFC (2017) On two novel types of three-way decisions in three-way decision spaces. Int J Approx Reason 82:285–306
Jia F, Liu PD (2019) A novel three-way decision model under multiple-criteria environment. Inf Sci 471:29–51
Jia XY, Deng Z, Min F, Liu D (2019) Three-way decisions based feature fusion for Chinese irony detection. Int J Approx Reason 113:324–335
Jiang CM, Yao YY (2018) Effectiveness measures in movement-based three-way decisions. Knowl-Based Syst 160(15):136–143
Lang GM (2019) A general conflict analysis model based on three-way decision. Int J Mach Learn Cyber 11(5):1083–1094
Li HX, Zhang LB, Huang B, Zhou XZ (2016) Sequential three-way decision and granulation for cost-sensitive face recognition. Knowl-Based Syst 91:241–251
Liang DC, Liu D (2015) Deriving three-way decisions from intuitionistic fuzzy decision-theoretic rough sets. Inf Sci 300:28–48
Liang DC, Wang MW, Xu ZS, Liu D (2020) Risk appetite dual hesitant fuzzy three-way decisions with todim. Inf Sci 507:585–605
Liu D (2021) The effectiveness of three-way classification with interpretable perspective. Inf Sci 567:237–255
Liu D, Liang DC (2017) Generalized three-way decisions and special three-way decisions. J Front Comput Sci Technol 11:502–510
Liu D, Ye XQ (2020) A matrix factorization based dynamic granularity recommendation with three-way decisions. Knowl-Based Syst 191:105423
Liu D, Li TR, Liang DC (2014) Incorporating logistic regression to decision-theoretic rough sets for classifications. Int J Approx Reason 55:197–210
Liu D, Yang X, Li TR (2020a) Three-way decisions: beyond rough sets and granular computing. Int J Mach Learn Cyber 11(5):989–1002
Liu PD, Wang YM, Jia F, Fujita H (2020b) A multiple attribute decision making three-way model for intuitionistic fuzzy numbers. Int J Approx Reason 119:177–203
Min F, Zhang SM, Ciucci D, Wang M (2020) Three-way active learning through clustering selection. Int J Mach Learn Cyber 11(5):1033–1046
Pang JF, Guan XQ, Liang JY, Wang BL, Song P (2002) Multi-attribute group decision-making method based on multi-granulation weights and three-way decisions. Int J Approx Reason 117:122–147
Prokhorov YV, Statulevivcius V (2000) Limit theorems of probability theory. Springer, New York
Qian YH, Zhang H, Sang YL, Liang JY (2014) Multigranulation decision-theoretic rough sets. Int J Approx Reason 55(1 (Part 1)):225–237
Qian J, Liu CH, Miao DQ, Yue XD (2020) Sequential three-way decisions via multi-granularity. Inf Sci 507:606–629
Qiao JS, Hu BQ (2020) On decision evaluation functions in generalized three-way decision spaces. Inf Sci 507:733–754
Wan TX, Li HX, Zhang LB, Zhou XZ, Huang B (2020) A three-way decision model based on cumulative prospect theory. Inf Sci 519:74–92
Wang XZ, Li JH (2020) New advances in three-way decision, granular computing and concept lattice. Int J Mach Learn Cyber 11(5):945–946
Wang MW, Liang DC, Xu ZS (2020) Sequential three-way multiple attribute group decisions with individual attributes and its consensus achievement based on social influence. Inf Sci 518:286–308
Wei L, Liu L, Qi JJ, Qian T (2020) Rules acquisition of formal decision contexts based on three-way concept lattices. Inf Sci 506:529–544
Wu CY, Zhang QH, Cheng YL, Gao M, Wang GY (2021) Novel three-way generative classifier with weighted scoring distribution. Inf Sci 579:732–750
Xu JF, Zhang YJ, Miao DQ (2021) Three-way confusion matrix for classification: a measure driven view. Inf Sci 579:732–750
Yang X, Li TR, Fujita H, Liu D (2019) A sequential three-way approach to multi-class decision. Int J Approx Reason 104:108–125
Yao YY (2010) Three-way decisions with probabilistic rough sets. Inf Sci 180(3):341–353
Yao YY (2011) The superiority of three-way decisions in probabilistic rough set models. Inf Sci 181(6):1080–1096
Yao YY (2013) Granular computing and sequential three-way decisions. In: Lingras P, Wolski M, Cornelis C, Mitra S, Wasilewski P (eds) RSKT 2013. LNCS (LNAI). Springer, Heidelberg, vol 8171, pp 16–27
Yao YY (2016) Three-way decisions and cognitive computing. Cogn Comput 8(4):543–554
Yao YY (2017) Interval sets and three-way concept analysis in incomplete contexts. Int J Mach Learn Cybern 8(1):3–20
Yao YY (2019) Three-way conflict analysis: reformulations and extensions of the Pawlak model. Knowl-Based Syst 180:26–37
Yao YY (2020) Tree-way granular computing, rough sets, and formal concept analysis. Int J Approx Reason 116:106–125
Yao YY (2021) The geometry of three-way decision. Appl Intell 51:6298–6325
Yao YY, Deng X (2011) Sequential three-way decisions with probabilistic rough sets. In: IEEE International Conference on Cognitive Informatics and Cognitive Computing
Yao JT, Azam N (2015) Web-based medical decision support systems for three-way medical decision making with game-theoretic rough sets. IEEE Trans Fuzzy Syst 23(1):3–15
Yue XD, Chen YF, Miao DQ (2020) Fuzzy neighborhood covering for three-way classification. Inf Sci 507:795–808
Zhang Y, Yao JT (2017) Gini objective functions for three-way classifications. Int J Approx Reason 81:103–114
Zhang QH, Xia DY, Wang GY (2017) Three-way decision model with two types of classification errors. Inf Sci 420:431–453
Zhang QH, Xia DY, Liu KX, Wang GY (2018a) A general model of decision theoretic three-way approximations of fuzzy sets based on a heuristic algorithm. Inf Sci 507(6):522–539
Zhang QH, Xie Q, Wang GY (2018b) A novel three-way decision model with decision-theoretic rough sets using utility theory. Knowl-Based Syst 159(1):321–335
Zhang YJ, Miao DQ, Zhang ZF, Xue JF, Luo S (2018c) A three-way selective ensemble model for multi-label classification. Int J Approx Reason 103:394–413
Zhang YB, Wang JQ, Miao DQ, Zhang ZF (2019) A cost-sensitive three-way combination technique for ensemble learning in sentiment classification. Int J Approx Reason 105:85–97
Zhang C, Li DY, Liang JY (2020a) Interval-valued hesitant fuzzy multi-granularity three-way decisions in consensus processes with applications to multi-attribute group decision making. Inf Sci 511:192–211
Zhang LB, Li HX, Zhou XZ, Huang B (2020b) Sequential three-way decision based on multi-granular autoencoder features. Inf Sci 507:630–643
Zhang QH, Gao M, Zhao F, Wang GY (2020c) Fuzzy entropy based game theoretic shadowed sets a novel game perspective from uncertainty. IEEE Trans Fuzzy Syst. https://doi.org/10.1109/TFUZZ.2020.3042250
Zhang QH, Pang GH, Wang GY (2020d) A novel sequential three-way decisions model based on penalty function. Knowl-Based Syst 192:105350
Zhang XQ, Zhang QH, Cheng YL, Wang GY (2020e) Optimal scale selection by integrating uncertainty and cost-sensitive learning in multi-scale decision tables. Int J Mach Learn Cyber 11(5):1095–1114
Zhao XR, Miao DQ, Hu BQ (2020) On relationship between three-way concept lattices. Inf Sci 538:396–414
Zhi HL, Qian T, Qi JJ, Ren RS (2020) Conflict analysis under one-vote veto based on approximate three-way concept lattice. Inf Sci 516:316–330
Zhou J, Lai ZH, Miao DQ, Gao C, Yue XD (2020) Multigranulation rough-fuzzy clustering based on shadowed sets. Inf Sci 507:553–573
Acknowledgements
This work was supported in part by the National Key Research and Development Program of China (No. 2020YFC2003500), the National Natural Science Foundation of China (Nos. 61876201, 61876157), the Natural Science Foundation of Chongqing (cstc2019jcyj-cxttX0002), the Graduate Scientific Research Innovation Project of Chongqing under Grant (No. CYB21207, and the Doctoral Talent Training Program of Chongqing University of Posts and Telecommunications (Nos. BYJS201907, BYJS202012, BYJS202109).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Yin, L., Zhang, Q., Zhao, F. et al. Superiority of three-way decisions from the perspective of probability. Artif Intell Rev 56, 1263–1295 (2023). https://doi.org/10.1007/s10462-022-10203-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10462-022-10203-7