Abstract
The Entropy has been used to characterize the neighbourhood of a sample on the base of its k Nearest Neighbour when data are imbalanced and many measures of Entropy have been proposed in the literature to better cope with vagueness, exploiting fuzzy logic, rough set theory and their derivatives. In this paper, a rough extension of Entropy is proposed to measure uncertainty and ambiguity in the neighbourhood of a sample, using the lower and upper approximations from rough–fuzzy set theory in order to compute the Entropy of the set of the k Nearest Neighbours of a sample. The proposed measure shows better robustness to noise and allows a more flexible modeling of vagueness with respect to the Fuzzy Entropy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Batuwita, R., Palade, V.: FSVM-CIL: fuzzy support vector machines for class imbalance learning. IEEE Trans. Fuzzy Syst. 18(3), 558–571 (2010)
Boonchuay, K., Sinapiromsaran, K., Lursinsap, C.: Decision tree induction based on minority entropy for the class imbalance problem. Pattern Anal. Appl. 20(3), 769–782 (2017)
Buckley, J.J.: Fuzzy Probability and Statistics. Springer, Heidelberg (2006). https://doi.org/10.1007/3-540-33190-5
Chen, Y., Wu, K., Chen, X., Tang, C., Zhu, Q.: An entropy-based uncertainty measurement approach in neighborhood systems. Inf. Sci. 279, 239–250 (2014)
Dubois, D., Prade, H.: Rough fuzzy sets and fuzzy rough sets*. Int. J. Gen Syst 17(2–3), 191–209 (1990)
Fan, Q., Wang, Z., Li, D., Gao, D., Zha, H.: Entropy-based fuzzy support vector machine for imbalanced datasets. Knowl.-Based Syst. 115, 87–99 (2017)
Ferone, A., Galletti, A., Maratea, A.: Variable width rough-fuzzy c-means. In: 2017 13th International Conference on Signal-Image Technology Internet-Based Systems (SITIS), pp. 458–464, December 2017
Ferone, A., Maratea, A.: Integrating rough set principles in the graded possibilistic clustering. Inf. Sci. 477, 148–160 (2019)
Kaleli, C.: An entropy-based neighbor selection approach for collaborative filtering. Knowl.-Based Syst. 56, 273–280 (2014)
Lin, C.F., Wang, S.D.: Fuzzy support vector machines. IEEE Trans. Neural Netw. 13(2), 464–471 (2002)
Maratea, A., Ferone, A.: Fuzzy entropy in imbalanced fuzzy classification. In: Esposito, A., et al. (ed.): Proceedings of Wirn, 2019. Springer, Heidelberg (2019, in press)
Sen, D., Pal, S.K.: Generalized rough sets, entropy, and image ambiguity measures. IEEE Trans. Syst. Man Cybern. Part B (Cybern.) 39(1), 117–128 (2009)
Song, G., Rochas, J., Huet, F., Magoulés, F.: Solutions for processing k nearest neighbor joins for massive data on mapreduce. In: 2015 23rd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, March 2015, pp. 279–287 (2015)
Wygralak, M.: Rough sets and fuzzy sets-some remarks on interrelations. Fuzzy Sets Syst. 29(2), 241–243 (1989)
Ziarko, W.: Probabilistic rough sets. In: Ślezak, D., Wang, G., Szczuka, M., Düntsch, I., Yao, Y. (eds.) RSFDGrC 2005. LNCS, vol. 3641, pp. 283–293. Springer, Heidelberg (2005). https://doi.org/10.1007/11548669_30
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Maratea, A., Ferone, A. (2019). Rough–Fuzzy Entropy in Neighbourhood Characterization. In: Montella, R., Ciaramella, A., Fortino, G., Guerrieri, A., Liotta, A. (eds) Internet and Distributed Computing Systems . IDCS 2019. Lecture Notes in Computer Science(), vol 11874. Springer, Cham. https://doi.org/10.1007/978-3-030-34914-1_41
Download citation
DOI: https://doi.org/10.1007/978-3-030-34914-1_41
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-34913-4
Online ISBN: 978-3-030-34914-1
eBook Packages: Computer ScienceComputer Science (R0)