Abstract
In this paper, summary of many experiments for various hybrid methods will be presented. Hybrid methods combine various methodologies from Data Mining such as data reduction, multiple classifiers systems, feature selection with rough sets methods. In the paper, three algorithms will be presented which will use the notion of surroundings and a k-NN method for data reduction. The paper also describes one multiple classifier system which uses several algorithms such as k-NN, decomposition trees and neural network. The rest of the paper focuses on five algorithms which use reducts and deterministic or inhibitory decision rules for feature selection. All the algorithms presented in the paper were tested on well known data sets from the UCI Repository of Machine Learning Databases. The algorithms presented in the paper have been implemented and can be tested in the DMES system.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bazan, J.G., Nguyen, H.S., Skowron, A., Szczuka, M.: A view on rough set concept approximation. In: Wang, M., et al. [19], pp. 181–188.
Blake, C., Merz, C.: UCI Repository of Machine Learning Data Bases, Department of Information and Computer Science, University of California, Irvine, CA (1998), http://www.ics.uci.edu/mlearn/mlrepository.html
Breiman, L.: Bagging Predictors. Machine Learning 24(2), 123–140 (1996)
Brighton, H., Mellish, C.: Advances in Instance Selection for Instance-Based Learning Algorithms. Data Mining and Knowledge Discovery 6, 153–172 (2002)
Cios, K., Pedrycz, W., Świniarski, R.: Data Mining. In: Methods for Knowledge Discovery. Kluwer, Dordrecht (1998)
Delimata, P., Moshkov, M., Skowron, A., Suraj, Z.: Inhibitory Rules in Data Analysis. A Rough Set Approach. SCI, vol. 163. Springer, Heidelberg (2008)
Delimata, P., Suraj, Z.: On k-NN Method with Preprocessing. Fundamenta Informaticae 69(3), 343–358 (2005)
Delimata, P., Suraj, Z.: Feature selection algorithm for multiple classifier systems: A hybrid approach. Fundamenta Informaticae 85(1-4), 97–110 (2008)
Góra, G., Wojna, A.: Riona: a new classification system combining rule induction and instance-based learning. Fundamenta Informaticae 51, 369–390 (2002)
Nguyen Hoa, S.: Data regularity analysis and applications in data mining. Ph.D. Thesis, Warsaw University, Warsaw, Poland (1999)
Pawlak, Z.: Rough sets. International Journal of Computer and Information Sciences 11, 341–356 (1982)
Pawlak, Z.: Rough Sets: Theoretical Aspects of Reasoning About Data. Kluwer, Dordrecht (1991)
Pawlak, Z., Skowron, A.: Rough sets and boolean reasoning. Information Sciences 177(1), 41–73 (2007)
Pawlak, Z., Skowron, A.: Rough sets: Some extensions. Information Sciences 177(1), 28–40 (2007)
Peters, J.F., Skowron, A., Grzymała-Busse, J.W., Kostek, B., Świniarski, R.W., Szczuka, M.S. (eds.): Transactions on Rough Sets I. LNCS, vol. 3100. Springer, Heidelberg (2004)
Randall, W., Martinez, T.: Reduction techniques for instance-based learning algorithms. Machine Learning 38(3), 257–286 (2000)
Stanfill, C., Waltz, D.: Toward memory - based reasonning. Communications of the ACM 29(12), 1213–1228 (1986)
Suraj, Z., Gayar, N., Delimata, P.: A rough set approach to multiple classifier systems. Fundamenta Informaticae 72(1-3), 393–406 (2006)
Wang, G., Liu, Q., Yao, Y., Skowron, A. (eds.): RSFDGrC 2003. LNCS (LNAI), vol. 2639. Springer, Heidelberg (2003)
Wilson, D.: Asymptotic properties of nearest neighbor rules using edited data. IEEE Transactions on Systems, Man and Cybernetics 2-3, 408–421 (1972)
Wojna, A.: Analogy-Based Reasoning in Classifier Construction. In: Peters, J.F., Skowron, A. (eds.) Transactions on Rough Sets IV. LNCS, vol. 3700, pp. 277–374. Springer, Heidelberg (2005)
Wojnarski, M.: LTF-c: Architecture, training algorithm and applications of new neural classifier. Fundamenta Informaticae 54(1), 89–105 (2003)
Wolpert, D.: Stacked generalisation. Neural Networks 5, 241–259 (1992)
Yule, G.: On the association of attributes in statistics. Phil. Trans. 194, 257–319 (1900)
Zhou, Z.H., Yu, Y.: Ensembling local learners through multimodal perturbation. IEEE Transactions on Systems, Man and Cybernetics Part B 35(4), 725–735 (2005)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Delimata, P., Suraj, Z. (2013). Hybrid Methods in Data Classification and Reduction. In: Skowron, A., Suraj, Z. (eds) Rough Sets and Intelligent Systems - Professor Zdzisław Pawlak in Memoriam. Intelligent Systems Reference Library, vol 43. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30341-8_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-30341-8_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-30340-1
Online ISBN: 978-3-642-30341-8
eBook Packages: EngineeringEngineering (R0)