Skip to main content

Part of the book series: Intelligent Systems Reference Library ((ISRL,volume 43))

Abstract

In this paper, summary of many experiments for various hybrid methods will be presented. Hybrid methods combine various methodologies from Data Mining such as data reduction, multiple classifiers systems, feature selection with rough sets methods. In the paper, three algorithms will be presented which will use the notion of surroundings and a k-NN method for data reduction. The paper also describes one multiple classifier system which uses several algorithms such as k-NN, decomposition trees and neural network. The rest of the paper focuses on five algorithms which use reducts and deterministic or inhibitory decision rules for feature selection. All the algorithms presented in the paper were tested on well known data sets from the UCI Repository of Machine Learning Databases. The algorithms presented in the paper have been implemented and can be tested in the DMES system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bazan, J.G., Nguyen, H.S., Skowron, A., Szczuka, M.: A view on rough set concept approximation. In: Wang, M., et al. [19], pp. 181–188.

    Google Scholar 

  2. Blake, C., Merz, C.: UCI Repository of Machine Learning Data Bases, Department of Information and Computer Science, University of California, Irvine, CA (1998), http://www.ics.uci.edu/mlearn/mlrepository.html

  3. Breiman, L.: Bagging Predictors. Machine Learning 24(2), 123–140 (1996)

    MathSciNet  MATH  Google Scholar 

  4. Brighton, H., Mellish, C.: Advances in Instance Selection for Instance-Based Learning Algorithms. Data Mining and Knowledge Discovery 6, 153–172 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  5. Cios, K., Pedrycz, W., Świniarski, R.: Data Mining. In: Methods for Knowledge Discovery. Kluwer, Dordrecht (1998)

    Chapter  Google Scholar 

  6. Delimata, P., Moshkov, M., Skowron, A., Suraj, Z.: Inhibitory Rules in Data Analysis. A Rough Set Approach. SCI, vol. 163. Springer, Heidelberg (2008)

    Google Scholar 

  7. Delimata, P., Suraj, Z.: On k-NN Method with Preprocessing. Fundamenta Informaticae 69(3), 343–358 (2005)

    MathSciNet  Google Scholar 

  8. Delimata, P., Suraj, Z.: Feature selection algorithm for multiple classifier systems: A hybrid approach. Fundamenta Informaticae 85(1-4), 97–110 (2008)

    MathSciNet  MATH  Google Scholar 

  9. Góra, G., Wojna, A.: Riona: a new classification system combining rule induction and instance-based learning. Fundamenta Informaticae 51, 369–390 (2002)

    MathSciNet  MATH  Google Scholar 

  10. Nguyen Hoa, S.: Data regularity analysis and applications in data mining. Ph.D. Thesis, Warsaw University, Warsaw, Poland (1999)

    Google Scholar 

  11. Pawlak, Z.: Rough sets. International Journal of Computer and Information Sciences 11, 341–356 (1982)

    Article  MathSciNet  MATH  Google Scholar 

  12. Pawlak, Z.: Rough Sets: Theoretical Aspects of Reasoning About Data. Kluwer, Dordrecht (1991)

    MATH  Google Scholar 

  13. Pawlak, Z., Skowron, A.: Rough sets and boolean reasoning. Information Sciences 177(1), 41–73 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  14. Pawlak, Z., Skowron, A.: Rough sets: Some extensions. Information Sciences 177(1), 28–40 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  15. Peters, J.F., Skowron, A., Grzymała-Busse, J.W., Kostek, B., Świniarski, R.W., Szczuka, M.S. (eds.): Transactions on Rough Sets I. LNCS, vol. 3100. Springer, Heidelberg (2004)

    MATH  Google Scholar 

  16. Randall, W., Martinez, T.: Reduction techniques for instance-based learning algorithms. Machine Learning 38(3), 257–286 (2000)

    Article  MATH  Google Scholar 

  17. Stanfill, C., Waltz, D.: Toward memory - based reasonning. Communications of the ACM 29(12), 1213–1228 (1986)

    Article  Google Scholar 

  18. Suraj, Z., Gayar, N., Delimata, P.: A rough set approach to multiple classifier systems. Fundamenta Informaticae 72(1-3), 393–406 (2006)

    MATH  Google Scholar 

  19. Wang, G., Liu, Q., Yao, Y., Skowron, A. (eds.): RSFDGrC 2003. LNCS (LNAI), vol. 2639. Springer, Heidelberg (2003)

    MATH  Google Scholar 

  20. Wilson, D.: Asymptotic properties of nearest neighbor rules using edited data. IEEE Transactions on Systems, Man and Cybernetics 2-3, 408–421 (1972)

    Article  Google Scholar 

  21. Wojna, A.: Analogy-Based Reasoning in Classifier Construction. In: Peters, J.F., Skowron, A. (eds.) Transactions on Rough Sets IV. LNCS, vol. 3700, pp. 277–374. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  22. Wojnarski, M.: LTF-c: Architecture, training algorithm and applications of new neural classifier. Fundamenta Informaticae 54(1), 89–105 (2003)

    MathSciNet  MATH  Google Scholar 

  23. Wolpert, D.: Stacked generalisation. Neural Networks 5, 241–259 (1992)

    Article  Google Scholar 

  24. Yule, G.: On the association of attributes in statistics. Phil. Trans. 194, 257–319 (1900)

    Article  MATH  Google Scholar 

  25. Zhou, Z.H., Yu, Y.: Ensembling local learners through multimodal perturbation. IEEE Transactions on Systems, Man and Cybernetics Part B 35(4), 725–735 (2005)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Paweł Delimata .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Delimata, P., Suraj, Z. (2013). Hybrid Methods in Data Classification and Reduction. In: Skowron, A., Suraj, Z. (eds) Rough Sets and Intelligent Systems - Professor Zdzisław Pawlak in Memoriam. Intelligent Systems Reference Library, vol 43. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30341-8_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-30341-8_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-30340-1

  • Online ISBN: 978-3-642-30341-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics