Skip to main content
SpringerLink
Log in
Book cover

Transactions on Rough Sets II pp 33–53Cite as

Incremental versus Non-incremental Rule Induction for Multicriteria Classification

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((TRS,volume 3135))

Abstract

Induction of decision rules within the dominance–based rough set approach to the multicriteria and multiattribute classification is considered. Within this framework, we discuss two algorithms: Glance and an extended version of AllRules. The important characteristics of Glance is that it induces the set of all dominance–based rules in an incremental way. On the other hand, AllRules induces in a non–incremental way the set of all robust rules, i.e. based on objects from the set of learning examples. The main aim of this study is to compare both these algorithms. We experimentally evaluate them on several data sets. The results show that Glance and AllRules are complementary algorithms. The first one works very efficiently on data sets described by a low number of condition attributes and a high number of objects. The other one, conversely, works well on data sets characterized by a high number of attributes and a low number of objects.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Blake, C., Koegh, E., Mertz, C.J.: Repository of Machine Learning.University of California at Irvine (1999), http://www.ics.uci.edu/~mlearn/MLRepositoru.html

  2. Cichosz, P.: Learning systems.WNT, Warszawa (2000) (in Polish)

    Google Scholar 

  3. Fisher, D., Schlimmer, J.C.: A case study of incremental concept induction. In: Proceedings of the Fifth National Conference on Artificial Intelligence, Philadelphia, USA, pp. 302–507. Morgan Kauffman, San Francisco (1986)

    Google Scholar 

  4. Greco, S., Matarazzo, B., Slowinski, R.: The use of rough sets and fuzzy sets in MCDM. In: Gal, T., Stewart, T., Hanne, T. (eds.) Advances in Multiple Criteria Decision Making, pp. 14.1–14.14. Kluwer, Dordrecht (1999)

    Google Scholar 

  5. Greco, S., Matarazzo, B., Slowinski, R.: Rough sets theory for multicriteria decision analysis. European Journal of Operational Research 129(1), 1–47 (2001)

    Article  MATH  MathSciNet  Google Scholar 

  6. Greco, S., Matarazzo, B., Slowinski, R.: Multicriteria classification, in. In: Handbook of Data Mining and Knowledge Disocvery, pp. 318–328. Oxford Univ. Press, Oxford (2002)

    Google Scholar 

  7. Greco, S., Matarazzo, B., Slowinski, R., Stefanowski, J.: An algorithm for induction decision rules consistent with the dominance principle. In: Ziarko, W.P., Yao, Y. (eds.) RSCTC 2000. LNCS (LNAI), vol. 2005, pp. 304–313. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  8. Greco, S., Matarazzo, B., Slowinski, R., Stefanowski, J.: Variable consistency model of dominance-based rough set approach. In: Ziarko, W.P., Yao, Y. (eds.) RSCTC 2000. LNCS (LNAI), vol. 2005, pp. 170–181. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  9. Greco, S., Slowinski, R., Stefanowski, J.: Mining association rules in preference–ordered data. In: Hacid, M.-S., Raś, Z.W., Zighed, D.A., Kodratoff, Y. (eds.) ISMIS 2002. LNCS (LNAI), vol. 2366, pp. 442–451. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  10. Grzymala–Busse, J.W.: LERS – a system for learning from examples based on rough sets. In: Slowinski, R. (ed.) Intelligent Decision Support: Handbook of Advances and Applications of Rough Sets Theory, pp. 3–18. Kluwer, Dordrecht (1992)

    Google Scholar 

  11. Grzymala–Busse, J.W.: Managing uncertainty in the machine learning from examples. In: Proceedings of the 3rd Workshop on Intelligent Information Systems, Wigry, Poland, pp. 70–84. IPI PAN Press (1994)

    Google Scholar 

  12. Grzymala–Busse, J.W., Zou, X.: Classification strategies using certain and possible rules. In: Polkowski, L., Skowron, A. (eds.) RSCTC 1998. LNCS (LNAI), vol. 1424, pp. 37–44. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  13. Han, J., Kamber, M.: Data Mining: Concepts and Techniques. Morgan Kaufmann, San Francisco (2000)

    Google Scholar 

  14. Hong, J.: Learning from examples and a multi–purpose learning system AE5. Chinese Journal of Computers 12, 98–105 (1989)

    Google Scholar 

  15. Hong, J.R., Mozetic, I., Michalski, R.S.: AQ15: Incremental Learning of Attribute–based Descriptions from Examples – the Method and User’s Guide. Report ISG 85-5, UIUCDCS-F-86-949, Dept. of Computer Science, Univ. of Illinois, Urbana (1986)

    Google Scholar 

  16. Langley, P.: Elements of Machine Learning. Morgan Kaufmann, San Francisco (1996)

    Google Scholar 

  17. Lukasik, M., Luszczynski, M., Szumski, M., Zurawski, M.: Multicriteria Decision Aid Software Using Dominance Based Rough Sets and Decision Rules. Eng. B.Sc. Thesis, Poznan University of Technology (1999) (in Polish)

    Google Scholar 

  18. Michalski, R.S.: A theory and methodology of inductive learning. In: Michalski, R.S., Carbonell, J.G., Mitchell, T.M. (eds.) Machine Learning: An Artificial Intelligence Approach, vol. 1, pp. 83–134. Morgan Kaufman, San Francisco (1983)

    Google Scholar 

  19. Michalski, R.S., Larson, J.: Selection of Most Representative Training Examples and Incremental Generation of VL1 Hypothesis: the Underlying Methodology and Description of Programs ESEL and AQ11.Tech. Report UIUCDCS R 78 867, Dept. of Computer Science, Univ. of Illinois at Champaign-Urbana, Urbana (1978)

    Google Scholar 

  20. Michalski, R.S., Reinke, R.E.: Incremental learning of concept descriptions: A method and experimental results. In: Machine Intelligence, vol. XI, pp. 263–288. Clarendon Press, Oxford (1988)

    Google Scholar 

  21. Mitchell, T.: Machine Learning. Mac-Graw Hill, New York (1997)

    MATH  Google Scholar 

  22. Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Francisco (1993)

    Google Scholar 

  23. Pawlak, Z.: Rough Sets: Theoretical Aspects of Reasoning about Data. Kluwer, Dordrecht (1991)

    MATH  Google Scholar 

  24. Roy, B.: Multicriteria Methodology for Decision Aiding. Kluwer, Dordrecht (1995)

    Google Scholar 

  25. Slowinski, R., Stefanowski, J., Greco, S., Matarazzo, B.: Rough sets processing of inconsistent information. Control and Cybernetics 29(1), 379–404 (2000)

    MATH  Google Scholar 

  26. Stefanowski, J.: On rough set based approaches to induction of decision rules. In: Rough Sets in Data Mining and Knowledge Discovery, vol. 1, pp. 500–529. Physica, Heidelberg (1998)

    Google Scholar 

  27. Stefanowski, J.: Algorithims of Rule Induction for Knowledge Discovery. Habilitation Thesis published as Series Rozprawy, vol. 361. Poznan Univeristy of Technology Press, Poznan (2001) (in Polish)

    Google Scholar 

  28. Stefanowski, J., Vanderpooten, D.: Induction of decision rules in classification and discovery–oriented perspectives. Int. Journal of Intelligent Systems 16(1), 11–28 (2001)

    Google Scholar 

  29. Stefanowski, J., Zurawski, M.: Incremental learning of decision rules for classification problems. Submitted to IIS-2003, New Trends in Intelligent Information Processing and Webmining Conference (2002)

    Google Scholar 

  30. Shan, N., Ziarko, W.: Data–based acquisition and incremental modification of classification rules. Computational Intelligence 11(2), 357–370 (1995)

    Article  MathSciNet  Google Scholar 

  31. Susmaga, R.: Experiments in incremental computation of reducts. In: Polkowski, L., Skowron, A. (eds.) Rough Sets in Data Mining and Knowledge Discovery, vol. 1, pp. 530–553. Physica, Heidelberg (1998)

    Google Scholar 

  32. Utgoff, P.E.: Incremental induction of decision trees. Machine Learning 4, 161–186 (1989)

    Article  Google Scholar 

  33. Wojna, A.: Constraint based incremental learning of classification rules. In: Ziarko, W.P., Yao, Y. (eds.) RSCTC 2000. LNCS (LNAI), vol. 2005, pp. 428–435. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  34. Xiandong, W.: Inductive learning: Algorithms and frontiers. Artificial Intelligence Review 7, 93–108 (1993)

    Article  Google Scholar 

  35. Zurawski, M.: Algorithms of Induction of Decision Rules for Multicriteria Decision Problems. M.Sc. Thesis, Poznań University of Technology, 110 pp (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Computing Science, Poznań University of Technology, Piotrowo 3A, 60-965, Poznań, Poland

    Roman Słowiński, Jerzy Stefanowski & Marcin Żurawski

  2. Faculty of Economics, University of Catania, 95129, Catania, Italy

    Salvatore Greco

Authors
  1. Salvatore Greco
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Roman Słowiński
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jerzy Stefanowski
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marcin Żurawski
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Electrical and Computer Engineering, University of Manitoba, R3T 5V6, Winnipeg, Manitoba, Canada

    James F. Peters

  2. Institute of Mathematics, Warsaw University, Banacha 2, 02-097, Warsaw, Poland

    Andrzej Skowron

  3. Institut de Recherche en Informatique de Toulouse, France

    Didier Dubois

  4. Institute of Computer Science, Polish Academy of Sciences, 01–237, Warsaw, Poland

    Jerzy W. Grzymała-Busse

  5. Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, 1-3, Machikaneyama, Toyonaka, 560-8531, Osaka, Japan

    Masahiro Inuiguchi

  6. Polish-Japanese Institute of Information Technology Warsaw, Poland Department of Mathematics and Computer Science, University of Warmia and Mazury, Olsztyn, Poland

    Lech Polkowski

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Greco, S., Słowiński, R., Stefanowski, J., Żurawski, M. (2004). Incremental versus Non-incremental Rule Induction for Multicriteria Classification. In: Peters, J.F., Skowron, A., Dubois, D., Grzymała-Busse, J.W., Inuiguchi, M., Polkowski, L. (eds) Transactions on Rough Sets II. Lecture Notes in Computer Science, vol 3135. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-27778-1_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-27778-1_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23990-1

  • Online ISBN: 978-3-540-27778-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation