Skip to main content
SpringerLink
Log in

Feature Selection for Reduction of Tabular Knowledge-Based Systems

  • Published:
Information Technology and Management Aims and scope Submit manuscript

Abstract

Tabular knowledge-based systems are known to be extremely versatile for verification and validation of knowledge bases. However, a major disadvantage of these systems is the combinatorial explosion that accompanies addition of new attributes or condition entries in the table. One of the means of alleviating this problem in tabular knowledge-based systems is through modularization, which is the process of breaking a big comprehensive table into smaller tables that are easy to deal with. In this study, we propose and illustrate another means to deal with this problem through use of feature selection methodology. The proposed method can be used synergistically with modularization to alleviate problems associated with combinatorial explosion in tabular knowledge bases.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. A.R. Abdel-Khalik and K.M. El-Sheshai, Information choice and utilization in an experiment on default prediction, Journal of Accounting Research, Autumn (1980) 325–342.

  2. K.J. Adams, D.A. Bell, L.P. Maguire and J. McGregor, Knowledge discovery from decision tables by the use of multiple-valued logic, Artificial Intelligence Review 19(2) (2003) 153–176.

    Article  Google Scholar 

  3. B. Baesens, R. Setiono, C. Mues and J. Vanthienen, Using neural network rule extraction and decision tables for credit-risk evaluation, Management Science 49(3) (2003) 312–329.

    Article  Google Scholar 

  4. J.M. Benitez, J.L. Castro, C.J. Mantas and F. Rojas, A neuro-fuzzy approach for feature selection, in Proceedings of IFSA World Congress and 20th NAFIPS International Conference 2 (2001) 1003–1008.

  5. P.S. Bradley, O.L. Mangasarian and W.N. Street, Feature selection in mathematical programming, INFORMS Journal on Computing (1998) 10(2).

  6. L. Breiman, J. Friedman, R. Olshen and C. Stone, Classification and Regression Trees, (Belmont, CA, Wadsworth, 1984).

  7. B. Chambless and David Scarborough, Information-theoretic feature selection for a neural behavioral model, Proceedings of the International Joint Conference on Neural Networks (IJCNN-01) 2 (2001) 1443–1448.

  8. F.M. Coetzee, Eric Glover, Steve Lawrence and C. Lee Giles, Feature selection in web applications by ROC inflections and powerset pruning, Proceedings of the Symposium on Applications and the Internet (2001) 5–14.

  9. T.M. Cover, The best two independent measurements are not the two best, IEEE Transactions on Systems, Man, and Cybernetics SMC-4:1 (1974) 116–117.

    Google Scholar 

  10. P.A. Devijver and J. Kittler, Pattern Recognition: A Statistical Approach (Prentice-Hall: 1982).

  11. J.D. Elashoff, R.M. Elashoff and G.E. Goldman, On the choice of variables in classification problems with dichotomous variables, Biometrika 54 (1967) 668–670.

    PubMed  Google Scholar 

  12. T. Elomaa and E. Ukkonen, A Geometric Approach to Feature Selection, in Proceedings of the European Conference on Machine Learning (1994) 351–354.

  13. A.P. Eremeev. On correctness of the production decision model based on the decision tables, Automation and Remote Control 62(10) (2001) 1608–1619.

    Article  Google Scholar 

  14. U. Gupta, Validating and Verifying Knowledge-based Systems (IEEE Press, Washington, D.C.: 1991).

    Google Scholar 

  15. Kira, K. and L.A. Rendell, A practical approach to feature selection, in Proceedings of the Ninth International Conference on Machine Learning (1992) 249–256.

  16. J. Kittler, Mathematical methods of feature selection in pattern recognition, International Journal of Man-Machine Studies 7 (1975) 609–637.

    Google Scholar 

  17. H. Liu and H. Motoda (eds.), Feature Extraction, Construction and Selection: A Data Mining Perspective (Kluwer, 1998).

  18. H. Liu and Rudy Setiono, Feature selection via discretization, IEEE Transactions on Knowledge and Data Engineering 9(4) (1997) 642–645.

    Article  Google Scholar 

  19. W.S. Meisel, Computer-Oriented Approaches to Pattern Recognition, (Academic Press, New York, 1972).

    Google Scholar 

  20. M. van Middelkoop, A.W.J. Borgers, and H.J.P. Timmermans, Modelling tourist destination choice using a decision table induction algorithm, Environment and Planning 35(9) (2003) 1669–1687.

    Article  Google Scholar 

  21. S. Murrell and R. Plant, On the validation and verification of production systems: A graph reduction approach. International Journal of Human-Computer Studies 44 (1996) 127–144.

    Article  Google Scholar 

  22. S.B. Nadler jr., Hyperspaces of Sets (Marcel Dekker, 1978 New York).

  23. T.A. Nguyen, Verifying Consistency of Production Systems, Proceedings of the Third Conference on Artificial Intelligence Applications (1987) 4–8.

  24. R.M. O'Keefe and D.E. O'Leary, Expert system verification and validation: A survey and tutorial, Artificial Intelligence Review 7 (1993) 3–42.

    Article  Google Scholar 

  25. D. E. O'Leary, The relationship between errors and size in knowledge-based systems, International Journal of Human-Computer Studies 44 (1996) 171–185.

    Article  Google Scholar 

  26. D.E. O'Leary (eds.) Special Issue on Verification and Validation issues in databases, Knowledge-based systems, and ontologies, International Journal of Intelligent Systems 16(3) 2001.

  27. M. Pazzani, The influence of prior knowledge on concept acquisition: Experimental and computational results, Journal of Experimental Psychology: Learning, Memory and Cognition 17(3) (1991) 416–432.

    Google Scholar 

  28. Z. Pawlak, Rough Sets: Theoretical Aspects of Reasoning About Data (Kluwer, 1992).

  29. S. Piramuthu, The Hausdorff Distance Measure for Feature Selection in Learning Applications, Proceedings of the 32nd Hawaii International Conference on System Sciences, 1999.

  30. S. Piramuthu, Feature construction for reduction of tabular knowledge-based systems, Information Sciences 168 (2004) 201–215.

    Google Scholar 

  31. A. D. Preece, R. Shinghal and A. Batarekh, Principles and practice in verifying rule-based systems, The Knowledge Engineering Review 7 (1992) 115–141.

    Google Scholar 

  32. P. Pudil, F. J. Ferri, J. Novovicova and J. Kittler, Floating search methods for feature selection with nonmonotonic criterion functions,” IEEE 12th International Conference on Pattern Recognition-Vol. II (1994) 279–283.

  33. Stearns, S.D., On selecting features for pattern classifiers, Third International Conference on Pattern Recognition, (1976), 71–75.

  34. G.T. Toussaint, “Note on Optimal Selection of Independent Binary-valued Features for Pattern Recognition.” IEEE Transactions on Information Theory, IT-17 (1971) 618.

  35. J. Vanthienen, Knowledge Acquisition and Validation Using a Decision Table Engineering Workbench. World Congress of Expert Systems (1991) 1861–1868.

  36. J. Vanthienen, A tool-supported approach to inter-tabular verification. Expert Systems with Applications 15 (1998) 277–285.

    Article  Google Scholar 

  37. J. Vanthienen, C. Mues, G. Wets and K. Delaere, A tool-supported approach to inter-tabular verification, Expert systems with applications 15 (1998) 277–285.

    Article  Google Scholar 

  38. J. Vanthienen and G. Wets, From decision tables to expert system shells, Data and Knowledge Engineering 13 (1994) 265–282.

    Article  Google Scholar 

  39. A. Vermesan and F. Coenen, Validation and Verification of Knowledge Based Systems—Theory, Tools and Practice, (Kluwer, 1999).

  40. G. Wets, J. Vanthienen and H. Timmermans, Modeling decision tables from Data, Proceedings of The Second Pacific-Asia Conference on Knowledge Discovery and Data Mining, Springer-Verlag, 1998, 412–413.

  41. W. Ziarko, Acquisition of hierarchy-structured probabilistic decision tables and rules from data, Expert Systems 20(5) (2003) 305–310.

    Article  Google Scholar 

  42. N. Zlatareva, Truth maintenance systems and their application for verifying expert system knowledge bases, Artificial Intelligence Review (6) (1992) 67–110.

Download references

Author information

Authors and Affiliations

  1. Decision and Information Sciences, University of Florida, 351 Stuzin Hall, Gainesville, FL, 32611-7169

    Selwyn Piramuthu

Authors
  1. Selwyn Piramuthu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Selwyn Piramuthu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Piramuthu, S. Feature Selection for Reduction of Tabular Knowledge-Based Systems. Inf Technol Manage 6, 351–362 (2005). https://doi.org/10.1007/s10799-005-3900-0

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10799-005-3900-0

Keywords

Search

Navigation