Skip to main content

A General Multi-relational Classification Approach Using Feature Generation and Selection

  • Conference paper
Advanced Data Mining and Applications (ADMA 2010)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 6441))

Included in the following conference series:

Abstract

Multi-relational classification is an important data mining task, since much real world data is organized in multiple relations. The major challenges come from, firstly, the large high dimensional search spaces due to many attributes in multiple relations and, secondly, the high computational cost in feature selection and classifier construction due to the high complexity in the structure of multiple relations. The existing approaches mainly use the inductive logic programming (ILP) techniques to derive hypotheses or extract features for classification. However, those methods often are slow and sometimes cannot provide enough information to build effective classifiers. In this paper, we develop a general approach for accurate and fast multi-relational classification using feature generation and selection. Moreover, we propose a novel similarity-based feature selection method for multi-relational classification. An extensive performance study on several benchmark data sets indicates that our approach is accurate, fast and highly scalable.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Burges, C.J.C.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining Knowledge Discovery 2(2), 121–167 (1998)

    Article  Google Scholar 

  2. Quinlan, J.R.: Induction of Decision Trees. Machine Learning 1, 81–106 (1986)

    Google Scholar 

  3. Lavrac, N., Dzeroski, S.: Inductive Logic Programming: Techniques and Applications. Ellis Horwood, New York (1994)

    MATH  Google Scholar 

  4. Muggleton, S.: Inductive Logic Programming. New Generation Computing 8(4), 295–318 (1991)

    Article  MATH  Google Scholar 

  5. Muggleton, S., Raedt, L.: Inductive Logic Programming: Theory and methods. Journal of Logic Programming 19, 629–679 (1994)

    Article  MathSciNet  MATH  Google Scholar 

  6. Lloyd, J.W.: Foundations of Logic Programming. Springer, New York (1987)

    Book  MATH  Google Scholar 

  7. Quinlan, J.R., Cameron-Jones, R.M.: Foil: A Midterm Report. In: Brazdil, P.B. (ed.) ECML 1993. LNCS, vol. 667, pp. 3–20. Springer, Heidelberg (1993)

    Google Scholar 

  8. Muggleton, S.: Inverse Entailment and Progol. New Generation Computing 13, 245–286 (1995)

    Article  Google Scholar 

  9. Blockeel, H., Raedt, L.D.: Top-down Induction of First-order Logical Decision Trees. Artificial Intelligence 101(1-2), 285–297 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  10. Quinlan, J.R.: C4.5 Programs for Machine Learning. Morgan Kaufmann, California (1993)

    Google Scholar 

  11. Yin, X.X., Han, J.W., Yang, J., Yu, P.S.: Crossmine: Efficient Classification across Multiple Database Relations. In: ICDE, pp. 399–411 (2004)

    Google Scholar 

  12. Kramer, S.: Relational Learning VS Propositionalization: Investigations in Inductive Logic Programming and Propositional machine learning. Technical report, Vienna University of Technology (1999)

    Google Scholar 

  13. Lavrac, N.: Principles of Knowledge Acquisition in Expert Systems. PhD thesis, Faculty of Technical Sciences, University of Maribor (1990)

    Google Scholar 

  14. Srinivasan, A., King, R.D.: Feature Construction with Inductive Logic Programming: A Study of Quantitative Predictions of Biological Activity Aided by Structural Attributes. Data Mining Knowledge Discovery 3(1), 37–57 (1999)

    Article  Google Scholar 

  15. Krogel, M.A.: On Propositionalization for Knowledge Discovery in Relational Databases. PhD thesis, Fakultat fur Informatik, Germany (2005)

    Google Scholar 

  16. Perlich, C., Provost, F.: Aggregation-based Feature Invention and Relational Concept Classes. In: Proceedings of the 9th International Conference on Knowledge Discovery and Data Mining, New York, pp. 167–176 (2003)

    Google Scholar 

  17. Molina, L.C., Belanche, L., Nebot, A.: Feature Selection Algorithms: A Survey and Experimental Evaluation. In: ICDM 2002 (2002)

    Google Scholar 

  18. Yin, X.X., Han, J.W., Yu, P.S.: Cross-Relational Clustering with User’s Guidance. In: KDD 2005 (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zou, M., Wang, T., Li, H., Yang, D. (2010). A General Multi-relational Classification Approach Using Feature Generation and Selection. In: Cao, L., Zhong, J., Feng, Y. (eds) Advanced Data Mining and Applications. ADMA 2010. Lecture Notes in Computer Science(), vol 6441. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17313-4_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-17313-4_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-17312-7

  • Online ISBN: 978-3-642-17313-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics