Skip to main content

Improving Multiclass ILP by Combining Partial Rules with Winnow Algorithm: Results on Classification of Dopamine Antagonist Molecules

  • Conference paper
  • First Online:
Book cover New Frontiers in Artificial Intelligence (JSAI 2003, JSAI 2004)

Abstract

In this paper, we propose an approach which can improve Inductive Logic Programming in multiclass problems. This approach is based on the idea that if a whole rule cannot be applied to an example, some partial matches of the rule can be useful. The most suitable class should be the class whose important partial matches cover the example more than those from other classes. Hence, the partial matches of the rule, called partial rules, are first extracted from the original rules. Then, we utilize the idea of Winnow algorithm to weigh each partial rule. Finally, the partial rules and the weights are combined and used to classify new examples. The weights of partial rules show another aspect of the knowledge which can be discovered from the data set. In the experiments, we apply our approach to a multiclass real-world problem, classification of dopamine antagonist molecules. The experimental results show that the proposed method gives the improvement over the original rules and yields 88.58% accuracy by running 10-fold cross validation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Enot, D.P., King, R.D.: Application of Inductive Logic Programming to Structure-based Drug Design. In: Lavrač, N., Gamberger, D., Todorovski, L., Blockeel, H. (eds.) PKDD 2003. LNCS (LNAI), vol. 2838, Springer, Heidelberg (2003)

    Google Scholar 

  2. Quiniou, R., Cordier, M.-O., Carrault, G., Wang, F.: Application of ILP to cardiac arrhythmia characterization for chronicle recognition. In: Rouveirol, C., Sebag, M. (eds.) ILP 2001. LNCS (LNAI), vol. 2157, pp. 220–227. Springer, Heidelberg (2001), citeseer.nj.nec.com/quiniou01application.html

    Chapter  Google Scholar 

  3. Littlestone, N.: Learning quickly when irrelevant attributes abound: A new linearthreshold algorithm. Machine Learning 2(4), 285–318 (1988)

    Google Scholar 

  4. Srinivasan, A., King, R.D.: Feature construction with inductive logic programming: A study of quantitative predictions of biological activity aided by structural attributes. In: Muggleton, S. (ed.) Inductive Logic Programming. LNCS, vol. 1314, pp. 89–104. Springer, Heidelberg (1997)

    Chapter  Google Scholar 

  5. Dietterich, T.G., Bakiri, G.: Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research 2, 263–286 (1995), citeseer.ist.psu.edu/dietterich95solving.html

    Article  Google Scholar 

  6. Fürnkranz, J.: Round robin rule learning. In: Brodley, C.E., Danyluk, A.P. (eds.) Proceedings of the 18th International Conference on Machine Learning (ICML-01), pp. 146–153. Morgan Kaufmann, Williamstown (2001), citeseer.nj.nec.com/frnkranz01round.html

    Google Scholar 

  7. Eineborg, M., Boström, H.: Classifying uncovered examples by rule stretching. In: Rouveirol, C., Sebag, M. (eds.) ILP 2001. LNCS (LNAI), vol. 2157, Springer, Heidelberg (2001), citeseer.nj.nec.com/598900.html

    Chapter  Google Scholar 

  8. Allwein, E.L., Schapire, R.E., Singer, Y.: Reducing multiclass to binary: A unifying approach for margin classifiers. In: Proc. 17th International Conf. on Machine Learning, pp. 9–16. Morgan Kaufmann, San Francisco (2000), citeseer.nj.nec.com/allwein00reducing.html

    Google Scholar 

  9. Srinivasan, A.: The Aleph Manual (2001)

    Google Scholar 

  10. Selman, B., Levesque, H.J., Mitchell, D.: A New Method for Solving Hard Satisfiability Problems. In: Proc. 10th National Conference on Artificial Intelligence, pp. 440–446. AAAI Press, Menlo Park (1992)

    Google Scholar 

  11. Kijsirikul, B., Sinthupinyo, S., Chongkasemwongse, K.: Approximate match of rules using backpropagation neural networks. Machine Learning 44(3), 273–299 (2001)

    Article  Google Scholar 

  12. Clark, P., Boswell, R.: Rule induction with CN2: Some recent improvements. In: Kodratoff, Y. (ed.) Machine Learning - EWSL-91. LNCS, vol. 482, pp. 151–163. Springer, Heidelberg (1991)

    Chapter  Google Scholar 

  13. Van Laer, W., De Raedt, L., Dzeroski, S.: On multi-class problems and discretization in inductive logic programming. In: International Syposium on Methodologies for Intelligent Systems, pp. 277–286 (1997), citeseer.nj.nec.com/vanlaer97multiclass.html

  14. Quinlan, J.R.: C4.5: Programs for machine learning. Morgan Kaufmann, San Francisco (1993)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Akito Sakurai Kôiti Hasida Katsumi Nitta

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer Berlin Heidelberg

About this paper

Cite this paper

Sinthupinyo, S., Nattee, C., Numao, M., Okada, T., Kijsirikul, B. (2007). Improving Multiclass ILP by Combining Partial Rules with Winnow Algorithm: Results on Classification of Dopamine Antagonist Molecules. In: Sakurai, A., Hasida, K., Nitta, K. (eds) New Frontiers in Artificial Intelligence. JSAI JSAI 2003 2004. Lecture Notes in Computer Science(), vol 3609. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71009-7_50

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-71009-7_50

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-71008-0

  • Online ISBN: 978-3-540-71009-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics