Abstract
In this paper, we propose an approach which can improve Inductive Logic Programming in multiclass problems. This approach is based on the idea that if a whole rule cannot be applied to an example, some partial matches of the rule can be useful. The most suitable class should be the class whose important partial matches cover the example more than those from other classes. Hence, the partial matches of the rule, called partial rules, are first extracted from the original rules. Then, we utilize the idea of Winnow algorithm to weigh each partial rule. Finally, the partial rules and the weights are combined and used to classify new examples. The weights of partial rules show another aspect of the knowledge which can be discovered from the data set. In the experiments, we apply our approach to a multiclass real-world problem, classification of dopamine antagonist molecules. The experimental results show that the proposed method gives the improvement over the original rules and yields 88.58% accuracy by running 10-fold cross validation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Enot, D.P., King, R.D.: Application of Inductive Logic Programming to Structure-based Drug Design. In: Lavrač, N., Gamberger, D., Todorovski, L., Blockeel, H. (eds.) PKDD 2003. LNCS (LNAI), vol. 2838, Springer, Heidelberg (2003)
Quiniou, R., Cordier, M.-O., Carrault, G., Wang, F.: Application of ILP to cardiac arrhythmia characterization for chronicle recognition. In: Rouveirol, C., Sebag, M. (eds.) ILP 2001. LNCS (LNAI), vol. 2157, pp. 220–227. Springer, Heidelberg (2001), citeseer.nj.nec.com/quiniou01application.html
Littlestone, N.: Learning quickly when irrelevant attributes abound: A new linearthreshold algorithm. Machine Learning 2(4), 285–318 (1988)
Srinivasan, A., King, R.D.: Feature construction with inductive logic programming: A study of quantitative predictions of biological activity aided by structural attributes. In: Muggleton, S. (ed.) Inductive Logic Programming. LNCS, vol. 1314, pp. 89–104. Springer, Heidelberg (1997)
Dietterich, T.G., Bakiri, G.: Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research 2, 263–286 (1995), citeseer.ist.psu.edu/dietterich95solving.html
Fürnkranz, J.: Round robin rule learning. In: Brodley, C.E., Danyluk, A.P. (eds.) Proceedings of the 18th International Conference on Machine Learning (ICML-01), pp. 146–153. Morgan Kaufmann, Williamstown (2001), citeseer.nj.nec.com/frnkranz01round.html
Eineborg, M., Boström, H.: Classifying uncovered examples by rule stretching. In: Rouveirol, C., Sebag, M. (eds.) ILP 2001. LNCS (LNAI), vol. 2157, Springer, Heidelberg (2001), citeseer.nj.nec.com/598900.html
Allwein, E.L., Schapire, R.E., Singer, Y.: Reducing multiclass to binary: A unifying approach for margin classifiers. In: Proc. 17th International Conf. on Machine Learning, pp. 9–16. Morgan Kaufmann, San Francisco (2000), citeseer.nj.nec.com/allwein00reducing.html
Srinivasan, A.: The Aleph Manual (2001)
Selman, B., Levesque, H.J., Mitchell, D.: A New Method for Solving Hard Satisfiability Problems. In: Proc. 10th National Conference on Artificial Intelligence, pp. 440–446. AAAI Press, Menlo Park (1992)
Kijsirikul, B., Sinthupinyo, S., Chongkasemwongse, K.: Approximate match of rules using backpropagation neural networks. Machine Learning 44(3), 273–299 (2001)
Clark, P., Boswell, R.: Rule induction with CN2: Some recent improvements. In: Kodratoff, Y. (ed.) Machine Learning - EWSL-91. LNCS, vol. 482, pp. 151–163. Springer, Heidelberg (1991)
Van Laer, W., De Raedt, L., Dzeroski, S.: On multi-class problems and discretization in inductive logic programming. In: International Syposium on Methodologies for Intelligent Systems, pp. 277–286 (1997), citeseer.nj.nec.com/vanlaer97multiclass.html
Quinlan, J.R.: C4.5: Programs for machine learning. Morgan Kaufmann, San Francisco (1993)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Sinthupinyo, S., Nattee, C., Numao, M., Okada, T., Kijsirikul, B. (2007). Improving Multiclass ILP by Combining Partial Rules with Winnow Algorithm: Results on Classification of Dopamine Antagonist Molecules. In: Sakurai, A., Hasida, K., Nitta, K. (eds) New Frontiers in Artificial Intelligence. JSAI JSAI 2003 2004. Lecture Notes in Computer Science(), vol 3609. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71009-7_50
Download citation
DOI: https://doi.org/10.1007/978-3-540-71009-7_50
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-71008-0
Online ISBN: 978-3-540-71009-7
eBook Packages: Computer ScienceComputer Science (R0)