Abstract
In the multi-instance multi-label learning framework, an example is described by multiple instances and associated with multiple class labels at the same time. An idea of tackling with multi-instance multi-label problems is to identify its equivalence in the traditional supervised learning framework. However, some useful information such as the correlation between labels may be lost in the process of degeneration, which will influence the classification performance. In E-MIMLSVM+ algorithm, multi-task learning techniques are utilized to incorporate label correlations, while it is time consuming as well as memory consuming. Therefore, we propose an improved algorithm. In our algorithm, the classifier chains method is applied in E-MIMLSVM+ to incorporate label correlations instead of multi-task learning techniques. The experimental results show that the proposed algorithm can reduce time complexity and improve the predictive performance.
Similar content being viewed by others
References
Zhou ZH, Zhang ML (2006) Multi-instance multi-label learning with application to scene classification. Neural Inf Process Sys (NIPS):1609–1616
Zhou ZH, Zhang ML et al (2012) Multi-instance multi-label learning. Artif Intell 176(1):2291–2320
Zhang ML, Wang ZJ (2009) MIMLRBF: RBF neural networks for multi-instance multi-label learning. Neurocomputing 72(16–18):3951–3956
Vapnik V (1995) The nature of statistical learning theory. Springer-Verlag, New York
Li CH, Liu KW, W HX (2011) The incremental learning algorithm with support vector machine based on hyperplane-distance. Appl Intell 34(1):19–27
Qian HM, Mao YB, Xiang WB, Wang ZQ (2010) Recognition of human activities using SVM multi-class classifier. Pattern Recogn Lett 31:100–111
Chen WJ, Shao YH, Xu DK (2014) Manifold proximal support vector machine for semi-supervised classification. Appl Intell 40(4):623–638
Li YX, Ji SW, Kumar S, Ye JP, Zhou ZH (2012) Drosophila gene expression pattern annotation through multi-instance multi-label learning. Trans Comput Biol Bioinformatics 9(1):98–112
Gartner T, Flach PA, Smola AJ (2002) Multi-instance kernels. In: Proceedings of the 19th intenational conference on machine learning, Sydney, Australia pp 179–186
Evgeniou T, Pontil M (2004) Regularized multi-task learning. In: Proceedings of the 10th ACM SIGKDD international conference knowledge discovery data mining, pp 109–117
Zhang J, Ghahramani Z, Yang Y (2008) Flexible latent variable models for multi-task learning. Mach Learn 73(3):221–242
Evgeniou T, Micchelli CA, Pontil M (2005) Learning multiple tasks with kernel methods. Mach Learn Res 6:615–637
Dietterich TG, Lathrop RH, Lozano-Pérez T (1997) Solving the multiple-instance problem with axis-parallel rectangles. Artif Intell 89(1-2):31–71
Boutell MR, Luo J, Shen X, Brown CM (2004) Learning multi-label scene classification. Pattern Recogn 37(9):1757–1771
Schapire RE, Singer Y (2000) BoosTexter: a boosting-based system for text categorization. Mach Learn 39(2-3):135– 168
Zhou ZH, Zhang ML, Huang SJ, Li YF (2008) MIML: a framework for learning with ambiguous objects. CORR abs/0808. 3231
Zhang ML, Zhou ZH (2008) M3MIML: A maximum margin method for multi-instance multi-label learning. In: Proceedings of the 8th IEEE international conference on data mining (ICDM’08). Pisa, Italy, pp 688–697
Haussler D (1999) Convolution kernels on discrete structures. Technical report UCSC-CRL-99-10, Department of Computer Science, University of California at Santa Cruz, CA, Santa Cruz
Jesse R, Bernhard P, Geoff H, Eibe F (2011) Classifier chain for multi-label classification. Mach Learn 85:333–359
Tsoumakas G, Katakis (2007) Multi label classification: an overview. Int J Data Warehous Min 3(3):1–13
Sebastiani F (2002) Machine learning in automated text categorization. ACM Comput Surv 34(1):1–47
Andrews S, Tsochantaridis I, Hofmann T (2003) Support vector machines for multiple-instance learning. In Adv 696 in Neural Inf Process Syst 15(15):561–568
Salton G (1989) Automatic text processing: The transformation, analysis, and retrieval of information by computer. Addison-Wesley Reading, Pennsylvania
Dumais ST, Platt J, Heckerman D, Sahami M (1998) Inductivelearning algorithms and representation for text categorization. In: Proceedings of the 7th ACM international conference on information and knowledge management, Bethesda, MD, pp 148–155
Yang Y, Pedersen JO (1997) A comparative study on feature selection in text categorization. In: Proceedings of the 14th international conference on machine learning, pp 412–420
Acknowledgments
This paper is supported by the Fundamental Research Funds for the Central Universities (No. R1407008A, 09CX04031A). The authors are grateful for the anonymous reviewers who made constructive comments.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, C., Zhang, Y. & Lu, L. An MIMLSVM algorithm based on ECC. Appl Intell 42, 537–543 (2015). https://doi.org/10.1007/s10489-014-0608-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-014-0608-z