Skip to main content
Log in

A multi-instance multi-label learning algorithm based on instance correlations

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Existing multi-instance multi-label learning algorithms generally assume that instances in a bag are independent of each other, which is difficult to be guaranteed in practical applications. A novel multi-instance multi-label learning algorithm is proposed by modeling instance correlations in each bag. First, instance correlations are introduced in multi-instance multi-label learning by constructing graphs. Then, different kernel matrices are derived from kernel functions based on graphs at different scales, which are employed to train Multiple Kernel Support Vector Machine (MKSVM) classifiers. Experimental results on different datasets show that the proposed method significantly improves the accuracy of the multi-label classification compared with the state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Andrews S, Hofmann T, Tsochantaridis I (2002) Multiple instance learning with generalized support vector machines. Proceedings of the 18th national conference on artificial intelligence, pp 943–944

  2. Andrews S, Tsochantaridis I, Hofmann T (2003) Support vector machines for multiple-instance learning. Adv Neural Inf Proces Syst 15:561–568

    Google Scholar 

  3. Boutell MR, Luo J, Shen X et al (2004) Learning multi-label scene classification. Pattern Recogn 37(9):1757–1771

    Article  Google Scholar 

  4. Briggs F, Fern XZ, Raich R (2012) Rank-loss support instance machines for MIML instance annotation. Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 534–542

  5. Chen YX, Bi JB, Wang JZ (2006) MILES: multiple-instance learning via embedded instance selection. IEEE Trans Pattern Anal Mach Intell:1931–1947

  6. Chen YX, Wang JZ (2004) Image categorization by learning and reasoning with regions. J Mach Learn Res 5(8):913–939

    MathSciNet  Google Scholar 

  7. Chowdhury M, Kundu MK (2015) Comparative assessment of efficiency for content based image retrieval systems using different wavelet features and pre-classifier. Multimed Tools Appl 74(24):11595–11630

    Article  Google Scholar 

  8. Deselaers T, Ferrari V (2010) A conditional random field for multiple-instance learning. Proceedings of the 27th International Conference on Machine Learning, pp 287–294

  9. Dietterich TG, Lathrop RH, Lozano-Pérez T (1997) Solving the multiple instance problem with axis-parallel rectangles. Artif Intell 89(1–2):31–71

    Article  MATH  Google Scholar 

  10. Dubey SR, Singh SK, Singh RK (2015) A multi-channel based illumination compensation mechanism for brightness invariant image retrieval. Multimed Tools Appl 74(24):11223–11253

    Article  Google Scholar 

  11. Feng SH, Xiong WH, Li B, Lang CY, Huang XK (2014) Hierarchical sparse representation based multi-instance semi-supervised learning with application to image categorization. Signal Process 94(1):595–607

    Article  Google Scholar 

  12. Fu Z, Robles-Kelly A, Zhou J (2011) MILIS: multiple instance learning with instance selection. IEEE Trans Pattern Anal Mach Intell 33(5):958–977

    Article  Google Scholar 

  13. Fung G, Dundar M, Krishnappuram B, Rao RB (2007) Multiple instance learning for computer aided diagnosis. Adv Neural Inf Proces Syst 19:425–432

    Google Scholar 

  14. Gärtner T, Flach PA, Kowalczyk A, Smola AJ (2002) Multi-instance kernels. Proceedings of the 19th International Conference on Machine Learning, pp 179–186

  15. Hu C, Bai X, Qi L, Wang X, Xue G, Mei L (2015) Learning discriminative pattern for real-time car brand recognition. IEEE Trans Intelli Transp Syst 16(6):3170–3181

    Article  Google Scholar 

  16. Hu C, Xu Z et al (2014) Semantic link network based model for organizing multimedia big data. IEEE Trans Emerg Top Comput 2(3):376–387

    Article  MathSciNet  Google Scholar 

  17. Hu C, Xu Z et al (2015) Video structured description technology for the new generation video surveillance system. Front Comput Sci 9(6):980–989

    Article  Google Scholar 

  18. Huang SJ, Gao W, Zhou ZH (2014) Fast multi-instance multi-label learning. Proceedings of the 28th AAAI Conference on Artificial Intelligence, pp 1868–1874

  19. Huang YG, Huang HY, Zhang J (2013) A noisy-smoothing relevance feedback method for content-based medical image retrieval. Multimed Tools Appl 73(3):1963–1981

    Article  Google Scholar 

  20. Indyk W, Kajdanowicz T, Kazienko P (2013) Relational large scale multi-label classification method for video categorization. Multimed Tools Appl 65(1):63–74

    Article  Google Scholar 

  21. Jorgensen Z, Zhou Y, Inge M (2008) A multiple instance learning strategy for combating good word attacks on spam filters. J Mach Learn Res 8:993–1019

    Google Scholar 

  22. Li YF, Hu JH, Jiang Y, Zhou ZH (2012) Towards discovering what patterns trigger what labels. Proceedings of the 26th AAAI Conference on Artificial Intelligence, pp 1012–1018

  23. Li B, Xiong WH, Hu WM (2011) Context-aware multi-instance learning based on hierarchical sparse representation. IEEE International Conference on Data Mining, pp 370–377

  24. Liu G, Wu J, Zhou ZH (2012) Key instance detection in multi-instance learning. Proceedings of the 4th Asian Conference on Machine Learning, pp 253–268

  25. Maron O, Lozano-Pérez T (1998) A framework for multiple-instance learning. Adv Neural Inf Proces Syst 10:570–576

    Google Scholar 

  26. Maron O, Ratan AL (1998) Multiple-instance learning for natural scene classification. Proceedings of the 15th International Conference on Machine Learning, pp 341–349

  27. Neal L, Briggs F, Raich R, Fern XZ (2011) Time-frequency segmentation of bird song in noisy acoustic environments. Proceedings of IEEE International Conference Acoustics, Speech, and Signal Processing, pp 2012–2015

  28. Rahmani R, Goldman SA (2006) MISSL: multiple instance semi-supervised learning, Proceedings of the 23rd international conference on machine learning, pp 705–712

  29. Rakotomamonjy A, Bach FR, Canu S, Grandvalet Y (2008) SimpleMKL. J Mach Learn 9(11):2491–2521

    MathSciNet  MATH  Google Scholar 

  30. Ruffo G (2000) Learning single and multiple instance decision trees for computer security applications. University of Turin, Torino

    Google Scholar 

  31. Salton G (1989) Automatic text processing: the transformation, analysis, and retrieval of information by computer. Addison-Wesley, Reading

    Google Scholar 

  32. Settles B, Craven M, Ray S (2008) Multiple-instance active learning. Adv Neural Inf Proces Syst 20:1289–1296

    Google Scholar 

  33. Viola P, Platt J, Zhang C (2006) Multiple instance boosting for object detection. Adv Neural Inf Proces Syst 18:1419–1426

    Google Scholar 

  34. Wang H, Huang H, Kamangar F (2011) Maximum margin multi-instance learning. Proceedings of the 24th Neural Information Processing Systems (NIPS, 2011), pp 153–1613

  35. Wang CH, Zhang L, Zhang HJ (2008) Graph-based multiple-instance learning for object-based image retrieval. Proceedings of the 1st ACM international conference on multimedia information retrieval, pp 156–163

  36. Wang J, Zucker JD (2000) Solving the multiple-instance problem: A lazy learning approach. Proceedings of the 17th international conference on machine learning, pp 1119–1125

  37. Winn J, Criminisi A, Minka T (2005) Object categorization by learned universal visual dictionary. Proceedings of the 10th IEEE International Conference on Computer Vision, pp 1800–1807

  38. Winn J, Criminisi A, Minka T (2005) Object categorization by learned universal visual dictionary. Proceedings of 10th IEEE International Conference on Computer Vision, vol. 2. pp 1800–1807

  39. Wu JS, Huang SJ, Zhou ZH (2014) Genome-wide protein function prediction through multi-instance multi-label learning. ACM/IEEE Trans Comput Biol Bioinformat 11(5):891–902

    Article  Google Scholar 

  40. Xu X, Frank E (2004) Logistic regression and boosting for labeled bags of instances, Advances in knowledge discovery and data mining. Springer, Berlin Heidelberg, pp 272–281

    Book  Google Scholar 

  41. Xu XS, Jiang Y, Xue XY, Zhou ZH (2012) Semi-supervised multi-instance multi-label learning for video annotation task. Proceedings of the 20th ACM International Conference on Multimedia, pp 737–740

  42. Xu XS, Xue X, Zhou ZH (2011) Ensemble multi-instance multi-label learning approach for video annotation task. Proceedings of the 19th ACM international conference on Multimedia, pp 1153–1156

  43. Xu Z et al (2015) Semantic based representing and organizing surveillance big data using video structural description technology. J Syst Softw 102:217–225

    Article  Google Scholar 

  44. Xu Z et al (2016) Semantic enhanced cloud environment for surveillance data management using video structural description. Computing 98(1–2):35–54

    Article  MathSciNet  MATH  Google Scholar 

  45. Yakhnenko O (2009) Learning from text and images: generative and discriminative models for partially labeled data, PhD thesis, Iowa State University

  46. Yang SJ, Jiang Y, Zhou ZH (2013) Multi-instance multi-label learning with weak label. Proceedings of the 23rd International Joint Conference on Artificial Intelligence, pp 1862–1868

  47. Yang Y, Pedersen JO (1997) A comparative study on feature selection in text categorization. Proceedings of the 14th International Conference on Machine Learning, pp 412–420

  48. Yang S, Zha H, Hu B (2009) Dirichlet-bernoulli alignment: a generative model for multi-class multi-label multi-instance corpora. Adv Neural Inf Proces Syst 22:2143–2150

    Google Scholar 

  49. Zha ZJ, Hua XS, Mei T, Wang JD, Qi GJ, Wang ZF (2008) Joint multi-label multi-instance learning for image classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1–8

  50. Zhang ML (2010) A k-nearest neighbor based multi-instance multi-label learning algorithm. Proceedings of the 22th IEEE International Conference on Tools with Artificial Intelligence, pp 207–212

  51. Zhang Q, Goldman SA (2002) EM-DD: an improved multiple-instance learning technique. Adv Neural Inf Proces Syst 14:1073–1080

    Google Scholar 

  52. Zhang Q, Goldman SA, Yu W, Fritts JE (2002) Content-based image retrieval using multiple-instance learning. Proceedings of the 19th International Conference on Machine Learning, pp 682–689

  53. Zhang C, Viola P (2008) Multiple-instance pruning for learning efficient cascade detectors. Adv Neural Inf Proces Syst 20:1681–1688

    Google Scholar 

  54. Zhang SQ, Zhao XM (2013) Dimensionality reduction-based spoken emotion recognition. Multimed Tools Appl 63(3):615–646

    Article  Google Scholar 

  55. Zhang ML, Zhou ZH (2007) Multi-label learning by instance differentiation. Proceedings of the 22nd AAAI Conference on Artificial Intelligence, pp 669–674

  56. Zhang ML, Zhou ZH (2007) ML-kNN: A lazy learning approach to multi-label learning. Pattern Recogn 40(7):2038–2048

    Article  MATH  Google Scholar 

  57. Zhou ZH, Jiang K, Li M (2005) Multi-instance learning based web mining. Appl Intell 22(2):135–147

    Article  Google Scholar 

  58. Zhou ZH, Sun YY, Li YF (2009) Multi-instance learning by treating instances as non-I.I.D. samples. Proceedings of the 26th International Conference on Machine Learning, pp 1249–1256

  59. Zhou ZH, Xu JM (2007) On the relation between multi-instance learning and semi-supervised learning. Proceedings of the 24th ICML, pp 1167–1174

  60. Zhou ZH, Xu JM (2007) On the relation between multi-instance learning and semi-supervised learning. Proceedings of the 24th International Conference on Machine Learning, pp 1167–1174

  61. Zhou ZH, Zhang ML (2007) Multi-instance multi-label learning with application to scene classification. Adv Neural Inf Proces Syst 19:1609–1616

    Google Scholar 

  62. Zhou ZH, Zhang ML, Huang SJ, Li YF (2012) Multi-instance multi-label learning. Artif Intell 176(1):2291–2320

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgments

This work is supported by the National Science Foundation of China (No.61170161, No.61300155, No.61303086), Shandong Province Scholarship Council, Ph.D. Programs Foundation of Ludong University (No. LY2014033).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chanjuan Liu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, C., Chen, T., Ding, X. et al. A multi-instance multi-label learning algorithm based on instance correlations. Multimed Tools Appl 75, 12263–12284 (2016). https://doi.org/10.1007/s11042-016-3494-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3494-z

Keywords

Navigation