Skip to main content
Springer Nature Link
Log in

Support top irrelevant machine: learning similarity measures to maximize top precision for image retrieval

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Top precision is one of the most popular performance measures for content-based image retrieval task, while similarity function is the most critical component of a content-based image retrieval system. However, surprisingly, there is no existing similarity function learning method proposed to maximize the top precision measure. To fill this gap, in this paper, we propose the problem of maximum top precision similarity learning, and the first solution to this problem. The similarity is a linear function of the conjunction of features of a query image and a database image. To learn the similarity function parameter matrix, we propose to maximize the top precision measures of the training queries and also minimize the squared \(\ell _2\) norm of the parameter matrix. The optimization problem is translated to a quadratic programming problem with regard to the Lagrange multipliers of top irrelevant images. The proposed algorithm, named as support top irrelevant machine, is evaluated over four benchmark image databases and is advantage over other similarity learning methods measured by top precision is shown.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Agarwal S (2011) The infinite push: a new support vector ranking algorithm that directly optimizes accuracy at the absolute top of the list. In: Proceedings of the 11th SIAM international conference on data mining, SDM 2011, pp 839–850

  2. Ahsan S, Tan J, Kim H, Ishikawa S (2016) Spatiotemporal lbp and shape feature for human activity representation and recognition. Int J Innov Comput Inf Control 12(1):1–13

    Google Scholar 

  3. Boyd S, Cortes C, Mohri M, Radovanovic A (2012) Accuracy at the top. Adv Neural Inf Process Syst 2:953–961

    Google Scholar 

  4. Caballero D, Antequera T, Caro A, Duran M, Perez-Palacios T (2016) Data mining on MRI-computational texture features to predict sensory characteristics in ham. Food Bioprocess Technol 9(4):699–708

    Article  Google Scholar 

  5. Chechik G, Sharma V, Shalit U, Bengio S (2009) Large scale online learning of image similarity through ranking. Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) 5524 LNCS, pp 11–14

  6. Clémenc on S, Vayatis N (2007) Ranking the best instances. J Mach Learn Res 8:2671–2699

    MathSciNet  MATH  Google Scholar 

  7. Duong T (2016) Non-parametric smoothed estimation of multivariate cumulative distribution and survival functions, and receiver operating characteristic curves. J Korean Stat Soc 45(1):33–50

    Article  MathSciNet  MATH  Google Scholar 

  8. Prema CE, Vinsley S, Suresh S (2016) Multi feature analysis of smoke in YUV color space for early forest fire detection. Fire Technol 1–24

  9. Fan X, Malone B, Yuan C (2014) Finding optimal bayesian network structures with constraints learned from data. In: Proceedings of the 30th conference on uncertainty in artificial intelligence (UAI-2014), pp 200–209

  10. Fan X, Tang K (2010) Enhanced maximum auc linear classifier. In: Fuzzy systems and knowledge discovery (FSKD), 2010 seventh international conference on, vol 4, pp 1540–1544. IEEE

  11. Fan X, Tang K, Weise T (2011) Margin-based over-sampling method for learning from imbalanced datasets. In: Proceedings of the 15th Pacific-Asia conference on knowledge discovery and data mining (PAKDD-2011), pp 309–320. Springer, Berlin

  12. Fan X, Yuan C (2015) An improved lower bound for bayesian network structure learning. In: Proceedings of the 29th AAAI conference on artificial intelligence (AAAI-2015), pp 3526–3532

  13. Fan X, Yuan C, Malone B (2014) Tightening bounds for bayesian network structure learning. In: Proceedings of the 28th AAAI conference on artificial intelligence (AAAI-2014), vol 4, pp 2439–2445

  14. Google image search. https://images.google.com

  15. Griffin G, Holub A, Perona P (2007) Caltech-256 object category dataset

  16. Guo K, Duan G (2014) 3D image retrieval based on differential geometry and co-occurrence matrix. Neural Comput Appl 24(3–4):715–721

    Article  Google Scholar 

  17. Hao S, Zhao P, Hoi S, Miao C (2015) Learning relative similarity from data streams: Active online learning approaches. In: International conference on information and knowledge management, proceedings, vol 19, 23 Oct 2015, pp 1181–1190

  18. Hoi SC, Liu W, Lyu MR, Ma WY (2006) Learning distance metrics with contextual constraints for image retrieval. In: Computer vision and pattern recognition, 2006 IEEE computer society conference on, vol 2, pp 2072–2078. IEEE

  19. Hong W, Tang K (2016) Convex hull-based multi-objective evolutionary computation for maximizing receiver operating characteristics performance. Memet Comput 8(1):35–44

    Article  Google Scholar 

  20. Jayasekara S, Dassanayake H, Fernando A (2013) A novel image retrieval system based on histogram factorization and contextual similarity learning. In: Applied mechanics and materials, vol 380, pp 4148–4151. Trans Tech Publ

  21. Kang C, Liao S, He Y, Wang J, Niu W, Xiang S, Pan C (2015) Cross-modal similarity learning: A low rank bilinear formulation. In: International conference on information and knowledge management, proceedings, vol 19, 23 Oct 2015, pp 1251–1260

  22. Khan Y, Ahmad F, Khan S (2014) Content-based image retrieval using extroverted semantics: a probabilistic approach. Neural Comput Appl 24(7–8):1735–1748

    Article  Google Scholar 

  23. Ledoux A, Richard N (2016) Color and multiscale texture features from vectorial mathematical morphology. Signal Image Video Process 10(3):431–438

    Article  Google Scholar 

  24. Li N, Jin R, Zhou ZH (2014) Top rank optimization in linear time. In: Advances in neural information processing systems, pp 1502–1510

  25. Lin F, Wang J, Zhang N, Xiahou J, McDonald N (2016) Multi-kernel learning for multivariate performance measures optimization. Neural computing and applications, pp 1–13

  26. Lin WC, Tsai CF, Chen ZY, Ke SW (2016) Keypoint selection for efficient bag-of-words feature generation and effective image classification. Inf Sci 329:33–51

    Article  Google Scholar 

  27. Liu X, Wang J, Yin M, Edwards B, Xu P (2015) Supervised learning of sparse context reconstruction coefficients for data representation and classification. Neural computing and applications, pp 1–9

  28. Liu Y, Shi Z, Liu Z, Li X, Wang G (2015) Learning query and image similarities with listwise supervision. In: 2015 IEEE 17th international workshop on multimedia signal processing, MMSP 2015, p 7340793

  29. Luo Q, Peng Y, Li J, Peng X (2016) Mwpca-icurd: density-based clustering method discovering specific shape original features. Neural computing and applications, pp 1–12

  30. Madhusudhanarao T, Setty S, Srinivas Y (2016) Content based medical image retrieval system based on generalized gamma distribution and feature matching methodology. Curr Med Imaging Rev 12(1):28–35

    Article  Google Scholar 

  31. Mohamadzadeh S, Farsi H (2016) Content-based image retrieval system via sparse representation. IET Comput Vis 10(1):95–102

    Article  MATH  Google Scholar 

  32. Quattoni A, Torralba A (2009) Recognizing indoor scenes. In: 2009 IEEE computer society conference on computer vision and pattern recognition workshops, CVPR workshops 2009, pp 413–420

  33. Rastghalam R, Pourghassem H (2016) Breast cancer detection using mrf-based probable texture feature and decision-level fusion-based classification using hmm on thermography images. Pattern Recognit 51:176–186

    Article  Google Scholar 

  34. Ren Y (2016) A comparative study of irregular pyramid matching in bag-of-bags of words model for image retrieval. Signal Image Video Process 10(3):471–478

    Article  Google Scholar 

  35. Usunier N, Buffoni D, Gallinari P (2009) Ranking with ordered weighted pairwise classification. In: Proceedings of the 26th international conference on machine learning, ICML 2009, pp 1057–1064

  36. Wang G, Hoiem D, Forsyth D (2012) Learning image similarity from flickr groups using fast kernel machines. IEEE Trans Pattern Anal Mach Intell 34(11):2177–2188

    Article  Google Scholar 

  37. Wang H, Wang J (2014) An effective image representation method using kernel classification. In: 2014 IEEE 26th international conference on tools with artificial intelligence (ICTAI 2014), pp 853–858

  38. Wang HJ, Chang CY (2012) Semantic real-world image classification for image retrieval with fuzzy-art neural network. Neural Comput Appl 21(8):2137–2151

    Article  Google Scholar 

  39. Wang J, Wang H, Zhou Y, McDonald N (2015) Multiple kernel multivariate performance learning using cutting plane algorithm. In: Systems, man, and cybernetics (SMC), 2015 IEEE international conference on, pp 1870–1875. IEEE

  40. Wang J, Zhou Y, Duan K, Wang JJY, Bensmail H (2015) Supervised cross-modal factor analysis for multiple modal data classification. In: Systems, man, and cybernetics (SMC), 2015 IEEE international conference on, pp 1882–1888. IEEE

  41. Xia H, Hoi S, Jin R, Zhao P (2014) Online multiple kernel similarity learning for visual search. IEEE Trans Pattern Anal Mach Intell 36(3):536–549

    Article  Google Scholar 

  42. Yang L, Jin R, Mummert L, Sukthankar R, Goode A, Zheng B, Hoi S, Satyanarayanan M (2010) A boosting framework for visuality-preserving distance metric learning and its application to medical image retrieval. IEEE Trans Pattern Anal Mach Intell 32(1):30–44

    Article  Google Scholar 

  43. Yu J, Amores J, Sebe N, Radeva P, Tian Q (2008) Distance learning for similarity estimation. IEEE Trans Pattern Anal Mach Intell 30(3):451–462

    Article  Google Scholar 

  44. Zhang R, Lin L, Zhang R, Zuo W, Zhang L (2015) Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification. IEEE Trans Image Process 24(12):4766–4779

    Article  MathSciNet  Google Scholar 

  45. Zhou S, Meng J, Huang Z, Jiang S, Tu Y (2016) A method for discrimination of processed ginger based on image color feature and a support vector machine model. Anal Methods 8(10):2201–2206

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Shandong Medical College, Linyi, 276000, Shandong, China

    Jiandong Meng & Yan Jiang

  2. Beijing Institute of Near Space Vehicle Systems Engineering, Beijing, 100076, China

    Xiaoliang Xu

  3. Department of Electrical Engineering, Institute of Technology Sepuluh Nopember, Surabaya, 60111, Indonesia

    Irfani Priananda

Authors
  1. Jiandong Meng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yan Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaoliang Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Irfani Priananda
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiandong Meng.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Meng, J., Jiang, Y., Xu, X. et al. Support top irrelevant machine: learning similarity measures to maximize top precision for image retrieval. Neural Comput & Applic 28 (Suppl 1), 1145–1154 (2017). https://doi.org/10.1007/s00521-016-2431-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-016-2431-4

Keywords