Skip to main content
SpringerLink
Log in

SEAM - an improved environmental adaptation method with real parameter coding for salient object detection

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Object detection is an important problem in computer vision attracting researchers from various domains. It deals with separating objects of interest from their background. Image-related low-level features are used to detect salient objects from images, however these features vary from image to image. There is no single feature that can clearly identify salient objects in all the images. Rather, a linear combination of these features may be useful for detection of salient objects. The computation of optimal weights of these features in a learning algorithm is an NP-Hard problem and requires an approximation of an optimization problem. So in the first phase, three low-level features capturing the edge and color information are extracted from the image. In the second phase, these features are integrated to form the saliency map. The linear weights are used for the combination which guides the dominance of feature(s). Thereafter, a threshold is applied over the saliency map to extract the salient objects. We use a linear weight vector and threshold that play a vital role in increasing the detection accuracy of the model. Identification of these parameters can be mapped to an optimization problem to identify the optimal linear weights best suited for the image. The problem is solved using an improved environmental adaptation method. There are three contributions of the paper. First being the identification of weight vector so that important feature(s) for an image are selected where the salient object is highlighted. The second is posing the salient object detection as an optimization problem with a relevant fitness function. Finally the third is utilization of Environment Adaptation Method (EAM) to solve the optimization problem pointed in the paper. The model is extensively validated over six complex datasets and achieves good results on standard performance measures used in comparison to twenty six related works. Four variants of the optimization algorithm are also presented. The EAM optimizer outperforms the GA, PSO and GWO optimizers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Achanta R, Hemamiz S, Estraday F, Susstrunk S (2009) Frequency-tuned Salient Region Detection, Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1597–1604

  2. Achanta R, Susstrunk S (2010) Saliency Detection using Maximum Symmetric Surround, Proceedings in International Conference on Image Processing, pp. 2653–2656

  3. Arya R, Agrawal RK, Singh N (2019) A novel approach for salient object detection using double-density dual-tree complex wavelet transform in conjunction with superpixel segmentation. Knowl Inf Syst 60(1):327–361

    Google Scholar 

  4. Borji A, Cheng MM, Jiang H, Li J (2014) Salient object detection: A survey. arXiv preprint arXiv:1411.5878

  5. Bruce NDB, Tsotsos JK (2006) Saliency Based on Information Maximization. Adv Neural Inf Proces Syst 18:155–162

    Google Scholar 

  6. Fu H, Cao X, Tu Z (2013) Cluster-based co-saliency detection. IEEE Trans Image Process

  7. Goferman S, Zelnik-Manor L, Tal A (2012) Context-aware saliency detection. IEEE Trans Pattern Anal Mach Intell 34:1915–1926

    Google Scholar 

  8. Graefe R, Efenberger W (1996) A novel approach for the detection of vehicles on freeways by real time vision. Intelligent Vehicles 1996:363–368

    Google Scholar 

  9. Han J, Ngan KN, Li MJ, Zhang HJ (2006) Unsupervised extraction of visual attention objects in color images. IEEE Transactions on Circuit Systems and Video Technology 16:141–145

    Google Scholar 

  10. Harel J, Koch C, Perona P (2007) Graph Based Visual Saliency, Proceedings of the Advances in Neural Information and Processing Systems, pp. 545–552

  11. Hou X, Zhang L (2007) Saliency Detection: A Spectral Residual Approach, Proceedings in IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8

  12. İmamoğlu N, Lin W, Fang Y (2013) A saliency detection model using low-level features based on wavelet transform. IEEE Transactions on Multimedia 15:96–105

    Google Scholar 

  13. Itti L (2000) Models of bottom up and top down visual attention. California Institute of Technology, Pasadena

    Google Scholar 

  14. Itti L, Koch C, Niebur E (1998) A model of saliency based visual attention for rapid scene analysis. IEEE Transactions in Pattern Analysis and Machine Intelligence 20:1254–1259

    Google Scholar 

  15. Jiang H, Wang J, Yuan Z, Wu Y, Zheng N, Li S (2013) Salient object detection: a discriminative regional feature integration approach. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2083-2090

  16. Karssemeijer N (2006) Detection of stellate distortions in mammograms. IEEE Trans Med Imaging 15:611–619

    Google Scholar 

  17. Koch C, Ullman S (1985) Shifts in selective visual attention: towards the underlying neural circuitry. Hum Neurobiol 4:219–227

    Google Scholar 

  18. Li Z, Itti L (2011) Saliency and gist features for target detection in satellite images. IEEE Transactions in Image Processing 20:2017–2029

    MathSciNet  MATH  Google Scholar 

  19. Li G, Yu Y (2016) Deep contrast learning for salient object detection. In proceedings of the IEEE conference on computer vision and pattern recognition (pp. 478-487).

  20. Lin Y, Kong S, Wang D, Zhuang Y (2014) Saliency detection within a deep convolutional architecture. In Workshops at the Twenty-Eighth AAAI Conference on Artificial Intelligence

  21. Liu Z, Shi R, Shen L, Xue Y, Ngan KN, Zhang Z (2012) Unsupervised salient object segmentation based on kernel density estimation and two-phase graph cut. IEEE Transactions on Multimedia 14:1275–1289

    Google Scholar 

  22. Liu T, Yuan Z, Sun-Wang J, Zheng N, Tang X, Shum HY (2011) Learning to detect a salient object. IEEE Trans Pattern Anal Mach Intell 33:353–366

    Google Scholar 

  23. Liu Z, Zou W, Meur OL (2014) Saliency tree: a novel saliency detection framework. IEEE Trans Image Process 23:1937–1952

    MathSciNet  MATH  Google Scholar 

  24. Meur OL, Callet PL, Barba D, Thoreau D (2006) A coherent computational approach to model bottom up visual attention. IEEE Trans Pattern Anal Mach Intell 28:802–817

    Google Scholar 

  25. Peng P, Shao L, Han J, Han J (2015) Saliency-aware image-to-class distances for image classification. Neurocomputing 166:337–345

    Google Scholar 

  26. Qin Y, Lu H, Xu Y, Wang HE (2015) Saliency detection via cellular automata, in: IEEE Conference on Computer Vision and Pattern Recognition, pp.110–119

  27. Rother C, Bordeaux L, Hamadi Y, Blake A (2006) Autocollage. ACM SIGGRAPH 25:847–852

    Google Scholar 

  28. Santella A, Agrawala M, Decarlo D, Salesin D, Cohen M (2006) Gaze Based Interaction for Semi-Automatic Photo Cropping, Proceedings of Conference Human Factors in Computing Systems, pp. 771–780

  29. Shen X, Wu Y (2012) A Unified Approach to Salient Object Detection via Low Rank Matrix Recovery, Proceedings in IEEE Conference on Computer Vision and Pattern Recognition, pp. 853–860

  30. Singh N, Agrawal RK (2013) Combination of Kullback–Leibler divergence and Manhattan distance measures to detect salient objects. Signal Image and Video Processing 9:427–435. https://doi.org/10.1007/s11760-013-0457-y

    Google Scholar 

  31. Singh N, Arya R, Agrawal RK (2014) A novel approach to combine features for salient object detection using constrained particle swarm optimization. Pattern Recogn 47:1731–1739

    Google Scholar 

  32. Singh N, Arya R, Agrawal RK (2016) A convex hull approach in conjunction with Gaussian mixture model for salient object detection. Digital Signal Processing 55:22–31

    Google Scholar 

  33. Singh N, Arya R, Agrawal RK (2017) A novel position prior using fusion of rule of thirds and image center for salient object detection. Multimed Tools Appl 76(8):10521–10538

    Google Scholar 

  34. Singh N, Arya R, Agrawal RK (2017) Performance enhancement of salient object detection using superpixel based Gaussian mixture model. Multimed Tools Appl:1–19

  35. Singh M, Govil MC, Pilli ES (2018) CHACT: convex Hull enabled active contour technique for salient object detection. IEEE Access 6:22441–22451

    Google Scholar 

  36. Singh M, Govil MC, Pilli ES, Vipparthi SK (2019) SOD-CED: salient object detection for noisy images using convolution encoder–decoder. IET Comput Vis 13(6):578–587

    Google Scholar 

  37. Vikram TN, Tscherepanow M, Wrede B (2012) A saliency map based on sampling an image into random rectangular regions of interest. Pattern Recogn 45:3114–3124

    Google Scholar 

  38. Xie Y, Lu H, Yang M-H (2013) Bayesian saliency via low and mid level cues. IEEE Trans Image Process 22:1689–1698

    MathSciNet  MATH  Google Scholar 

  39. Yu Z, Wong HS (2007) A rule based technique for extraction of visual attention regions based on real time clustering. IEEE Transactions on Multimedia 9:766–784

    Google Scholar 

  40. Zhang D, Han J, Han J, Shao L (2016) Cosaliency detection based on intrasaliency prior transfer and deep intersaliency mining. IEEE transactions on neural networks and learning systems 27(6):1163–1176

    MathSciNet  Google Scholar 

  41. Zhang L, Tong MH, Marks TK, Shan H, Cottrell GW (2008) SUN: a Bayesian framework for saliency using natural statistics. J Vis 8:1–20

    Google Scholar 

  42. Zhang W, Wu QMJ, Wang G, Yin H (2010) An adaptive computational model for salient object detection. IEEE Transactions on Multimedia 12:300–315

    Google Scholar 

  43. Zhao R, Ouyang W, Li H, Wang X (2015) Saliency detection by multi-context deep learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1265–1274

  44. Zhu L, Klein DA, Frintrop S, Cao Z, Cremers AB (2014) A multisize Superpixel approach for salient object detection based on multivariate Normal distribution estimation. IEEE Trans Image Process 23:5094–5107

    MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Motilal Nehru National Institute of Technology, Allahabad, India

    Navjot Singh & K. K. Mishra

  2. University of Missouri - St. Louis, St. Louis, Missouri, USA

    Sanjiv Bhatia

Authors
  1. Navjot Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. K. K. Mishra
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sanjiv Bhatia
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Navjot Singh.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, N., Mishra, K.K. & Bhatia, S. SEAM - an improved environmental adaptation method with real parameter coding for salient object detection. Multimed Tools Appl 79, 12995–13010 (2020). https://doi.org/10.1007/s11042-020-08678-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-08678-z

Keywords

Search

Navigation