Skip to main content

Runtime Performance Enhancement of a Superpixel Based Saliency Detection Model

  • Conference paper
  • First Online:
  • 2742 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9730))

Abstract

Reducing computational cost of image processing for various real time computer and robotic vision tasks, e.g. object recognition and tracking, adaptive compression, content aware image resizing, etc. remains a challenge. Saliency detection is often utilized as a pre-processing step for rapid, parallel, bottom-up processing of low level image features to compute saliency map. Subsequent higher level, complex computer vision tasks can then conveniently focus on identified salient locations for further image processing. Thus, saliency detection has successfully mitigated computational complexity of image processing tasks although processing speed enhancement still remains a desired goal. Recent fast and improved superpixel models are furnishing fresh incentive to employ them in saliency detection models to reduce computational complexity and enhance runtime speed. In this paper, we propose use of the superpixel extraction via energy driven sampling (SEEDS) algorithm to achieve processing speed enhancement in an existing saliency detection model. Evaluation results show that our modified model achieves over 60 % processing speed enhancement while maintaining accuracy comparable to the original model.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE TPAMI 20, 1254–1259 (1998)

    Article  Google Scholar 

  2. Koch, C., Ullman, S.: Shifts in selective visual attention: towards the underlying neural circuitry. In: Vaina, L.M. (ed.) Matters of Intelligence, pp. 115–141. Springer, Heidelberg (1987)

    Chapter  Google Scholar 

  3. Treisman, A.M., Gelade, G.: A feature-integration theory of attention. Cogn. Psychol. 12, 97–136 (1980). 82

    Article  Google Scholar 

  4. Borji, A., Itti, L.: State-of-the-art in visual attention modeling. IEEE TPAMI 35(1), 185–207 (2013)

    Article  MathSciNet  Google Scholar 

  5. Borji, A., Sihite, D.N., Itti, L.: Salient object detection: a benchmark. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 414–429. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  6. Borji, A., Cheng, M.M., Jiang, H., Li, J.: Salient object detection: a survey (2014). arXiv preprint arXiv:1411.5878

  7. Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)

    Article  MathSciNet  Google Scholar 

  8. Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: NIPS, pp. 545–552 (2007)

    Google Scholar 

  9. Zhang, L., Tong, M.H., Marks, T.K., Shan, H., Cottrell, G.W.: Sun: a Bayesian framework for saliency using natural statistics. J. Vis. 8(7), 1–20 (2008). 32

    Article  Google Scholar 

  10. Gao, D., Vasconcelos, N.: Discriminant saliency for visual recognition from clustered scenes. In: NIPS (2004)

    Google Scholar 

  11. Hou, X., Zhang, L.: Saliency detection: a spectral residual approach. In: CVPR, pp. 1–8 (2007)

    Google Scholar 

  12. Liu, Z., Meur, O., Luo, S.: Superpixel based saliency detection. In: International Workshop on Image and Audio Analysis for Multimedia Interactive services, pp. 1–4, July 2013

    Google Scholar 

  13. Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Susstrunk, S.: Slicsuperpixels compared to state-of-the-art superpixel methods. IEEE TPAMI 34(11), 2274–2282 (2012)

    Article  Google Scholar 

  14. Van den Bergh, M., Boix, X., Roig, G., de Capitani, B., Van Gool, L.: SEEDS: superpixels extracted via energy-driven sampling. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VII. LNCS, vol. 7578, pp. 13–26. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  15. Zhua, H., Mengb, F., Cai, J., Lua, S.: Beyond Pixels: A Comprehensive Survey from Bottom-up to Semantic Image Segmentation and Cosegmentation, February 2015. arXiv:1502.00717v

  16. Goferman, J.S., Zelnik-Manor, L., Tal, A.: Context-aware saliency detection. In: CVPR, pp. 2376–2383 (2010)

    Google Scholar 

  17. Cheng, M.-M., Mitra, N.J., Huang, X., Torr, P.H.S., Hu, S.-M.: Global contrast based salient region detection. In: IEEE TPAMI (CVPR 2011) (2014)

    Google Scholar 

  18. Achanta, R., Hemami, S., Estrada, F. Susstrunk, S.: Frequency-tuned salient region detection. In: CVPR (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Qazi Aitezaz Ahmed .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Ahmed, Q.A., Akhtar, M. (2016). Runtime Performance Enhancement of a Superpixel Based Saliency Detection Model. In: Campilho, A., Karray, F. (eds) Image Analysis and Recognition. ICIAR 2016. Lecture Notes in Computer Science(), vol 9730. Springer, Cham. https://doi.org/10.1007/978-3-319-41501-7_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-41501-7_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-41500-0

  • Online ISBN: 978-3-319-41501-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics