Skip to main content
SpringerLink
Log in
Book cover

Pacific Rim Conference on Multimedia

PCM 2016: Advances in Multimedia Information Processing - PCM 2016 pp 366–375Cite as

Multi-scale Point Set Saliency Detection Based on Site Entropy Rate

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9916))

Abstract

Visual saliency in images has been studied extensively in many literatures, but there is no much work on point sets. In this paper, we propose an approach based on pointwise site entropy rate to detect the saliency distribution in unorganized point sets and range data, which are lack of topological information. In our model, a point set is first transformed to a sparsely-connected graph. Then the model runs random walks on the graphs to simulate the signal/information transmission. We evaluate point saliency using site entropy rate (SER), which reflects average information transmitted from a point to its neighbors. By simulating the diffusion process on each point, multi-scale saliency maps are obtained. We combine the multi-scale saliency maps to generate the final result. The effectiveness of the proposed approach is demonstrated by comparisons to other approaches on a range of test models. The experiment shows our model achieves good performance, without using any connectivity information.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Akman, O., Jonker, P.: Computing saliency map from spatial information in point cloud data. In: Blanc-Talon, J., Bone, D., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2010. LNCS, vol. 6474, pp. 290–299. Springer, Heidelberg (2010). doi:10.1007/978-3-642-17688-3_28

    Chapter  Google Scholar 

  2. Castellani, U., Cristani, M., Fantoni, S., Murino, V.: Sparse points matching by combining 3D mesh saliency with statistical descriptors. Comput. Graph. Forum 27(2), 643–652 (2008)

    Article  Google Scholar 

  3. Chen, X., Saparov, A., Pang, B., Funkhouser, T.: Schelling points on 3D surface meshes. ACM Trans. Graph. 31(4), 13–15 (2012)

    Article  Google Scholar 

  4. Cheng, M.M., Zhang, G.X., Mitra, N.J., Huang, X., Hu, S.M.: Global contrast based salient region detection. IEEE Trans. Pattern Anal. Mach. Intell. 37(3), 409–416 (2015)

    Article  Google Scholar 

  5. Gao, D., Mahadevan, V., Vasconcelos, N.: The discriminant center-surround hypothesis for bottom-up saliency. Adv. Neural Inf. Process. Syst. 20, 497–504 (2007)

    Google Scholar 

  6. Gelfand, N., Mitra, N.J., Guibas, L.J., Pottmann, H.: Robust global registration. In: Proceedings of Eurographics Symposium on Geometry Processing, p. 197 (2005)

    Google Scholar 

  7. Guy, G., Medioni, G.: Inference of surfaces, 3D curves, and junctions from sparse, noisy, 3D data. IEEE Trans. Pattern Anal. Mach. Intell. 19(11), 1265–1277 (1997). http://dx.doi.org/10.1109/34.632985

    Article  Google Scholar 

  8. Jong, S.H., Peyman, M.: Static and space-time visual saliency detection by self-resemblance. J. Vis. 9(12), 1–27 (2009)

    Article  Google Scholar 

  9. Hou, T., Qin, H.: Admissible diffusion wavelets and their applications in space-frequency processing. IEEE Trans. Visual Comput. Graph. 19(1), 3–15 (2013)

    Article  Google Scholar 

  10. Hou, X., Zhang, L., Saliency detection: a spectral residual approach. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)

    Google Scholar 

  11. Hou, X., Zhang, L.: Dynamic visual attention: searching for coding length increments. In: Conference on Neural Information Processing Systems, Vancouver, British Columbia, Canada, December, pp. 681–688 (2008)

    Google Scholar 

  12. Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998)

    Article  Google Scholar 

  13. Lee, C.H., Varshney, A., Jacobs, D.W.: Mesh saliency. ACM Trans. Graph. 24(3), 659–666 (2005)

    Article  Google Scholar 

  14. Leifman, G., Shtrom, E., Tal, A.: Surface regions of interest for viewpoint selection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 414–421 (2012)

    Google Scholar 

  15. Li, X., Guskov, I.: Multiscale features for approximate alignment of point-based surfaces. In: Eurographics Symposium on Geometry Processing, pp. 217–226 (2005)

    Google Scholar 

  16. Medioni, G., Tang, C.K., Lee, M.S.: Tensor voting: theory and applications. Proc. Rfia 34(8), 1482–1495 (2000)

    Google Scholar 

  17. Min, K.P., Lee, S.J., Lee, K.W.: Multi-scale tensor voting for feature extraction from unstructured point clouds. Graph. Models 74(4), 197–208 (2012)

    Article  Google Scholar 

  18. Pauly, M., Keiser, R., Gross, M.: Multi-scale feature extraction on point-sampled surfaces. Comput. Graph. Forum 22, 281–289 (2003)

    Article  Google Scholar 

  19. Ran, G., Cohen-Or, D.: Salient geometric features for partial shape matching and similarity. ACM Trans. Graph. 25(1), 130–150 (2006)

    Article  Google Scholar 

  20. Shtrom, E., Leifman, G., Tal, A.: Saliency detection in large point sets. In: 2013 IEEE International Conference on Computer Vision, pp. 3591–3598, December 2013

    Google Scholar 

  21. Song, R., Liu, Y., Martin, R.R., Rosin, P.L.: Mesh saliency via spectral processing. ACM Trans. Graph. 33(1), 57–76 (2014)

    Article  MATH  Google Scholar 

  22. Stas, G., Stas, G., Lihi, Z.M., Ayellet, T.: Context-aware saliency detection. IEEE Trans. Pattern Anal. Mach. Intell. 34(10), 1915–1926 (2012)

    Article  Google Scholar 

  23. Tao, P., Cao, J., Li, S., Liu, L., Liu, X.: Mesh saliency via ranking unsalient patches in a descriptor space. Comput. Graph. 46, 264–274 (2014)

    Article  Google Scholar 

  24. Tasse, F.P., Kosinka, J., Dodgson, N.: Cluster-based point set saliency. In: IEEE International Conference on Computer Vision, pp. 637–639 (2015)

    Google Scholar 

  25. Treisman, A.M., Gelade, G.: A feature-integration theory of attention. Cogn. Psychol. 12(1), 97–136 (1980)

    Article  Google Scholar 

  26. Vijay, M., Nuno, V.: Spatiotemporal saliency in dynamic scenes. IEEE Trans. Pattern Anal. Mach. Intell. 32(1), 171–177 (2010)

    Article  Google Scholar 

  27. Wang, S., Li, N., Li, S., Luo, Z., Zhixun, S., Qin, H.: Multi-scale mesh saliency based on low-rank, sparse analysis in shape feature space. Comput. Aided Geom. Des. 35-36, 206–214 (2015)

    Google Scholar 

  28. Wang, W., Wang, Y., Huang, O., Gao, W.: Measuring visual saliency by site entropy rate. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2368–2375 (2010)

    Google Scholar 

  29. Jinliang, W., Shen, X., Zhu, W., Liu, L.: Mesh saliency with global rarity. Graph. Models 75(5), 255–264 (2013)

    Article  Google Scholar 

  30. Wu, Y., Shen, X.: A unified approach to salient object detection via low rank matrix recovery. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 853–860 (2012)

    Google Scholar 

Download references

Acknowledgments

This work was partially supported by National Natural Science Foundation of China under Grant No. 61231018 and No. 61273366; National Science and technology support program under Grant 2015BAH31F01; Program of introducing talents of discipline to university under grant B13043.

Author information

Authors and Affiliations

  1. Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, 710049, China

    Yu Guo, Fei Wang, Pengyu Liu, Jingmin Xin & Nanning Zheng

Authors
  1. Yu Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pengyu Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jingmin Xin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Nanning Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yu Guo .

Editor information

Editors and Affiliations

  1. Zhengzhou University, Zhengzhou, China

    Enqing Chen

  2. Jiaotong University, Xi’an, China

    Yihong Gong

  3. Zhengzhou University, Zhengzhou, China

    Yun Tie

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Guo, Y., Wang, F., Liu, P., Xin, J., Zheng, N. (2016). Multi-scale Point Set Saliency Detection Based on Site Entropy Rate. In: Chen, E., Gong, Y., Tie, Y. (eds) Advances in Multimedia Information Processing - PCM 2016. PCM 2016. Lecture Notes in Computer Science(), vol 9916. Springer, Cham. https://doi.org/10.1007/978-3-319-48890-5_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-48890-5_36

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-48889-9

  • Online ISBN: 978-3-319-48890-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation