Skip to main content
SpringerLink
Log in

GLSC: LSC superpixels at over 130 FPS

  • Special Issue Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Superpixel has been successfully applied in various computer vision tasks, and many algorithms have been proposed to generate superpixel map. Recently, a superpixel algorithm called “superpixel segmentation using linear spectral clustering” (LSC) has been proposed, and it performs equally well or better than state-of-the art superpixel segmentation algorithms in terms of several commonly used evaluation metrics in superpixel segmentation. Although LSC is of linear complexity, its original implementation runs in few hundreds of milliseconds for images with resolution of 481 × 321 stated by the authors, which is a limitation for some real-time applications such as visual tracking which may needs, for instance, 30 FPS for standard image resolution (e.g., 480 × 320, 640 × 480, 1280 × 720 and 1920 × 1080). Instead of inventing new algorithms with lower complexity than LSC, we will explore LSC to modify its structure and make it suitable to be implemented by parallel technique. The modified LSC algorithm is implemented in CUDA and tested on several NVIDIA graphics processing unit. Our implementation of the proposed modified LSC algorithm achieves speedups of up to 80× from the original sequential implementation, and the quality, measured by two commonly used evaluation metrics, of our implementation keeps being similar to the original one. The source code will be made publicly available.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Notes

  1. http://jschenthu.weebly.com/projects.html.

  2. https://1drv.ms/u/s!ApN11A41BjdggQMr1jhCu6pfmc3D.

References

  1. Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: Slic superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)

    Article  Google Scholar 

  2. Arbelaez, P., Maire, M., Fowlkes, C., Malik, J.: Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 898–916 (2011)

    Article  Google Scholar 

  3. Van den Bergh, M., Boix, X., Roig, G., Van Gool, L.: Seeds: superpixels extracted via energy-driven sampling. Int. J. Comput. Vis. 111(3), 298–314 (2015)

    Article  MathSciNet  Google Scholar 

  4. Felzenszwalb, P., Huttenlocher, D.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59(2), 167–181 (2004)

    Article  Google Scholar 

  5. Garcia-Garcia, A., Orts-Escolano, S., Garcia-Rodriguez, J., Cazorla, M.: Interactive 3D object recognition pipeline on mobile GPGPU computing platforms using low-cost RGB-D sensors. J. Real Time Image Process. (2016). doi:10.1007/s11554-016-0607-x

    Google Scholar 

  6. Gong, C., Tao, D., Liu, W., Maybank, S.J., Fang, M., Fu, K., Yang, J.: Saliency propagation from simple to difficult. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2531–2539 (2015)

  7. Guler, P., Deniz, E.: Real-time multi-camera video analytics system on GPU. J. Real Time Image Process. 11(3), 457–472 (2016). doi:10.1007/s11554-013-0337-2

    Article  Google Scholar 

  8. Harris, M.: Optimizing Parallel Reduction in CUDA. NVIDIA Developer Technology (2007)

  9. Kesavan, Y., Ramanan, A.: One-pass clustering superpixels. In: 2014 7th International Conference on Information and Automation for Sustainability (ICIAfS), pp. 1–5. IEEE (2014)

  10. Levinshtein, A., Stere, A., Kutulakos, K.N., Fleet, D.J., Dickinson, S.J., Siddiqi, K.: Turbopixels: fast superpixels using geometric flows. IEEE Trans. Pattern Anal. Mach. Intell. 31(12), 2290–2297 (2009)

    Article  Google Scholar 

  11. Li, Z., Chen, J.: Superpixel segmentation using linear spectral clustering. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1356–1363 (2015)

  12. Liu, X., Xu, Q., Ma, J., Jin, H., Zhang, Y.: MsLRR: a unified multiscale low-rank representation for image segmentation. IEEE Trans. Image Process. 23(5), 2159–2167 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  13. Nguyen, T.V., Lu, C., Sepulveda, J., Yan, S.: Adaptive nonparametric image parsing. IEEE Trans. Circuits Syst. Video Technol. 25(10), 1565–1575 (2015)

    Article  Google Scholar 

  14. NVIDIA Corporation: NVIDIA CUDA Compute Unified Device Architecture Programming Guide. NVIDIA Corporation (2007)

  15. Ren, C.Y., Prisacariu, V.A., Reid, I.D.: gSLICr: SLIC superpixels at over 250Hz. ArXiv e-prints (2015)

  16. Ren, X., Malik, J.: Learning a classification model for segmentation. In: Proceedings. Ninth IEEE International Conference on Computer Vision, 2003, pp. 10–17 (2003)

  17. Sun, X., Shang, K., Ming, D., Tian, J., Ma, J.: A biologically-inspired framework for contour detection using superpixel-based candidates and hierarchical visual cues. Sensors 15(10), 26654–26674 (2015)

    Article  Google Scholar 

  18. Wang, S., Lu, H., Yang, F., Yang, M.H.: Superpixel tracking. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 1323–1330 (2011)

Download references

Author information

Authors and Affiliations

  1. National Key laboratory of Science and Technology on Multi-spectral Information Processing, School of Automation, Huazhong University of Science and Technology, Wuhan, 430074, Hubei Province, China

    Zhihua Ban, Jianguo Liu & Jeremy Fouriaux

Authors
  1. Zhihua Ban
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jianguo Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jeremy Fouriaux
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jianguo Liu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ban, Z., Liu, J. & Fouriaux, J. GLSC: LSC superpixels at over 130 FPS. J Real-Time Image Proc 14, 605–616 (2018). https://doi.org/10.1007/s11554-016-0652-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-016-0652-5

Keywords

Search

Navigation