Skip to main content
Log in

Accelerated superpixel image segmentation with a parallelized DBSCAN algorithm

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Segmentation of an image into superpixel clusters is a necessary part of many imaging pathways. In this article, we describe a new routine for superpixel image segmentation (F-DBSCAN) based on the DBSCAN algorithm that is six times faster than previous existing methods, while being competitive in terms of segmentation quality and resistance to noise. The gains in speed are achieved through efficient parallelization of the cluster search process by limiting the size of each cluster thus enabling the processes to operate in parallel without duplicating search areas. Calculations are performed in large consolidated memory buffers which eliminate fragmentation and maximize memory cache hits thus improving performance. When tested on the Berkeley Segmentation Dataset, the average processing speed is 175 frames/s with a Boundary Recall of 0.797 and an Achievable Segmentation Accuracy of 0.944.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: Slic superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)

    Article  Google Scholar 

  2. Arbelaez, P., Maire, M., Fowlkes, C., Malik, J.: Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 898–916 (2010)

    Article  Google Scholar 

  3. Batra, D., Kowdle, A., Parikh, D., Luo, J., Chen, T.: icoseg: Interactive co-segmentation with intelligent scribble guidance. In: 2010 IEEE computer society conference on computer vision and pattern recognition, pp. 3169–3176. IEEE (2010)

  4. Berger, E.D., McKinley, K.S., Blumofe, R.D., Wilson, P.R.: Hoard: A scalable memory allocator for multithreaded applications. ACM Sigplan Notices 35(11), 117–128 (2000)

    Article  Google Scholar 

  5. Bergh, V.M., Boix, X., Roig, G., de Capitani, B., Van Gool, L.: Seeds: Superpixels extracted via energy-driven sampling. In: European conference on computer vision, pp. 13–26. Springer (2012)

  6. Beucher, S.: The watershed transformation applied to image segmentation. In: Scanning microscopy-supplement, p. 299 (1992)

  7. Bradski, G.: The opencv library. Dr Dobb’s J. Softw. Tools 25, 120–125 (2000)

    Google Scholar 

  8. Cheng, J., Liu, J., Xu, Y., Yin, F., Wong, D.W.K., Tan, N.M., Tao, D., Cheng, C.Y., Aung, T., Wong, T.Y.: Superpixel classification based optic disc and optic cup segmentation for glaucoma screening. IEEE Trans. Med. Imaging 32(6), 1019–1032 (2013)

    Article  Google Scholar 

  9. Conrad, C., Mertz, M., Mester, R.: Contour-relaxed superpixels. In: International workshop on energy minimization methods in computer vision and pattern recognition, pp. 280–293. Springer (2013)

  10. Ester, M., Kriegel, H.P., Sander, J., Xu, X., et al.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the second international conference on knowledge discovery and data mining (KDD ’96), vol. 96, pp. 226–231 (1996)

  11. Gan, J., Tao, Y.: Dbscan revisited: Mis-claim, un-fixability, and approximation. In: Proceedings of the 2015 ACM SIGMOD international conference on management of data, pp. 519–530 (2015)

  12. Getreuer, P.: Linear methods for image interpolation. Image Process. On Line 1, 238–259 (2011)

    Article  Google Scholar 

  13. Hahsler, M., Piekenbrock, M., Doran, D.: Dbscan: Fast density-based clustering with R. J. Stat. Softw. 25, 409–416 (2019)

    Google Scholar 

  14. Hou, J., Gao, H., Li, X.: Dsets-dbscan: a parameter-free clustering algorithm. IEEE Trans. Image Process. 25(7), 3182–3193 (2016)

    Article  MathSciNet  Google Scholar 

  15. Kurumalla, S., Rao, P.S.: K-nearest neighbor based dbscan clustering algorithm for image segmentation. J. Theor. Appl. Inf. Technol. 92(2), 395 (2016)

    Google Scholar 

  16. Lea, D., Gloger, W.: A memory allocator (1996)

  17. Li, S.S.: An improved dbscan algorithm based on the neighbor similarity and fast nearest neighbor query. IEEE Access 8, 47468–47476 (2020)

    Article  Google Scholar 

  18. Li, Z., Chen, J.: Superpixel segmentation using linear spectral clustering. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1356–1363 (2015)

  19. Li, Z., Wu, X.M., Chang, S.F.: Segmentation using superpixels: a bipartite graph partitioning approach. In: 2012 IEEE conference on computer vision and pattern recognition, pp. 789–796. IEEE (2012)

  20. Lim, J., Han, B.: Generalized background subtraction using superpixels with label integrated motion estimation. In: European conference on computer vision, pp. 173–187. Springer (2014)

  21. Liu, M.Y., Tuzel, O., Ramalingam, S., Chellappa, R.: Entropy rate superpixel segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR 2011), pp. 2097–2104. IEEE (2011)

  22. Liu, Y.J., Yu, M., Li, B.J., He, Y.: Intrinsic manifold slic: a simple and efficient method for computing content-sensitive superpixels. IEEE Trans. Pattern Anal. Mach. Intell. 40(3), 653–666 (2017)

    Article  Google Scholar 

  23. Loke, S., MacDonald, B.A., Parsons, M., Wünsche, B.: Testing dataset for accelerated superpixel image segmentation with a parallelized dbscan algorithm (2020). https://doi.org/10.17632/m52mb6ptj7.2

  24. Loke, S.C., MacDonald, B.A., Parsons, M., Wünsche, B.C.: Fast portrait segmentation of the head and upper body. In: 2020 35th International Conference on Image and Vision Computing New Zealand (IVCNZ), pp. 1–6. IEEE (2020)

  25. Lv, Y., Ma, T., Tang, M., Cao, J., Tian, Y., Al-Dhelaan, A., Al-Rodhaan, M.: An efficient and scalable density-based clustering algorithm for datasets with complex structures. Neurocomputing 171, 9–22 (2016)

    Article  Google Scholar 

  26. Manavalan, R., Thangavel, K.: Trus image segmentation using morphological operators and dbscan clustering. In: 2011 World Congress on information and communication technologies, pp. 898–903. IEEE (2011)

  27. Mokrzycki, W., Tatol, M.: Colour difference\(/delta\) e-a survey. Mach. Graph. Vis. 20(4), 383–411 (2011)

    Google Scholar 

  28. Ren, X., Malik, J.: Learning a classification model for segmentation. In: null, p. 10. IEEE (2003)

  29. Sharma, G., Bala, R.: Digital color imaging handbook. CRC Press, Hoboken (2017)

    Google Scholar 

  30. Shen, J., Hao, X., Liang, Z., Liu, Y., Wang, W., Shao, L.: Real-time superpixel segmentation by dbscan clustering algorithm. IEEE Trans. Image Process. 25(12), 5933–5942 (2016)

    Article  MathSciNet  Google Scholar 

  31. Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 888–905 (2000)

    Article  Google Scholar 

  32. Stutz, D.: Superpixel segmentation: an evaluation. In: German conference on pattern recognition, pp. 555–562. Springer (2015)

  33. Stutz, D., Hermans, A., Leibe, B.: Superpixels: an evaluation of the state-of-the-art. Comput. Vis. Image Underst. 166, 1–27 (2018)

    Article  Google Scholar 

  34. Wang, S., Lu, H., Yang, F., Yang, M.H.: Superpixel tracking. In: 2011 International conference on computer vision, pp. 1323–1330. IEEE (2011)

  35. Wang, Z., Zhou, L., Zhu, R., He, Z., Chen, D.: Sharpness-preservation video upscaling. In: 2017 10th international congress on image and signal processing, BioMedical engineering and informatics (CISP-BMEI), pp. 1–5. IEEE (2017)

  36. Yao, J., Boben, M., Fidler, S., Urtasun, R.: Real-time coarse-to-fine topologically preserving segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2947–2955 (2015)

  37. Yu, H., Chen, L., Yao, J., Wang, X.: A three-way clustering method based on an improved dbscan algorithm. Phys. A 535, 122289 (2019)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Seng Cheong Loke.

Ethics declarations

Conflict of interest

This study was paid for using PRESS account funding from the University of Auckland (ID 663710048). The authors declare that they have no known competing financial interests or personal relationships which have, or could be perceived to have, influenced the work reported in this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Loke, S.C., MacDonald, B.A., Parsons, M. et al. Accelerated superpixel image segmentation with a parallelized DBSCAN algorithm. J Real-Time Image Proc 18, 2361–2376 (2021). https://doi.org/10.1007/s11554-021-01128-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-021-01128-5

Keywords