Skip to main content
Log in

Interactive image segmentation combining global seeding and sparse local reconstruction

  • Original Article
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

Seed segmentation methods are highly regarded for their effectiveness in processing complex images, user-friendliness, and compatibility with graph-based representations. However, these methods often depend on intricate computational tools, leading to issues such as poor image contour adherence and incomplete seed propagation. To address these limitations, this paper proposes an interactive framework that integrates global seed information with sparse local linear reconstruction regularization (GSSR). In this framework, a Gaussian mixture model is firstly employed to construct a flow of global seed information, establishing connections between pixel points and yielding more complete segmented objects. Additionally, the \(L_{p}(0 < p \le 1)\) norm is utilized to constrain the sparse local reconstruction term, facilitating the generation of sparse boundaries. An iterative process based on the Alternating Direction Method of Multipliers (ADMM) is developed to solve the \(L_1\) regularization term, which is then generalized for the \(L_p\) problem through reweighting. We conduct a comprehensive comparison on the BSD dataset, CVC-ClinicDB datasets and two publicly available MSRC datasets with different labeling schemes. Extensive experimental validation demonstrates that the proposed method outperforms existing results.The source code and datasets are openly available at: https://github.com/choppy-water/GSSR.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Algorithm 1
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Data availibility

The datasets used in this paper are public datasets.

References

  1. Chen X, Pan L (2018) A survey of graph cuts/graph search based medical image segmentation. IEEE Rev Biomed Eng 11:112–124

    Article  MATH  Google Scholar 

  2. Zhang Y, Borse S, Cai H, Porikli F (2022) Auxadapt: Stable and efficient test-time adaptation for temporally consistent video semantic segmentation. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp. 2339–2348

  3. Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779–788

  4. Kolmogorov V, Zabin R (2004) What energy functions can be minimized via graph cuts? IEEE Trans Pattern Anal Mach Intell 26(2):147–159

    Article  MATH  Google Scholar 

  5. Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans Pattern Anal Mach Intell 22(8):888–905

    Article  MATH  Google Scholar 

  6. Levin A, Rav-Acha A, Lischinski D (2008) Spectral matting. IEEE Trans Pattern Anal Mach Intell 30(10):1699–1712

    Article  Google Scholar 

  7. Nascimento MC, De Carvalho AC (2011) Spectral methods for graph clustering-a survey. Eur J Oper Res 211(2):221–231

    Article  MathSciNet  MATH  Google Scholar 

  8. Xia S, Peng D, Meng D, Zhang C, Wang G, Giem E, Wei W, Chen Z (2020) Ball \( k \) k-means: fast adaptive clustering with no bounds. IEEE Trans Pattern Anal Mach Intell 44(1):87–99

    MATH  Google Scholar 

  9. Krishna K, Murty MN (1999) Genetic k-means algorithm. IEEE Trans Syst, Man, Cybernet Part B 29(3):433–439

    Article  MATH  Google Scholar 

  10. Bond SR, Hoeffler A, Temple JR (2001) Gmm estimation of empirical growth models. Available at SSRN 290522

  11. Koutis I, Miller GL, Tolliver D (2011) Combinatorial preconditioners and multilevel solvers for problems in computer vision and image processing. Comput Vis Image Underst 115(12):1638–1646

    Article  MATH  Google Scholar 

  12. Grady L (2006) Random walks for image segmentation. IEEE Trans Pattern Anal Mach Intell 28(11):1768–1783

    Article  MATH  Google Scholar 

  13. Wang L, Li M, Fang X, Nappi M, Wan S (2022) Improving random walker segmentation using a nonlocal bipartite graph. Biomed Signal Process Control 71:103154

    Article  MATH  Google Scholar 

  14. Cousty J, Bertrand G, Najman L, Couprie M (2008) Watershed cuts: minimum spanning forests and the drop of water principle. IEEE Trans Pattern Anal Mach Intell 31(8):1362–1374

    Article  MATH  Google Scholar 

  15. Boykov YY, Jolly M-P (2001) Interactive graph cuts for optimal boundary & region segmentation of objects in nd images. In: Proceedings eighth IEEE international conference on computer vision. ICCV 2001. IEEE, vol. 1, pp. 105–112

  16. Boykov Y, Funka-Lea G (2006) Graph cuts and efficient nd image segmentation. Int J Comput Vision 70(2):109–131

    Article  MATH  Google Scholar 

  17. Henzinger M, Noe A, Schulz C, Strash D (2018) Practical minimum cut algorithms. J Exp Algorithmics (JEA) 23:1–22

    Article  MathSciNet  MATH  Google Scholar 

  18. Karger DR (2000) Minimum cuts in near-linear time. J ACM (JACM) 47(1):46–76

    Article  MathSciNet  MATH  Google Scholar 

  19. Rother C, Kolmogorov V, Blake A (2004) Grabcut interactive foreground extraction using iterated graph cuts. ACM Trans Graph (TOG) 23(3):309–314

    Article  MATH  Google Scholar 

  20. Tang M, Gorelick L, Veksler O, Boykov Y (2013) Grabcut in one cut. In: Proceedings of the IEEE international conference on computer vision, pp. 1769–1776

  21. Peng Z, Qu S, Li Q (2019) Interactive image segmentation using geodesic appearance overlap graph cut. Signal Process: Image Commun 78:159–170

    MATH  Google Scholar 

  22. Kim TH, Lee KM, Lee SU (2008) Generative image segmentation using random walks with restart. In: Computer Vision–ECCV 2008: 10th European conference on computer vision, marseille, france, October 12–18, 2008, proceedings, part iii 10. Springer, pp. 264–275

  23. Yu W, McCann J (2016) Random walk with restart over dynamic graphs. In: 2016 IEEE 16th international conference on data mining (icdm). IEEE, pp. 589–598

  24. Lee C, Jang W-D, Sim J-Y, Kim C-S (2015) Multiple random walkers and their application to image cosegmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3837–3845

  25. Shen J, Du Y, Wang W, Li X (2014) Lazy random walks for superpixel segmentation. IEEE Trans Image Process 23(4):1451–1462

    Article  MathSciNet  MATH  Google Scholar 

  26. Deng M, Zhou Z, Liu G, Zeng D, Zhang M (2023) Adaptive active contour model based on local bias field estimation and saliency. J Intell Fuzzy Syst, pp 1–15

  27. Bampis CG, Maragos P, Bovik AC (2017) Graph-driven diffusion and random walk schemes for image segmentation. IEEE Trans Image Process 26(1):35–50

    Article  MathSciNet  MATH  Google Scholar 

  28. Bampis C.G, Maragos P (2015) Unifying the random walker algorithm and the sir model for graph clustering and image segmentation. In: 2015 IEEE international conference on image processing (ICIP). IEEE, pp. 2265–2269

  29. Ruziska FM, Tomé T, de Oliveira MJ (2017) Susceptible-infected-recovered model with recurrent infection. Physica A 467:21–29

    Article  MathSciNet  MATH  Google Scholar 

  30. Casaca W, Gois JP, Batagelo HC, Taubin G, Nonato LG (2021) Laplacian coordinates: theory and methods for seeded image segmentation. IEEE Trans Pattern Anal Mach Intell 43:2665–2681

    Article  Google Scholar 

  31. Adams R, Bischof L (1994) Seeded region growing. IEEE Trans Pattern Anal Mach Intell 16(6):641–647

    Article  MATH  Google Scholar 

  32. Ning J, Zhang L, Zhang D, Wu C (2010) Interactive image segmentation by maximal similarity based region merging. Pattern Recogn 43(2):445–456

    Article  MATH  Google Scholar 

  33. Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24(5):603–619

    Article  MATH  Google Scholar 

  34. Kailath T (1967) The divergence and bhattacharyya distance measures in signal selection. IEEE Trans Commun Technol 15(1):52–60

    Article  MATH  Google Scholar 

  35. Shan Y, Ma Y, Liao Y, Huang H, Wang B (2023) Interactive image segmentation based on multi-layer random forest classifiers. Multimed Tools Appl 82(15):22469–22495

    Article  Google Scholar 

  36. Xu N, Price B, Cohen S, Yang J, Huang T (2016) Deep interactive object selection. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR)

  37. Liew J, Wei Y, Xiong W, Ong S.-H, Feng J (2017) Regional interactive image segmentation networks. In: 2017 IEEE international conference on computer vision (ICCV). IEEE, pp. 2746–2754

  38. Li Z, Chen Q, Koltun V (2018) Interactive image segmentation with latent diversity. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 577–585

  39. Jang W-D, Kim C-S (2019) Interactive image segmentation via backpropagating refinement scheme. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 5297–5306

  40. Sofiiuk K, Petrov IA, Konushin A (2022) Reviving iterative training with mask guidance for interactive segmentation. In: 2022 IEEE international conference on image processing (ICIP). IEEE, pp. 3141–3145

  41. Vezhnevets V, Konouchine V (2005) Growcut: Interactive multi-label nd image segmentation by cellular automata. In: Proc. of Graphicon. Citeseer, vol. 1, pp. 150–156

  42. Bühler T, Hein M (2009) Spectral clustering based on the graph p-laplacian. In: Proceedings of the 26th annual international conference on machine learning, pp. 81–88

  43. Yu Y, Fang C, Liao Z (2015) Piecewise flat embedding for image segmentation. In: Proceedings of the IEEE international conference on computer vision, pp. 1368–1376

  44. Daubechies I, DeVore R, Fornasier M, Güntürk CS (2010) Iteratively reweighted least squares minimization for sparse recovery. Commun Pure Appl Math: J Issued Courant Instit Math Sci 63(1):1–38

    Article  MathSciNet  MATH  Google Scholar 

  45. Candes EJ, Wakin MB, Boyd SP (2008) Enhancing sparsity by reweighted \(l_1\) minimization. J Fourier Anal Appl 14:877–905

    Article  MathSciNet  MATH  Google Scholar 

  46. Otsu N et al (1975) A threshold selection method from gray-level histograms. Automatica 11(285–296):23–27

    MATH  Google Scholar 

  47. Unnikrishnan R, Pantofaru C, Hebert M (2007) Toward objective evaluation of image segmentation algorithms. IEEE Trans Pattern Anal Mach Intell 29(6):929–944

    Article  MATH  Google Scholar 

  48. Meilǎ M (2005) Comparing clusterings: an axiomatic view. In: Proceedings of the 22nd international conference on machine learning, pp. 577–584

  49. Unnikrishnan R, Pantofaru C, Hebert M (2005) A measure for objective evaluation of image segmentation algorithms. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05)-Workshops. IEEE, pp. 34–34

  50. McGuinness K, O’connor NE (2010) A comparative evaluation of interactive segmentation algorithms. Pattern Recogn 43(2):434–444

    Article  MATH  Google Scholar 

  51. Bernal J, Sánchez FJ, Fernández-Esparrach G, Gil D, Rodríguez C, Vilariño F (2015) Wm-dova maps for accurate polyp highlighting in colonoscopy: validation vs. saliency maps from physicians. Comput Med Imaging Graph 43:99–111

    Article  Google Scholar 

  52. Andrade F, Carrera EV (2015) Supervised evaluation of seed-based interactive image segmentation algorithms. In: 2015 20th symposium on signal processing, images and computer vision (STSIVA). IEEE, pp. 1–7

  53. Estrada FJ, Jepson AD (2009) Benchmarking image segmentation algorithms. Int J Comput Vision 85:167–181

    Article  MATH  Google Scholar 

  54. Tibshirani RJ, Efron B (1993) An introduction to the bootstrap. Monogr Stat Appl Prob 57(1):1–436

    MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

This research is supported by the Humanities and Social Sciences Research Program of Chongqing Municipal Education Commission (Grant No. 23SKGH263), the Science and Technology Research Program of Chongqing Municipal Education Commission (No. KJQN202201148), and the Funding Achievements of the Action Plan for High Quality Development of Graduate Education at Chongqing University of Technology (Grant No. gzlcx20243180).

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed to the study design. J.L.: Conceptualization, Resources, Writing - review & editing. Y.L.: Methodology, Software, Validation and Writing - original draft. K.Z.: Data Curation. S.C.: Visualization. Q.L.:Data Curation.

Corresponding author

Correspondence to Yuanqin Liu.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Long, J., Liu, Y., Zhang, K. et al. Interactive image segmentation combining global seeding and sparse local reconstruction. Pattern Anal Applic 28, 55 (2025). https://doi.org/10.1007/s10044-025-01432-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10044-025-01432-x

Keywords