Skip to main content
SpringerLink
Log in

Extracting closed object contour in the image: remove, connect and fit

  • Theoretical Advances
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

Contour extraction is one of the fundamental problems in computer vision. How to extract closed object contours in noisy images is an interesting challenge, which is not solved well by current methods. In this paper, a method of extracting closed object contours through removing, connecting and fitting is proposed. Firstly, existing preprocessing steps are employed to produce a set of contour segments from an image. Secondly, an 8-neighborhoods discriminant is advised, which is used to determine and remove the nontarget curve pieces. Thirdly, a connection algorithm based on proximity and continuity of closed contours is presented to connect the fractured curve segments to form a closed object contour. Fourthly, a B-spline curve-fitting method is provided to make the closed object contour more consistent to the object’s real contour. Finally, real applications and comparative experiments are conducted to testify the proposed method’s performance, effectiveness and robustness. The comparison shows that the proposed method can obtain a better closed contour even in a noisy image.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Rahman NNSA, Saad NM, Abdullah AR, Wahab FA (2018) The internet of things beverages bottle shape defect detection using Naïve Bayes classifier. Int J Hum Technol Interact 2(1):71–76

    Google Scholar 

  2. Komoku K, Emi T, Yokogawa T, Yamauchi H, Sato Y (2017) Study of material surface shape detection model for MEMS tactile sensor by motion tracking. In: Proceedings of the international conference on intelligent informatics and biomedical sciences, pp 163–164

  3. Zhang H, Cao X, Ho JK, Chow TW (2017) Object-level video advertising: an optimization framework. IEEE Trans Ind Inf 13(2):520–531

    Article  Google Scholar 

  4. Arbeláez P, Maire M, Fowlkes C, Malik J (2011) Contour detection and hierarchical image segmentation. IEEE Trans Pattern Anal Mach Intell 33(5):898–916

    Article  Google Scholar 

  5. Chen H, Gao Q (2005) Efficient image region and shape detection by perceptual contour grouping. Proc IEEE Int Conf Mech Auto 2:793–798

    Google Scholar 

  6. Antunes M, Lopes LS (2013) Contour-based object extraction and clutter removal for semantic vision. Lect Notes Comput Sci 7950:170–180

    Article  Google Scholar 

  7. Jordan H, van Dyck W, Smodič R (2011) A co-processed contour tracing algorithm for a smart camera. J Real-Time Image Process 6(1):23–31

    Article  Google Scholar 

  8. Aroma RJ, Raimond K (2017) An empirical study on the influence of image filters in effective closed contour extraction of lakes in satellite images. Indian J Sci Technol 10(5):1–8

    Article  Google Scholar 

  9. Masson-Sibut A, Nakib A (2015) Real-time assessment of bone structure positions via ultrasound imaging. J Real-Time Image Proc 13(1):1–11

    Google Scholar 

  10. Xu Y, Fang G, Lv N, Chen S, Zou JJ (2015) Computer vision technology for seam tracking in robotic GTAW and GMAW. Rob Comput Integr Manuf 32:25–36

    Article  Google Scholar 

  11. Yang KF, Li CY, Li YJ (2014) Multifeature-based surround inhibition improves contour detection in natural images. IEEE Trans Image Process 23(12):5020–5032

    Article  MathSciNet  MATH  Google Scholar 

  12. Jevnisek Avidan (2016) Semi global boundary detection. Comput Vision Image Underst 152:21–28

    Article  Google Scholar 

  13. Lim JJ, Zitnick CL, Dollar P (2013) Sketch Tokens: a learned mid-level representation for contour and object detection. In: Proceedings of the IEEE conference on computer vision pattern recognition, Portland, OR, USA, vol 9, pp 3158–3165

  14. Zhao W, Zhou Z (2008) Contours location based on fisher discrimination analysis. In: Proceedings of international conference on computational intelligence and security, IEEE, pp 480–483

  15. Kang T, Yu J, Oh J, Seol Y, Choi K, Kim M (2007) Object based contour detection by using graph-cut on stereo image. In: Proceedings of the IAPR conference mach vision application, DBLP, Tokyo, JAPAN, May, pp 319–322

  16. Schindler K, Suter D (2008) Object detection by global contour shape. Pattern Recognit 41(12):3736–3748

    Article  MATH  Google Scholar 

  17. Gao A (1997) Extracting object silhouettes by perceptual edge grouping. In: Proceedings of the IEEE international conference on system, man, cybernetics, computational cybernetics and simulation, vol 3, pp 2450–2454

  18. Guy G, Medioni G (1992) Perceptual grouping using global saliency-enhancing operators. In: Proceedings of the IAPR international conference on pattern recognition, pp 99–103

  19. Guy M (1996) Inferring global perceptual contours from local features. Int’l J Comput Vis 20:113–133

    Article  Google Scholar 

  20. Ming Y, Li H, He X (2012) Connected contours: a new contour completion model that respects the closure effect. In: Proceedings of IEEE conference on CVPR, pp 829–836

  21. Payet N, Todorovic S (2013) SLEDGE: sequential labeling of image edges for boundary detection. Int J Comput Vis 104(1):15–37

    Article  MathSciNet  MATH  Google Scholar 

  22. Jiang M, Qi X, Tejada PJ (2011) A computational-geometry approach to digital image contour extraction. In: Transactions on computational science, XIII, 2011, pp 13–43

  23. Kubota T, Huntsberger T, Martin JT (2001) Edge based probabilistic relaxation for sub-pixel contour extraction. In: Proceedings of the third international workshop energy minimization methods computer vision and pattern recognition, Sophia Antipolis, France, 2001, pp 328–343

  24. Khan GN, Gillies DF (1992) Extracting contours by perceptual grouping. Image Vision Comput 10(92):77–88

    Article  Google Scholar 

  25. Tejada PJ, Qi X, Jiang M (2009) Computational geometry of contour extraction. In: Proceedings of CCCG, Vancouver, British Columbia, Canada, pp 25–28

  26. Tabbone S (1994) Cooperation between edges and junctions for edge grouping. In: Proceedings of IEEE international conference on image processing, ICIP-94, vol 1, pp 954–957

  27. Barnes N, Loy G, Shaw D, Robles-Kelly A (2005) Regular polygon detection. In: Proceeding of the tenth IEEE international conference on computer vision, IEEE Xplore, vol 1, pp 778–785

  28. Matveev I, Chinaev N, Novik V (2016) Location of pupil contour by Hough transform of connectivity components. Pattern Recognit Image Anal 26(2):398–405

    Article  Google Scholar 

  29. Ackermann F, Maamann A, Posch S, Sagerer G, Schliiter D (1997) Perceptual grouping of contour segments using Markov random fields. Int J Pattern Recognit Image Anal 7(1):11–17

    Google Scholar 

  30. Ekman M, Lomsky M, Strömblad SO, Carlsson S (1995) Closed-line integral optimization edge detection algorithm and its application in equilibrium radionuclide angiocardiography. J Nucl Med Off Publ Soc Nucl Med 36(6):1014–1018

    Google Scholar 

  31. FJ Estrada, JH Elder (2006) Multi-scale contour extraction based on natural image statistics. In: Proceedings of the conference on computer vision pattern recognition workshop, IEEE Computer society

  32. Elder JH, Krupnik A, Johnston LA (2003) Contour grouping with prior models. IEEE Trans Pattern Anal Mach Intell 25(6):661–674

    Article  Google Scholar 

  33. Gu K, Pati D, Dunson DB (2014) Bayesian multiscale modeling of closed curves in point clouds. J Am Stat Assoc 109(508):1481–1494

    Article  MathSciNet  MATH  Google Scholar 

  34. Zhou H-Q, Dai S-H (2010) Wavelet descriptor for closed curves detection in complex background. J Comput 5(11):1723–1730

    Article  MathSciNet  Google Scholar 

  35. Benmansour F, Cohen LD (2009) Fast object segmentation by growing minimal paths from a single point on 2D or 3D images. J Math Imaging Vis 33(2):209–221

    Article  MathSciNet  Google Scholar 

  36. Chen D, Mirebeau JM, Cohen LD (2016) A new finsler minimal path model with curvature penalization for image segmentation and closed contour detection. In: Proceedings of the CVPR, IEEE, pp 355–363

  37. Chan T, Vese L (2001) Active contours without edges. IEEE Trans Image Process 10(2):266–277

    Article  MATH  Google Scholar 

  38. Jarjes AA, Wang K, Mohammed GJ (2010) GVF snake-based method for accurate pupil contour detection. Inf Technol J 9(8):1653–1658

    Article  Google Scholar 

  39. Liu J, Fan Z, Olsen SI, Christensen KH, Kristensen JK (2017) Boosting active contours for weld pool visual tracking in automatic arc welding. IEEE Trans Auto Sci Eng 14(2):1096–1108

    Article  Google Scholar 

  40. Prakash S, Abhilash R, Das S (2007) Snakecut: an integrated approach based on active contour and grabcut and for automatic foreground object segmentation. Prog Comput Vis Image Anal 6(3):13–29

    Google Scholar 

  41. Xu T, Zhao P (2008) Precise center location for light spot contour images of light emitting diode control points in light-pen vision coordinate measurement. Opt Eng 47(12):123602

    Article  Google Scholar 

  42. Youssef YB, Lamnii A (2017) Contour detection of mammogram masses using ChanVese model and B-spline approximation. Int J Interact Multimed Artif Intell 4(5):25–27

    Google Scholar 

  43. Yuan C, Lin E, Millard J, Hwang JN (1999) Closed contour edge detection of blood vessel lumen and outer wall boundaries in black-blood MR images. Magn Reson Imaging 17(2):257–266

    Article  Google Scholar 

  44. FJ Estrada, AD Jepson (2006) Robust boundary detection with adaptive grouping. In: Proceedings of the CVPR workshop, sixth conference

  45. Levinshtein A, Sminchisescu C, Dickinson S (2010) Optimal contour closure by superpixel grouping. In: Proceedings of the European conference on computer vision, pp 480–493

  46. Stahl JS, Oliver K, Wang S (2008) Open boundary capable edge grouping with feature maps. In: IEEE computer society conference on CVPRW’08, computer vision and pattern recognition workshops, 2008, pp 1–8

  47. Wang S, Kubota T, Siskind JM, Wang J (2005) Salient closed boundary extraction with ratio contour. IEEE Trans Pattern Anal Mach Intell 27(4):546–561

    Article  Google Scholar 

  48. Zhang T, Bai X, Song X, Niu X (2011) An improved algorithm for multiple closed contour detection. In: 2011 Seventh international conference on intelligent information hiding and multimedia signal processing (IIH-MSP), pp 202–205

  49. Jiang B (2014) Real-time multi-resolution edge detection with pattern analysis on graphics processing unit. J Real-Time Image Proc pp 1–29

  50. Wu Y, Zhu S, Zhi Y, Lu W, Sun J, Dai E, Yan A, Liu L (2011) The location of laser beam cutting based on the computer vision. In: Proceedings of SPIE, conference on optics and photonics for information processing, vol 8134, San Diego, CA, USA, pp 81340T-1-5

  51. Lu Y, Shapiro LG (2017) Closing the loop for edge detection and object proposals. In: Proceedings of thirty-first AAAI conference on artificial intelligence, pp 4204–4210

  52. Zhang TY, Suen CY (1984) A fast parallel algorithm for thinning digital patterns. Commun ACM 27(3):236–239

    Article  Google Scholar 

  53. Huiskes MJ, Lew MS (2008) The MIR flickr retrieval evaluation. In: Proceedings of the 1st ACM international conference on multimedia information retrieval, ACM, pp 39–43

Download references

Author information

Authors and Affiliations

  1. College of Computer, Zhejiang University of Technology, Hangzhou, 310023, China

    Fei Gao, Mingqian Wang, Yichao Cai & Shufang Lu

Authors
  1. Fei Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mingqian Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yichao Cai
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shufang Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fei Gao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gao, F., Wang, M., Cai, Y. et al. Extracting closed object contour in the image: remove, connect and fit. Pattern Anal Applic 22, 1123–1136 (2019). https://doi.org/10.1007/s10044-018-0749-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-018-0749-5

Keywords

Search

Navigation