Skip to main content
Log in

Adaptive propagation matting based on transparency of image

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Image matting is an essential technique in many image and video editing applications. Although many matting methods have been proposed, it is still a challenge for most to obtain satisfactory matting results in the transparent foreground region of an image. To solve this problem, this paper proposes a novel matting algorithm, i.e. adaptive transparency-based propagation matting (ATPM) algorithm. ATPM algorithm considers image matting from a new slant. We pay attention to the transparencies of the input images and creatively assign them into three categories (highly transparent, strongly transparent and little transparent) according to the transparencies of the foreground objects in the images. Our matting model can make relevant adjustment in terms of the transparency types of the input images. Moreover, many current matting methods do not perform well when the foreground and background regions have similar color distributions. Our method adds texture as an additional feature to effectively discriminate the foreground and background regions. Experimental results on the benchmark dataset show that our method gets high-quality matting results for images of three transparency types, especially provides more accurate results for highly transparent images comparing with the state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Aksoy Y, Aydin TO, Pollefeys M (2017) Designing effective inter-pixel information flow for natural image matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 29–37

  2. Buades A, Coll B, Morel JM (2008) Nonlocal image and movie denoising. Int J Comput Vis 76(2):123–139

    Article  Google Scholar 

  3. Cao G, Li J, He Z, Chen X (2017) Divide and conquer: a self-adaptive approach for high-resolution image matting. In: International conference on virtual reality and visualization, pp 24–30

  4. Chen X, Zou D, Zhao Q, Tan P (2012) Manifold preserving edit propagation. ACM Trans Graph (TOG) 31(6):1–7

    Google Scholar 

  5. Chen Q, Li D, Tang CK (2013) Knn matting. IEEE Trans Pattern Anal Mach Intell 35(9):2175–2188

    Article  Google Scholar 

  6. Chen X, Zou D, Zhiying Zhou S, Zhao Q, Tan P (2013) Image matting with local and nonlocal smooth priors. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 1902–1907

  7. Cho D, Tai YW, Kweon I (2016) Natural image matting using deep convolutional neural networks. In: European conference on computer vision. Springer, pp 626–643

  8. Chuang YY, Curless B, Salesin DH, Szeliski R (2001) A bayesian approach to digital matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 2. IEEE, pp 264–271

  9. Feng X, Liang X, Zhang Z (2016) A cluster sampling method for image matting via sparse coding. In: European conference on computer vision. Springer, pp 204–219

  10. Gastal ES, Oliveira MM (2010) Shared sampling for real-time alpha matting. Computer Graphics Forum 29(2):575–584

    Article  Google Scholar 

  11. Grady L, Schiwietz T, Aharon S, Westermann R (2005) Random walks for interactive alpha-matting. In: Proceedings of the IASTED international conference on visualization, imaging and image processing (VIIP), pp 423–429

  12. He K, Rhemann C, Rother C, Tang X, Sun J (2011) A global sampling method for alpha matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 2049–2056

  13. He B, Wang G, Ruan Z, Yin X, Pei X, Lin X (2012) Local matting based on sample-pair propagation and iterative refinement. In: Proceedings of the IEEE international conference on image processing (ICIP). IEEE, pp 285–288

  14. Hu WC, Chen WH, Huang DY, Yang CY (2016) Effective image forgery detection of tampered foreground or background image based on image watermarking and alpha mattes. Multimedia Tools and Applications 75(6):3495–3516

    Article  Google Scholar 

  15. Jin M, Kim BK, Song WJ (2014) Adaptive propagation-based color-sampling for alpha matting. IEEE Transactions on Circuits and Systems for Video Technology 24(7):1101–1110

    Article  Google Scholar 

  16. Johnson J, Varnousfaderani ES, Cholakkal H, Rajan D (2016) Sparse coding for alpha matting. IEEE Trans Image Process 25(7):3032–3043

    Article  MathSciNet  Google Scholar 

  17. Karacan L, Erdem A, Erdem E (2015) Image matting with kl-divergence based sparse sampling. In: Proceedings of the IEEE international conference on computer vision (ICCV), pp 424–432

  18. Lee P, Wu Y (2011) Nonlocal matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 2193–2200

  19. Levin A, Lischinski D, Weiss Y (2008) A closed-form solution to natural image matting. IEEE Trans Pattern Anal Mach Intell 30(2):228–242

    Article  Google Scholar 

  20. Levin A, Rav-Acha A, Lischinski D (2008) Spectral matting. IEEE Trans Pattern Anal Mach Intell 30(10):1699–1712

    Article  Google Scholar 

  21. Li C, Wang P, Zhu X, Pi H (2017) Three-layer graph framework with the sumd feature for alpha matting. Comput Vis Image Underst. https://doi.org/10.1016/j.cviu.2017.06.011

  22. Lin YC, Wang HA, Hsieh YF (2012) Image matting through a web browser. Multimedia Tools and Applications 61(3):551–570

    Article  Google Scholar 

  23. Ojala T, Pietikäinen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recogn 29(1):51–59

    Article  Google Scholar 

  24. Omer I, Werman M (2004) Color lines: image specific color representation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 2. IEEE, pp 946–953

  25. Porter T, Duff T (1984) Compositing digital images. In: Proceedings of the 11th annual conference on computer graphics and interactive techniques, pp 253–259

  26. Rhemann C, Rother C, Gelautz M (2008) Improving color modeling for alpha matting. In: British machine vision conference 2008, Leeds, September, pp 1155–1164

  27. Rhemann C, Rother C, Wang J, Gelautz M, Kohli P, Rott P (2009) A perceptually motivated online benchmark for image matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1826–1833

  28. Rother C, Kolmogorov V, Blake A (2004) Grabcut: interactive foreground extraction using iterated graph cuts. ACM Trans Graph (TOG) 23(3):309–314

    Article  Google Scholar 

  29. Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326

    Article  Google Scholar 

  30. Ruzon MA, Tomasi C (2000) Alpha estimation in natural images. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 1. IEEE, pp 18–25

  31. Shahrian E, Rajan D (2012) Weighted color and texture sample selection for image matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 718–725

  32. Shahrian E, Rajan D, Price B, Cohen S (2013) Improving image matting using comprehensive sampling sets. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 636–643

  33. Sun J, Jia J, Tang CK, Shum HY (2004) Poisson matting. ACM Trans Graph (TOG) 23(3):315–321

    Article  Google Scholar 

  34. Tan G, Chen H, Qi J (2016) A novel image matting method using sparse manual clicks. Multimedia Tools and Applications 75(17):10,213–10,225

    Article  Google Scholar 

  35. Varnousfaderani ES, Rajan D (2013) Weighted color and texture sample selection for image matting. IEEE Trans Image Process 22(11):4260–4270

    Article  MathSciNet  MATH  Google Scholar 

  36. Wang J, Cohen MF (2005) An iterative optimization approach for unified image segmentation and matting. In: Proceedings of the IEEE international conference on computer vision (ICCV), vol 2. IEEE, pp 936–943

  37. Wang J, Cohen MF (2007) Optimized color sampling for robust matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1–8

  38. Wang J, Agrawala M, Cohen MF (2007) Soft scissors: an interactive tool for realtime high quality matting. ACM Trans Graph (TOG) 26(3):1–9

    Article  Google Scholar 

  39. Wright S (2006) Digital compositing for film and video. Elsevier/Focal Press

  40. Xu N, Price B, Cohen S, Huang T (2017) Deep image matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 2970–2979

  41. Xue B, Sapiro G (2007) A geodesic framework for fast interactive image and video segmentation and matting. In: Proceedings of the IEEE international conference on computer vision (ICCV), pp 1–8

  42. Yang CK, Kuo CN (2016) Automatic hair extraction from 2d images. Multimedia Tools and Applications 75(8):4441–4465

    Article  Google Scholar 

  43. Zhang Z, Zhu Q, Xie Y (2012) Learning based alpha matting using support vector regression. In: Proceedings of the IEEE international conference on image processing (ICIP). IEEE, pp 2109–2112

  44. Zheng Y, Kambhamettu C (2009) Learning based digital matting. In: Proceedings of the IEEE international conference on computer vision (ICCV). IEEE, pp 889–896

  45. Zheng Y, Kambhamettu C, Yu J, Bauer T, Steiner K (2008) Fuzzymatte: a computationally efficient scheme for interactive matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1–8

Download references

Acknowledgements

This work was partially supported by the National Natural Science Foundation of China (Grant No. 11431002).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiangyu Zhu.

Ethics declarations

Conflict of interests

The authors declare that they have no conflict of interest.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhu, X., Wang, P. & Huang, Z. Adaptive propagation matting based on transparency of image. Multimed Tools Appl 77, 19089–19112 (2018). https://doi.org/10.1007/s11042-017-5357-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5357-7

Keywords

Navigation