Skip to main content
SpringerLink
Log in

A Survey on Pre-Processing in Image Matting

  • Survey
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

Pre-processing is an important step in digital image matting, which aims to classify more accurate foreground and background pixels from the unknown region of the input three-region mask (Trimap). This step has no relation with the well-known matting equation and only compares color differences between the current unknown pixel and those known pixels. These newly classified pure pixels are then fed to the matting process as samples to improve the quality of the final matte. However, in the research field of image matting, the importance of pre-processing step is still blurry. Moreover, there are no corresponding review articles for this step, and the quantitative comparison of Trimap and alpha mattes after this step still remains unsolved. In this paper, the necessity and the importance of pre-processing step in image matting are firstly discussed in details. Next, current pre-processing methods are introduced by using the following two categories: static thresholding methods and dynamic thresholding methods. Analyses and experimental results show that static thresholding methods, especially the most popular iterative method, can make accurate pixel classifications in those general Trimaps with relatively fewer unknown pixels. However, in a much larger Trimap, there methods are limited by the conservative color and spatial thresholds. In contrast, dynamic thresholding methods can make much aggressive classifications on much difficult cases, but still strongly suffer from noises and false classifications. In addition, the sharp boundary detector is further discussed as a prior of pure pixels. Finally, summaries and a more effective approach are presented for pre-processing compared with the existing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Wang J, Agrawala M, Cohen M F. Soft scissors: An interactive tool for realtime high quality matting. ACM Transactions on Graphics, 2007, 26(3): Article No. 9.

  2. Liu K, Li X, Dong Y. Superpixel fats for fast foreground extraction. In Proc. IEEE China Summit and International Conference on Signal and Information Processing, Jul. 2015, pp.132-136.

  3. Porter T, Duff T. Compositing digital images. In Proc. the 11th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), Jul. 1984, pp.253-259.

  4. Rhemann C, Rother C, Wang J, Gelautz M, Kohli P, Rott P. Alpha matting evaluation website, 2009. http://www.alphamatting.com, Jun. 2016.

  5. Rhemann C, Rother C, Wang J, Gelautz M, Kohli P, Rott P. A perceptually motivated online benchmark for image matting. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, Jun. 2009, pp.1826-1833.

  6. Karacan L, Erdem A, Erdem E. Image matting with KL-divergence based sparse sampling. In Proc. IEEE International Conference on Computer Vision, Dec. 2015, pp.424-432.

  7. Shahrian E, Rajan D, Price B, Cohen S. Improving image matting using comprehensive sampling sets. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, Jun. 2013, pp.636-643.

  8. Varnousfaderani E, Rajan D. Weighted color and texture sample selection for image matting. IEEE Transactions on Image Processing, 2013, 22(11): 4260-4270.

  9. Johnson J, Rajan D, Cholakkal H. Sparse codes as alpha matte. In Proc. the British Machine Vision Conference, Sept. 2014, pp.245-253.

  10. Shahrian E, Rajan D. Weighted color and texture sample selection for image matting. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, Jun. 2012, pp.718-725.

  11. Gastal E S L, Oliveira M M. Shared sampling for real-time alpha matting. Computer Graphics Forum, 2010, 29(2): 575-584.

  12. He K, Rhemann C, Rother C, Tang X, Sun J. A global sampling method for alpha matting. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, Jun. 2011, pp.2049-2056.

  13. Rhemann C, Rother C, Kohli P, Gelautz M. A spatially varying PSF-based prior for alpha matting. In Proc. the 23rd IEEE Conference on Computer Vision and Pattern Recognition, Jun. 2010, pp.2149-2156.

  14. He B, Wang G, Shi C et al. High-accuracy and quick matting based on sample-pair refinement and local optimization. IEICE Transactions on Information and Systems, 2013, E96-D(9): 2096-2106.

  15. Rhemann C, Rother C, Gelautz M. Improving color modeling for alpha matting. In Proc. the British Machine Vision Conference, Sept. 2008, pp.1155-1164.

  16. Cheng J, Miao Z. Improving sampling criterion for alpha matting. In Proc. the 2nd IAPR Asian Conference on Pattern Recognition, Nov. 2013, pp.803-807.

  17. Wang J, Cohen M F. Optimized color sampling for robust matting. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, Jun. 2007.

  18. AL-Kabbany A, Dubois E. Improved global-sampling matting using sequential pair-selection strategy. In Proc. Visual Information Processing and Communication, Feb. 2014.

  19. Rhemann C, Rother C, Rav-Acha A, Sharp T. High resolution matting via interactive Trimap segmentation. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, Jun. 2008.

  20. Wang J, Cohen M F. An iterative optimization approach for unified image segmentation and matting. In Proc. the 10th IEEE International Conference on Computer Vision, Oct. 2005, pp.936-943.

  21. Guan Y, Chen W, Liang X, Ding Z, Peng Q. Easy matting: A stroke based approach for continuous image matting. Computer Graphics Forum, 2006, 29(2): 567-576.

  22. Tan W, Fan T, Chen X, Ouyang Y, Wang D, Li G. Automatic matting of identification photos. In Proc. International Conference on Computer-Aided Design and Computer Graphics (CAD/Graphics), Nov. 2013, pp.387-388.

  23. Chuang Y Y, Curless B, Salesin D H, Szeliski R. A Bayesian approach to digital matting. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Dec. 2001, pp.264-271.

  24. Sun J, Jia J Y, Tang C K, Shum H Y. Poisson matting. ACM Transactions on Graphics, 2004, 23(3): 315-321.

  25. Grady L, Schiwietz T, Aharon S, Westermann R. Random walks for interactive alpha matting. In Proc. International Conference on Visualization, Imaging, and Image Processing, Sept. 2005, pp.423-429.

  26. Levin A, Lischinski D, Weiss Y. A closed-form solution to natural image matting. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008, 30(2): 228-242.

  27. Lee P, Wu Y. Nonlocal matting. In Proc. the 24th IEEE Conference on Computer Vision and Pattern Recognition, Jun. 2011, pp.2193-2200.

  28. Chen Q, Li D, Tang C K. KNN matting. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(9): 2175-2188.

  29. Chen X, Zou D, Zhou S Z, Zhao Q, Tan P. Image matting with local and nonlocal smooth priors. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, Jun. 2013, pp.1902-1907.

  30. Zhang Z, Zhu Q, Xie Y. Learning based alpha matting using support vector regression. In Proc. the 19th IEEE International Conference on Image Processing, Sept. 30-Oct. 3, 2012, pp.2109-2112.

  31. Rother C, Kolmogorov V, Blake A. “GrabCut”: Interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics, 2004, 23(3): 309-314.

  32. Boykov Y, Kolmogorov V. An experimental comparison of Min-Cut/Max-Flow algorithms for energy minimization in vision. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(9): 1124-1137.

  33. Boykov Y, Veksler O, Zabih R. Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(11): 1222-1239.

  34. Juan O, Keriven R. Trimap segmentation for fast and user-friendly alpha matting. In Proc. the 3rd Variational, Geometric, and Level Set Methods in Computer Vision, Oct. 2005, pp.186-197.

  35. Wang J, Cohen M F. Image and video matting: A survey. Foundations and Trends in Computer Graphics and Vision, 2007, 3(2): 97-175.

Download references

Author information

Authors and Affiliations

  1. School of Computer and Information Engineering, Harbin University of Commerce, Harbin, 150028, China

    Gui-Lin Yao

Authors
  1. Gui-Lin Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gui-Lin Yao.

Additional information

This work was supported by the Doctoral Scientific Research Start Fund Project of Harbin University of Commerce of China under Grant No. 15KJ06, the Youth Innovation Talent Support Program of Harbin University of Commerce under Grant No. 2016QN054, and the National Basic Research 973 Program of China under Grant No. 2015CB351804.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yao, GL. A Survey on Pre-Processing in Image Matting. J. Comput. Sci. Technol. 32, 122–138 (2017). https://doi.org/10.1007/s11390-017-1709-z

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-017-1709-z

Keywords

Search

Navigation