Abstract
In this paper, we propose a new video matting method based on sampling. By detecting the movement of foreground and background objects from video, we define the local transformation which transfer the small areas between different frames in the video. By the local transformation, foreground and the occluded background object can be sampled from neighbor frames. Benefited from temporal consistency, we can get high quality alpha matte. Experiment results show that our method achieves ideal results in the scenes where old method get poor results.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bai, X., Wang, J., Simons, D., Sapiro, G.: Video snapcut: robust video object cutout using localized classifiers, vol. 28, pp. 70:1–70:11. ACM, New York (July 2009)
Brox, T., Bregler, C., Malik, J.: Large displacement optical flow. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 41–48 (2009)
Chen, Q., Li, D., Tang, C.-K.: Knn matting. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn. (CVPR) 2012, 869–876 (2012)
Chen, T., Cheng, M.-M., Tan, P., Shamir, A., Hu, S.-M.: Sketch2photo: internet image montage. ACM Trans. Graph. 28, 124:1–124:10 (2009)
Chen, X., Zhou, D., Zhou, S.Z., Zhao, Q., Tan, P.: Image matting with local and nonlocal smooth priors. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (June 2013)
Gastal, E.S.L., Oliveira, M.M.: Shared sampling for real-time alpha matting. In: Proceedings of Eurographics Computer Graphics Forum, vol. 29, no. 2, pp. 575–584 (May 2010)
Hou, Z.: A background reconstruction algorithm based on pixel intensity classification in remote video surveillance system
Lee, P., Wu, Y.: Nonlocal matting. In: The 24th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011, pp. 2193–2200. IEEE, Colorado Springs (20–25 June 2011)
Levin, A., Lischinski, D., Weiss, Y.: A closed form solution to natural image matting. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 61–68. IEEE Computer Society, Washington, DC, USA (2006)
Li, Y., Sun, J., Shum, H.-Y.: Video object cut and paste. ACM Trans. Graph. 24, 595–600 (2005)
Rajan, D.: Weighted color and texture sample selection for image matting. In: Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), CVPR 2012, pp. 718–725. IEEE Computer Society, Washington (2012)
Shen, Y., Lin, X., Gao, Y., Sheng, B., Liu, Q.: Video composition by optimized 3d mean-value coordinates. Comput. Animat. Virtual Worlds 23(3–4), 179–190 (2012)
Shen, Y., Ma, L., Liu, H., Bao, Y., Chen, Z.: Detecting and extracting natural snow from videos. Inf. Process. Lett. 110(24), 1124–1130 (2010)
Shi, Y., Au, O.C., Pang, J., Tang, K., Sun, W., Zhang, H., Zhu, W., Jia, L.: Color clustering matting. In: ICME, pp. 1–6. IEEE (2013)
Varadarajan, S., Karam, L.J., Florencio, D.: Background recovery from video sequences using motion parameters. In: ICASSP 2009: Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 989–992. IEEE Computer Society, Washington (2009)
Wang, J., Bhat, P., Colburn, R.A., Agrawala, M., Cohen, M.F.: Interactive video cutout. ACM Trans. Graph. 24, 585–594 (2005)
Sorkine, O., Wang, Y.S., Tai, C.-L. Lee, T.-Y.: Optimized scale-and-stretch for image resizing. In: ACM Trans. Graph. Proceedings of ACM SIGGRAPH ASIA, vol. 27, no. 5 (2008)
Zheng, Y., Kambhamettu, C.: Learning based digital matting. In: IEEE 12th International Conference on Computer Vision, ICCV 2009, pp. 889–896. IEEE, Kyoto (27 September–4 October 2009)
Acknowledgements
This work is supported by the Zhejiang Provincial Natural Science Foundation of China, under grant LY13F020019, The Natural Science Foundation of China (No.u1304616).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pan, Q., Shen, Y., Bao, Y., Lin, X., Liu, J. (2015). Extracting the Foreground from Video Based on a New Sampling Method. In: Pan, Z., Cheok, A., Mueller, W., Zhang, M. (eds) Transactions on Edutainment XI. Lecture Notes in Computer Science(), vol 8971. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-48247-6_7
Download citation
DOI: https://doi.org/10.1007/978-3-662-48247-6_7
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-48246-9
Online ISBN: 978-3-662-48247-6
eBook Packages: Computer ScienceComputer Science (R0)