Abstract
During 2D to 3D conversion, key-frame selection is a very important step as it can directly affect the visual quality of the 3D video. In this paper, a novel key-frame selection method for 2D-to-3D conversion is presented to get fewer errors and much better photorealistic perception. Firstly, the occlusion areas between two consecutive frames are detected and SURF-feature points of the frames are extracted. Secondly, the ratio of feature points to the correspondence is calculated, which is used to select the key-frame candidates. Finally, camera projection matrix in the projective space is computed for every key-frame candidate, and the key-frame candidate that has the least re-projection error is selected as the key-frame. Experimental results show that the propagated depth maps using the proposed method have fewer errors, which is beneficial to generate high quality stereoscopic video.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cao, X., Li, Z., Dai, Q.: Semi-Automatic 2D-to-3D Conversion Using Disparity Propagation. IEEE Transaction on Broadcasting 57(2), 491–499 (2011)
Wang, H., Huang, C., Yang, J.: Block-Based Depth Maps Interpolation for Efficient Multiview Content Generation. IEEE Transaction on Circuits and Systems for Video Technology 21(12), 1847–1858 (2011)
Harman, P.V., Flack, J., Fox, S., Dowley, M.: Rapid 2D-to-3D Conversion. In: Proceedings of Stereoscopic Displays and Virtual Reality Systems IX. SPIE, vol. 4669, pp. 78–86 (2002)
Seo, Y.H., Kim, S.H., Doo, K.S., Choi, J.S.: Optimal Keyframe Selection Algorithm for Three-Dimensional Reconstruction in Uncalibrated Multiple Images. Optical Engineering 47(5), 053201 (2008)
Harman, P.V.: Home-Based 3D Entertainment-An Overview. In: IEEE International Conference on Image Processing, pp. 1–4 (2000)
Nistér, D.: Frame Decimation for Structure and Motion. In: Second European Workshop on 3D Structure from Multiple Images of Large-Scale Environments, pp. 17–34 (2000)
Gibson, S., Cook, J., Howard, T., Hubbold, R.: Accurate Camera Calibration for Off-Line, Video-Based Augmented Reality. In: The 1st International Symposium on Mixed and Augmented Reality, pp. 37–46 (2002)
Ogale, A., Aloimonos, Y.: Shape and the Stereo Correspondence Problem. International Journal of Computer Vision 65(3), 147–162 (2005)
Lenz, R.K., Tsai, R.Y.: Technology for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Version Metrology. IEEE Transaction on Pattern Analysis and Machine Intelligence 10(5), 68–75 (1988)
Meyer, F.: Color Image Segmentation. In: Proceedings of the International Conference on Image Processing and Its Applications, pp. 303–306 (1992)
Ahmad, I., Zheng, W., Luo, J., Lion, M.: A Fast Adaptive Motion Estimation Algorithm. IEEE Transaction on Circuits System for Video Technology 16(3), 420–438 (2006)
Fehn, C.: Depth-Image-Based Rendering (DIBR), Compression, and Transmission for a New Approach on 3DTV. In: Proceedings of the SPIE, vol. 5291, pp. 93–104 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sun, J., Xie, J., Li, J., Liu, W. (2012). A Key-Frame Selection Method for Semi-automatic 2D-to-3D Conversion. In: Zhang, W., Yang, X., Xu, Z., An, P., Liu, Q., Lu, Y. (eds) Advances on Digital Television and Wireless Multimedia Communications. Communications in Computer and Information Science, vol 331. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34595-1_63
Download citation
DOI: https://doi.org/10.1007/978-3-642-34595-1_63
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34594-4
Online ISBN: 978-3-642-34595-1
eBook Packages: Computer ScienceComputer Science (R0)