Abstract
To enable viewers to perceive the video content as if he or she is walking inside the video scenes, we need to have two essential video technologies. One is to present the audience with panoramic videos with 360°, and the other is view-adaptive video playback, i.e. presenting video scenes in accordance with the change of viewing angles. For the first technology, we propose a fast video stitching algorithm via exploiting the audio information for frame synchronization, and for the second, we propose a Fake-3D and True-3D mix method to immerse viewers inside the video scene via its dynamic playback of panoramic videos, adaptive to multi-view changes. Our proposed technologies have great potential in practical applications, such as virtual reality gaming and new concept movie shows etc.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
McVicar, M., Santos-Rodríguez, R., Ni, Y., De Bie, T.: Automatic chord estimation from audio: a review of the state of the art. IEEE Trans. Audio Speech Lang. Process. 22, 556–573 (2014)
Brown, M., Lowe, D.G.: Automatic panoramic image stitching using invariant features. Int. J. Comput. Vis. (2007)
Tang, W., Wong, T.T., Heng, P.: A system for real-time panorama generation and display in tele-immersive applications. IEEE Trans. Mult. 7, 280–292 (2005)
Burt, P., Adelson, E.: A multiresolution spline with application to image mosaics. ACM Trans. Graphics 2, 217–236 (1983)
Xu, W., Mulligan, J.: Panoramic video stitching from commodity HDTV cameras. Multimedia Syst. 19, 407–426 (2013)
Molina, E., Zhu, Z.: Persistent aerial video registration and fast multi-view mosaicking. IEEE Trans. Image Process. 23, 2184–2192 (2014)
Song, X., Zhang, J., Han, Y., Jiang, J.: Semi-supervised feature selection via hierarchical regression for web image classification. Multimedia Syst. 22(1), 41–49 (2016)
Zhang, J., Han, Y., Jiang, J.: Tensor rank selection for multimedia analysis. J. Vis. Commun. Image Represent. 30, 376–392 (2015)
Li, J.Y., Jiang, J.: Nonrigid structure from motion via sparse representation. IEEE Trans. Cybern. 45(8), 1401–1413 (2015)
Pan, Z.L., Ming, Z., Zhong, H., Wang, X., Xu, C.: Compressed knowledge transfer via factorization machine for heterogeneous collaborative recommendation. Knowl. Based Syst. 85, 234–244 (2015)
Bano, S., Cavallaro, A.: Discovery and organization of multi-camera user-generated videos of the same event. Inf. Sci. 302, 108–121 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Nie, Y., Jiang, J. (2017). Walking into Panoramic and Immersive 3D Video. In: Maglaras, L., Janicke, H., Jones, K. (eds) Industrial Networks and Intelligent Systems. INISCOM 2016. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 188. Springer, Cham. https://doi.org/10.1007/978-3-319-52569-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-52569-3_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-52568-6
Online ISBN: 978-3-319-52569-3
eBook Packages: Computer ScienceComputer Science (R0)