Abstract
Real-time rendering of complex 3D scene on mobile devices is a challenging task. The main reason is that mobile devices have limited computational capabilities and are lack of powerful 3D graphics hardware support. In this paper, we propose a remote Image-Based Rendering system for mobile devices to interactively visualize real world and synthetic scenes under wireless network. Our system uses panoramic video as building block of representing scene data. The scene data is compressed with one MPEG like encoding scheme tailored for mobile device. The compressed data is stored on remote server. Our system carefully partitions the rendering task between client and server. The server is responsible for determining the required data for rendering novel views. It streams the required data to client in server pushing manner. After receiving data, mobile client carries out rendering locally using image warping and displays the resultant images onto its small screen. Experimental results show that our system can achieve real time rendering speed on mainstream mobile devices. It allows multiple mobile clients to explore the same or different scenes simultaneously.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bao, P., Gourlay, D.: A Framework for Remote Rendering of 3-D Scenes on Limited Mobile Devices. IEEE Transactions on Multimedia 8(2), 382–389 (2006)
Chang, C.-F., Ger, S.-H.: Enhancing 3D Graphics on Mobile Devices by Image-Based Rendering. In: Chen, Y.-C., Chang, L.-W., Hsu, C.-T. (eds.) PCM 2002. LNCS, vol. 2532, pp. 1105–1111. Springer, Heidelberg (2002)
Chen, S.E.: QuickTime VR-An Image-based Approach to Virtual Environment Navigation. In: Proccedings of SIGGRAPH 1995, pp. 29–38 (August 1995)
Chim, J., Lau, R.W.H.: CyberWalk: A Web-Based Distributed Virtual Walkthrough environment. IEEE Transactions on Multimedia 5(4), 503–515 (2003)
Diepstraten, J., Gorke, M., Ertl, T.: Remote line rendering for mobile devices. In: Proceedings of Computer Graphics International (CGI 2004), pp. 454–461 (2004)
Gortler, S.J., Grzeszczuk, R., Szeliski, R., Cohen, M.F.: The lumigraph. In: Proceedings of SIGGRAPH 1996, pp. 43–54 (August 1996)
Lamberti, F., Zunino, C., Sanna, A., Flume, A., Maniezzo, M.: An accelerated remote graphics architecture for PDAs. In: Proceeding of the eighth international conference on 3D web technology, pp. 55–61 (2003)
Levoy, M., Hanrahan, P.: Light field rendering. In: Proceedings of SIGGRAPH 1996, August 1996, pp. 31–42 (1996)
Luebke, D., Reddy, M., Cohen, J., Varshney, A., Watson, B., Huebner, R.: Level of Detail for 3D Graphics. Morgan Kaufmann Publishing, San Francisco (2002)
Ng, K.-T., Chan, S.-C., Shum, H.-Y.: Data Compression and Transmission Aspects of Panoramic Video. IEEE Transactions on Circuits and Systems for Video Technology 15(1), 82–95 (2005)
Noimark, Y., Cohen-Or, D.: Streaming Scenes to MPEG-4 Video Enabled Devices. IEEE Computer Graphics and Applications 23(1), 58–64 (2003)
Shum, H.-Y., He, L.-W.: Rendering with concentric mosaics. In: Proceedings of SIGGRAPH 1999, August 1999, pp. 299–306 (1999)
Shum, H.-Y., Kang, S.B., Chan, S.-C.: Survey of Image-Based Representation and Compression Techniques. IEEE Transactions on Circuits Systems for Video Technology 13(11), 1029–1037 (2003)
Teler, E., Lischinski, D.: Streaming of Complex 3D Scenes for Remote Walkthroughs. Computer Graphics Forum 20(3), 17–25 (2001)
Zhang, C., Li, J.: On the Compression and Streaming of Concentric Mosaic Data for Free Wondering in a Realistic Environment over the Internet. IEEE Transactions on Multimedia 7(6), 1170–1182 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jiang, Z. et al. (2006). PanoWalk: A Remote Image-Based Rendering System for Mobile Devices. In: Zhuang, Y., Yang, SQ., Rui, Y., He, Q. (eds) Advances in Multimedia Information Processing - PCM 2006. PCM 2006. Lecture Notes in Computer Science, vol 4261. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11922162_74
Download citation
DOI: https://doi.org/10.1007/11922162_74
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-48766-1
Online ISBN: 978-3-540-48769-2
eBook Packages: Computer ScienceComputer Science (R0)