Skip to main content
SpringerLink
Log in

A point-based rendering approach for real-time interaction on mobile devices

  • Published:
Science in China Series F: Information Sciences Aims and scope Submit manuscript

Abstract

Mobile device is an important interactive platform. Due to the limitation of computation, memory, display area and energy, how to realize the efficient and real-time interaction of 3D models based on mobile devices is an important research topic. Considering features of mobile devices, this paper adopts remote rendering mode and point models, and then, proposes a transmission and rendering approach that could interact in real time. First, improved simplification algorithm based on MLS and display resolution of mobile devices is proposed. Then, a hierarchy selection of point models and a QoS transmission control strategy are given based on interest area of operator, interest degree of object in the virtual environment and rendering error. They can save the energy consumption. Finally, the rendering and interaction of point models are completed on mobile devices. The experiments show that our method is efficient.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Pan Z G, He G Q, Yang B, et al. Advance in research on mobile graphics technologies. J Comput-Aided Des & Comput Graph, 2008, 20(3): 273–280

    Google Scholar 

  2. Noimark Y, Cohen-Or D. Streaming scenes to MPEG-4 videoenabled devices. IEEE Comput Graph Appl, 2003, 23(1): 58–64

    Article  Google Scholar 

  3. Lamberti F, Sanna A. A streaming-based solution for remote visualization of 3D graphics on mobile devices. IEEE Trans Vis Comput Graph, 2007, 13(2): 247–260

    Article  Google Scholar 

  4. Zhu J J, Pan Z G, Xu G L, et al. Virtual avatar enhanced nonverbal communication from mobile phones to PCs. Edutainment, Nanjing, 2008. 551–567

  5. Zenka R, Slavik P. Non-photorealistic walkthroughs using flash. In: The 12th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, Plzen-Bory, 2004. 201–204

  6. Nishino H, Shihara K, Kagawa T, et al. A ubiquitous 3D graphics modeler for mobile devices. In: International Symposium on Parallel and Distributed Processing with Applications (ISPA’ 08), Sydney, 2008. 502–509

  7. Werner R, Pazzi N, Boukerche A, et al. Implementation, measurement, and analysis of an image-based virtual environment streaming protocol for wireless mobile devices. IEEE Trans Instrum Meas, 2008, 57(9): 1894–1907

    Article  Google Scholar 

  8. Lei Y. Research of key techniques in image based rendering system on mobile devices. Doctoral Dissertation. Hangzhou: Zhejiang University, 2005

    Google Scholar 

  9. Chang C, Ger S. Enhancing 3D graphics on mobile devices by image-based rendering. In: Proceedings of the Third IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing, Taiwan, 2002. 1105–1111

  10. Diepstraten J, Gorke M, Ertl T. Remote line rendering for mobile devices. In: Proceedings of the Computer Graphics International, Crete, Greece, 2004. 454–461

  11. Liu R F, Liang X H, Xie K, et al. Feature-preserving contour based remote rendering algorithm. J Imag Graph, 2009, 14(2): 346–352

    Google Scholar 

  12. Huang Y Z, Yang C L, Meng X X, et al. Stylistic line drawings of 3D models on mobile devices. J Comput-Aided Des & Comput Graph, 2007, 19(8): 1075–1079

    Google Scholar 

  13. Gutierrez M, Vexo F, Thalmann D. The mobile animator: interactive character animation in collaborative virtual environments. In: IEEE Virtual Reality, Chicago, 2004. 125–131

  14. Huang J S, Bue B, Pattath A, et al. Interactive illustrative rendering on mobile devices. IEEE Comput Graph Appl, 2007, 27(3): 48–56

    Article  Google Scholar 

  15. He B S, Xu X L, Zheng T. Vector graphics rendering on mobile device. In: International Conference on Communications and Mobile Computing (CMC’09), Kunming, 2009. 3: 8–11

    Article  Google Scholar 

  16. Chen R Q, Tang M, Dong J X. Non-photorealistic rendering in customizable styles for mobile collaboration. In: Proceedings of the 2007 11th International Conference on Computer Supported Cooperative Work in Design, Melbourne, 2007. 139–144

  17. Duguet F, Drettakis G. Flexible point-based rendering on mobile devices. IEEE Comput Graph Appl, 2004, 24(4): 57–63

    Article  Google Scholar 

  18. Boukerche A, Jing F, de Araujo R B. A 3D image-based rendering technique for mobile handheld devices. In: Proceedings of the 2006 International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM’06), Buffalo, 2006. 325–331

  19. He G Q, Bai B G, Pan Z G, et al. Accelerated rendering of vector graphics on mobile devices. In: Proceeding of HCI International, 2007. 298–305

  20. Zhang Q P, Lai L L. Strategies of enhancing the performance of embedded 3D graphics applications. In: Proceedings of the 6th International Conference on Machine Learning and Cybernetics, Hong Kong, 2007. 4231–4236

  21. Falchetto M, Barone M, Pau D, et al. Sort middle pipeline architecture for efficient 3D rendering. In: International Conference on Consumer Electronics, Las Vegas, 2007. 1–2

  22. Levoy M, Whitted T. The Use of Points as Display Primitives. Technical Report TR 85-022. CS Departement, University of North Carolina at Chapel Hill, January 1985

  23. Pfister H, Zwicker M, van Baar J, et al. Surfels: Surface elements as rendering primitives. In: Proc of ACM SIGGRAPH, 2000. 335–342

  24. Zwicker M, Pfister H, van Baar J, et al. Surface splatting. In: Proc of ACM SIGGRAPH, Los Angeles, 2001. 371–378

  25. Rusinkiewicz S, Levoy M. QSplat: a multiresolution pointrendering system for large meshes. In: Proc of SIGGRAPH, New Orleans, 2000. 343–352

  26. Rusinkiewicz S, Levoy M. Streaming qsplat: a viewer for networked visualization of large, dense models. In: Proceedings of the 2001 Symposium on Interactive 3D Graphics, Chapel Hill, 2001. 63–68

  27. Dachsbacher C, Vogelgsang C, Stamminger M. Sequential point trees. In: Proc of ACM SIGGRAPH, San Diego, 2003. 657–662

  28. Pauly M, Gross M, Kobbelt L P. Efficient simplification of point-sampled surfaces. In: Proceedings of the Conference on Visualization, Boston, 2003. 163–170

  29. Alexa M, Behr J, Cohen-Or D, et al. Computing and rendering point set surfaces. IEEE Trans Vis Comput Graph, 2003, 9(1): 3–15

    Article  Google Scholar 

  30. Botsch M, Wiratanaya A, Kobbelt L. Efficient high quality rendering of point sampled geometry. In: Proceedings of the 13th Eurographics Workshop on Rendering, Pisa, 2002. 53–64

  31. Pajarola R. Efficient level-of-details for point based rendering. In: Proceedings IASTED Computer Graphics and Imaging, Honolulu, 2003. 1–6

  32. Kalaiah A, Varshney A. Statistical point geometry. In: Proceedings of the 2003 Eurographics/ACM SIGGRAPH Symposium on Geometry processing, Aachen, 2003. 107–115

  33. Wu J H, Kobbelt L. Optimized sub-sampling of point sets for surface splitting. Comput Graph Forum, 2004, 23(3): 643–652

    Article  Google Scholar 

  34. Chim J, Lau R W H, Leong H V, et al. CyberWalk: A webbased distributed virtual walkthrough environment. IEEE Trans Multimedia, 2003, 5(4): 503–515

    Google Scholar 

  35. Sim J Y, Kim C S. Rate-distortion optimized compression and view-dependent transmission of 3-d normal meshes. IEEE Trans Circuits Syst Video Tech, 2005, 15(7): 854–868

    Article  Google Scholar 

  36. Ohshima T, Yamamoto H, Tamura H. Gaze-directed adaptive rendering for interacting with virtual space. In: Proceedings of the 1996 Virtual Reality Annual International Symposium (VRAIS 96), Washington, 1996. 103–110

  37. Yang B L, Li F W B, Pan Z G, et al. An effective error resilient packetization scheme for progressive mesh transmission over unreliable networks. J Comput Sci Tech, 2008 (6): 1015–1025

  38. Teler E, Lischinski D. Streaming of complex 3d scenes for remote walkthroughs. Comput Graph Forum, 2001, 20(3): 17–25

    Article  Google Scholar 

  39. Lau R W H, To D S P, Green M. An adaptive multi-resolution modeling technique based on viewing and animation parameters. In: Proc IEEE VRAIS, Albuquerque, 1997. 20–27

  40. Ioana M, Boier-Martin. Adaptive graphics. IEEE Comput Graph Appl, 2003, 23(1): 6–10

    Article  Google Scholar 

  41. Sun Y L. 3D terrafly-quality of service mannagement for online interactive 3D geographic information system. Doctoral Dissertation, Florida International University, 2004

  42. Oikawa S, Hashimoto K, Shibata Y. QoS control function based on user’s information on the 3D virtual shared space. In: Proceedings of the 18th International Conference on Advanced Information Networking and Application (AINA’04), Fukuoka, 2004, 2: 74–77

    Article  Google Scholar 

  43. Nakai Y, Kamon N, Shibata Y. Scalable collaborative virtual environment considering user’s interest information. In: Proceedings of the 20th International Conference on Advanced Information Networking and Applications (AINA’06). Vienna: Vienna University of Technology, 2006. 2: 1–5

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Technology, Beihang University, Beijing, 100191, China

    XiaoHui Liang, QinPing Zhao, ZhiYing He, Ke Xie & YuBo Liu

Authors
  1. XiaoHui Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. QinPing Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. ZhiYing He
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ke Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. YuBo Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to XiaoHui Liang.

Additional information

Supported by the National Natural Science Foundation of China (Grant No. 60873159), the Program for New Century Excellent Talents in University (Grant No. NCET-07-0039), the National High-Tech Research & Development Progrom of China (Grant No. 2006AA01Z333)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liang, X., Zhao, Q., He, Z. et al. A point-based rendering approach for real-time interaction on mobile devices. Sci. China Ser. F-Inf. Sci. 52, 1335–1345 (2009). https://doi.org/10.1007/s11432-009-0144-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11432-009-0144-3

Keywords

Search

Navigation