research-article

Towards peer-assisted rendering in networked virtual environments

Authors:

Sebastien Mondet,

Géraldine Morin,

Wei ChengAuthors Info & Claims

MM '11: Proceedings of the 19th ACM international conference on Multimedia

Pages 183 - 192

https://doi.org/10.1145/2072298.2072324

Published: 28 November 2011 Publication History

Abstract

This paper introduces a new technique, called peer-assisted rendering, that aims to enable interactive navigation in a 3D networked virtual environment using a resource-constrained device, by speeding up the rendering. A resource-constrained client requests part of the rendered scenes from other peers with similar viewpoints within the virtual environment, and merges the rendered parts into its own view. This approach is more scalable than previous solutions based on server-based pre-rendering. The goal of this paper is to make a strong case for the feasibility of peer-assisted rendering through the following two messages. First, by analyzing a large number of user traces from a popular virtual world called Second Life, we show that there are surprisingly many users with similar viewpoints and encompass large number of common objects in their viewing areas, indicating that a client can potentially find multiple other peers that can assist in rendering. Second, by combining three different rendering methods, each contributing to rendering of different classes of objects in the scene, we show that it is possible for a client to render the scene efficiently with little visual artifacts.

References

[1]

P. Bao and D. Gourlay. A framework for remote rendering of 3-D scenes on limited mobile devices. IEEE Trans. on Multimedia, 8(2):382 -- 388, apr. 2006.

Digital Library

[2]

P. Bao and D. Gourlay. Collaborative walkthrough using 3D warping. In Proc. of the Intl. Conf. on Computer and Communication Engineering 2008, pages 1110--1115, Kuala Lumpur, Malaysia, 2008.

[3]

A. Boukerche and R. W. N. Pazzi. Remote rendering and streaming of progressive panoramas for mobile devices. In MM'06: Proc. of the 14th ACM Intl. Conf. on Multimedia, pages 691--694, Santa Barbara, CA, USA, 2006.

Digital Library

[4]

A. Boukerche, R. Werner, and N. Pazzi. A peer-to-peer approach for remote rendering and image streaming in walkthrough applications. In ICC '07: IEEE Intl. Conf. on Communications, pages 1692 --1697, june 2007.

[5]

C.-F. Chang and S.-H. Ger. Enhancing 3D graphics on mobile devices by image-based rendering. In PCM '02: Proc. of the 3rd IEEE Pacific Rim Conf. on Multimedia, pages 1105--1111, London, UK, 2002. Springer-Verlag.

Digital Library

[6]

J. Chen, I. Yoon, and W. Bethel. Interactive, internet delivery of visualization via structured prerendered multiresolution imagery. IEEE Trans. on Visualization and Computer Graphics, 14(2):302--312, 2008.

Digital Library

[7]

L. Cheng, A. Bhushan, R. Pajarola, and M. E. Zarki. Real-time 3D graphics streaming using MPEG-4. In Proc. of the IEEE/ACM Workshop on Broadband Wireless Services and Applications, 2004.

[8]

W. Cheng, D. Liu, and W. T. Ooi. Peer-assisted view-dependent progressive mesh streaming. In MM '09: Proc. of the 17th ACM Intl. Conf. on Multimedia, pages 441--450, Beijing, China, 2009.

Digital Library

[9]

S.-Y. Hu. A case for 3D streaming on peer-to-peer networks. In Web3D '06: Proc. of the 11th Intl. Conf. on 3D Web Technology, pages 57--63, Columbia, Maryland, 2006.

Digital Library

[10]

H. Z. Jie Feng. Efficient view-dependent LOD control for large 3D unclosed mesh models of environments. In Proc. of IEEE Intl. Conf. on Robotics and Automation, pages 2723--2728, 2004.

[11]

F. Lamberti, C. Zunino, A. Sanna, A. Fiume, and M. Maniezzo. An accelerated remote graphics architecture for PDAs. In Web3D '03: Proc. of the 8th Intl. Conf. on 3D Web Technology, pages 55--ff, Saint Malo, France, 2003.

Digital Library

[12]

S. Lazem, M. Elteir, A. Abdel-Hamid, and D. Gracanm. Prediction-based prefetching for remote rendering streaming in mobile virtual environments. In IEEE Intl. Symp. on Signal Processing and Information Technology, pages 760 --765, 2007.

[13]

Y. Lei, Z. Jiang, D. Chen, and H. Bao. Image-based walkthrough over Internet on mobile devices. In Proc. of Grid and Cooperative Computing, pages 728--735, 2004.

[14]

H. Liang, R. N. Silva, W. T. Ooi, and M. Motani. Avatar mobility in user-created networked virtual worlds: measurements, analysis, and implications. Multimedia Tools Appl., 45(1--3):163--190, 2009.

Digital Library

[15]

K. Liang and R. Zimmermann. Cross-tree adjustment for spatialized audio streaming over networked virtual environments. In NOSSDAV '09: Proc. of the 18th Intl. Workshop on Network and Operating Systems Support for Digital Audio and Video, pages 73--78, Williamsburg, VA, USA, 2009.

Digital Library

[16]

J. Lluch, R. Gaitan, E. Camahort, and R. Vivo. Interactive three-dimensional rendering on mobile computer devices. In Proc. of the 2005 ACM SIGCHI Intl. Conf. on Advances in Computer Entertainment Technology, pages 254--257, 2005.

Digital Library

[17]

W. R. Mark, L. McMillan, and G. Bishop. Post-rendering 3D warping. In I3D '97: Proc. of the 1997 Symposium on Interactive 3D Graphics, pages 7--ff., Providence, RI, 1997.

Digital Library

[18]

L. McMillan and G. Bishop. Plenoptic modeling: an image-based rendering system. In SIGGRAPH '95: Proc. of the 22nd Conf. on Computer Graphics and Interactive Techniques, pages 39--46, 1995.

Digital Library

[19]

B. Mochocki, K. Lahiri, and S. Cadambi. Power analysis of mobile 3D graphics. In Proc. of the Conf. on Design, Automation and Test in Europe, pages 502--507, Munich, Germany, 2006.

Digital Library

[20]

Y. Noimark and D. Cohen-Or. Streaming scenes to MPEG-4 video-enabled devices. IEEE Computer Graphics and Applications, 23(1):58--64, 2003.

Digital Library

[21]

J. Shade, S. Gortler, L.-w. He, and R. Szeliski. Layered depth images. In SIGGRAPH '98: Proc. of the 25th Conf. on Computer Graphics and Interactive Techniques, pages 231--242, 1998.

Digital Library

[22]

S. Shi, W. J. Jeon, K. Nahrstedt, and R. H. Campbell. Real-time remote rendering of 3D video for mobile devices. In MM '09: Proc. of the 17th ACM Intl. Conf. on Multimedia, pages 391--400, Beijing, China, 2009.

Digital Library

[23]

S. Shi, M. Kamali, K. Nahrstedt, J. C. Hart, and R. H. Campbell. A high-quality low-delay remote rendering system for 3D video. In MM '10: Proc. of the 18th Intl. Conf. on Multimedia, pages 601--610, Firenze, Italy, 2010.

Digital Library

[24]

W. Shi, Y. Lu, Z. Li, and J. Engelsma. Scalable support for 3D graphics applications in cloud. In CLOUD '10: Proc. of the IEEE 3rd Intl. Conf. on Cloud Computing, pages 346--353, 2010.

Digital Library

[25]

A. Sterkin. Interactive 3D streaming. Research@Intel Blog, June 2008. Retrieved 1 April 2010.

Cited By

Wang RZhang BWu MZhang JGuo XZhang XLi HJiao DMa S(2019)Performance bottleneck analysis and resource optimized distribution method for IoT cloud rendering computing system in cyber-enabled applicationsEURASIP Journal on Wireless Communications and Networking10.1186/s13638-019-1401-92019:1Online publication date: 29-Mar-2019
https://doi.org/10.1186/s13638-019-1401-9
Wang RZhang BBi JZhang XGuo XJiao D(2019)GhostMobileCloud: A Cloud-Based Mobile Terminal User Accessing Remote 3D Scene Real-Time Communication MethodCommunications, Signal Processing, and Systems10.1007/978-981-13-6504-1_39(307-316)Online publication date: 14-Aug-2019
https://doi.org/10.1007/978-981-13-6504-1_39
Liu COoi WJia JZhao L(2018)Cloud BakingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/320643114:3s(1-20)Online publication date: 15-Jun-2018
https://dl.acm.org/doi/10.1145/3206431
Show More Cited By

Index Terms

Towards peer-assisted rendering in networked virtual environments
1. Computer systems organization
  1. Architectures
    1. Other architectures
      1. Special purpose systems
2. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces

Recommendations

Hybrid representations to improve both streaming and rendering of dynamic networked virtual environments
VRCAI '04: Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industry

In this paper we present a novel combined usage of image-based and geometrical representations in dynamic networked virtual environments. Contrary to other research, the type of applications we focus on rely on a continuous streaming of representation ...
Image-based rendering of diffuse, specular and glossy surfaces from a single image
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques

In this paper, we present a new method to recover an approximation of the bidirectional reflectance distribution function (BRDF) of the surfaces present in a real scene. This is done from a single photograph and a 3D geometric model of the scene. The ...
Sample-Based Cameras for Feed Forward Reflection Rendering

This paper presents sample-based cameras for rendering high quality reflections on convex reflectors at interactive rates. The method supports change of view, moving objects and reflectors, higher order reflections, view-dependent lighting of reflected ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '11: Proceedings of the 19th ACM international conference on Multimedia

November 2011

944 pages

ISBN:9781450306164

DOI:10.1145/2072298

General Chairs:
K. Selçuk Candan
Arizona State University, USA
,
Sethuraman Panchanathan
Arizona State University, USA
,
Balakrishnan Prabhakaran
University of Texas at Dallas, USA
,
Program Chairs:
Hari Sundaram
Arizona State University, USA
,
Wu-Chi Feng
Portland State University, USA
,
Nicu Sebe
University of Trento, Italy

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM '11

Sponsor:

SIGMM

MM '11: ACM Multimedia Conference

November 28 - December 1, 2011

Arizona, Scottsdale, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
272
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang RZhang BWu MZhang JGuo XZhang XLi HJiao DMa S(2019)Performance bottleneck analysis and resource optimized distribution method for IoT cloud rendering computing system in cyber-enabled applicationsEURASIP Journal on Wireless Communications and Networking10.1186/s13638-019-1401-92019:1Online publication date: 29-Mar-2019
https://doi.org/10.1186/s13638-019-1401-9
Wang RZhang BBi JZhang XGuo XJiao D(2019)GhostMobileCloud: A Cloud-Based Mobile Terminal User Accessing Remote 3D Scene Real-Time Communication MethodCommunications, Signal Processing, and Systems10.1007/978-981-13-6504-1_39(307-316)Online publication date: 14-Aug-2019
https://doi.org/10.1007/978-981-13-6504-1_39
Liu COoi WJia JZhao L(2018)Cloud BakingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/320643114:3s(1-20)Online publication date: 15-Jun-2018
https://dl.acm.org/doi/10.1145/3206431
Nuernberger BTurk MHöllerer TFjeld MFratarcangeli MSjölie DStaadt OUnger J(2017)Evaluating snapping-to-photos virtual travel interfaces for 3D reconstructed visual realityProceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology10.1145/3139131.3139138(1-11)Online publication date: 8-Nov-2017
https://dl.acm.org/doi/10.1145/3139131.3139138
Zhu MMorin GCharvillat VOoi W(2017)Sprite treeThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-016-1286-033:11(1385-1402)Online publication date: 1-Nov-2017
https://dl.acm.org/doi/10.1007/s00371-016-1286-0
Zhao SOoi W(2016)Modeling 3D synthetic view dissimilarityThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-015-1069-z32:4(429-443)Online publication date: 1-Apr-2016
https://dl.acm.org/doi/10.1007/s00371-015-1069-z
Chu DZhang ZWolman ALane NMase KLangheinrich MGatica-Perez DGellersen HChoudhury TYatani K(2015)PrimeProceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/2750858.2806062(203-214)Online publication date: 7-Sep-2015
https://dl.acm.org/doi/10.1145/2750858.2806062
Mohammadi IHashemi MGhanbari M(2015)An object-based framework for cloud gaming using player's visual attention2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)10.1109/ICMEW.2015.7169781(1-6)Online publication date: Jun-2015
https://doi.org/10.1109/ICMEW.2015.7169781
Lai CChao HTsai ZLai YHassan M(2015)A Hybrid Remote Rendering Approach for Graphic Applications on Cloud ComputingCloud Computing10.1007/978-3-319-16050-4_1(3-17)Online publication date: 8-Mar-2015
https://doi.org/10.1007/978-3-319-16050-4_1
Jia JWang WHei X(2014)An efficient caching algorithm for peer-to-peer 3D streaming in distributed virtual environmentsJournal of Network and Computer Applications10.1016/j.jnca.2014.03.00542(1-11)Online publication date: Jun-2014
https://doi.org/10.1016/j.jnca.2014.03.005
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten