Ma Cheng
ABSTRACT
Metaverse development has often focused on bettering virtual reality technologies due to benefits in establishing immersion in virtual environment1. Its dependency on VR technology brings limitations including the lack of high-quality graphics and a lack of mobility. The mobile platform is the most prevalent interface for users to gain VR experience. There is a big challenge that mobile VR must face: it has limited computing power, but VR requires high rendering speed and image quality. The traditional solution is to complete lighting and shading computation offline and bake the result to light map. Thus, only texture lookups are needed at runtime which allows very high rendering speed. The problem of the traditional baking is that they usually take seconds to minutes to finish. In this paper, we introduce a novel edge computing framework to reduce the baking time to less than a second. Our method uses reservoir-based spatiotemporal importance resampling (ReSTIR) to bake low resolution light maps at edge server. At mobile side, the light maps are enlarged using super resolution technique. We also use denoiser to make sure the baked image is noise-free. The experimental results show that our method can have near real-time performance for scene with average complexity. The bottleneck is the bandwidth of mobile device when performing super resolution. Once it gets improved, we can expect our entire edge computing framework becomes real-time.
- G. J. Ward, F. M. Rubinstein, R. D. Clear, A ray tracing solution for diffuse interreflection, SIGGRAPH Comput. Graph. 22 (4) (1988) 85--92. doi:10.1145/378456.378490.Google Scholar
Digital Library
- G. J.Ward, P. Heckbert, Irradiance gradients, in: In Proceedings of Eurographics Workshop on Rendering, Bristol, UK, 1992, pp. 85--98.Google Scholar
- E. Tabellion, A. Lamorlette, An approximate global illumination system for computer generated films, ACM Trans. Graph. 23 (3) (2004) 469--476. doi:10.1145/1015706.1015748.Google ScholarDigital Library
- J. Krivánek, K. Bouatouch, S. Pattanaik, J. Zára, Making radiance and irradiance caching practical: Adaptive caching and neighbor clamping, in: Proceedings of the 17th Eurographics Conference on Rendering Techniques, EGSR '06, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 2006, pp. 127--138. doi:10.2312/EGWR/EGSR06/127-138.Google Scholar
- J. Schwarzhaupt, H. W. Jensen, W. Jarosz, Practical hessian-based error control for irradiance caching, ACM Trans. Graph. 31 (6) (2012) 193:1--193:10. doi:10.1145/2366145.2366212.Google ScholarDigital Library
- H. W. Jensen, Global illumination using photon maps, in: Proceedings of the Eurographics Workshop on Rendering Techniques '96, Springer-Verlag, London, UK, UK, 1996, pp. 21--30.Google ScholarDigital Library
- P. H. Christensen, Faster photon map global illumination, J. Graph. Tools 4 (3) (1999) 1-10. doi:10.1080/10867651.1999.10487505.Google ScholarDigital Library
- T. Hachisuka, S. Ogaki, H. W. Jensen, Progressive photon mapping, ACM Trans. Graph. 27 (5) (2008) 130:1--130:8. doi:10.1145/1409060.1409083.Google ScholarDigital Library
- C. Knaus, M. Zwicker, Progressive photon mapping: A probabilistic approach, ACM Trans. Graph. 30 (3) (2011) 25:1--25:13. doi:10.1145/1966394.1966404.Google ScholarDigital Library
- V. Havran, R. Herzog, H.-P. Seidel, Fast Final Gathering via Reverse Photon Mapping, Computer Graphics Forumdoi:10.1111/j.1467-8659.2005.00857.x.Google Scholar
- T. Hachisuka, W. Jarosz, H. W. Jensen, A progressive error estimation framework for photon density estimation, ACM Trans. Graph. 29 (6) (2010) 144:1--144:12. doi:10.1145/1882261.1866170.Google ScholarDigital Library
- Benedikt Bitterli, Chris Wyman, Matt Pharr, Peter Shirley, Aaron Lefohn, and Wojciech Jarosz. 2020. Spatiotemporal reservoir resampling for real-time ray tracing with dynamic direct lighting. ACM Trans. Graph. 39, 4, Article 148 (July 2020), 17 pages.Google Scholar
- Christan Luksch, Michael Wimmer, and Michael Schwärzler. 2019. Incrementally baked global illumination. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D '19). Association for Computing Machinery, New York, NY, USA, Article 4, 1--10. DOI:https://doi.org/10.1145/3306131.3317015Google ScholarDigital Library
- Chang Liu, Wei Tsang Ooi, Jinyuan Jia, and Lei Zhao. 2018. Cloud Baking: Collaborative Scene Illumination for Dynamic Web3D Scenes. ACM Trans. Multimedia Comput. Commun. Appl. 14, 3s, Article 59 (August 2018), 20 pages. DOI:https://doi.org/10.1145/32064316Google Scholar
- Dario Seyb, Peter-Pike Sloan, Ari Silvennoinen, Michał Iwanicki, and Wojciech Jarosz. 2020. The design and evolution of the UberBake light baking system. ACM Trans. Graph. 39, 4, Article 150 (July 2020), 13 pages. DOI:https://doi.org/10.1145/3386569.3392394Google Scholar
- AMD FidelityFX Super Resolution 1.0 (FSR). Retrieved from https://github.com/GPUOpen-Effects/FidelityFX-FSRGoogle Scholar
- H. Halen, A. Brinck, K. Hayward, X. Bei. Global Illumination Based on Surfels. Advances in Real-Time Rendering in Games course, SIGGRAPH 2021.Google Scholar
- NVIDIA Real-Time Denoisers. Retrieved from https://developer.nvidia.com/nvidia-rt-denoiserGoogle Scholar
- X. Zhang, Y. Wang, J. Zhang, L. Wang and Y. Zhao, "RINGLM: A Link-Level Packet Loss Monitoring Solution for Software-Defined Networks," in IEEE Journal on Selected Areas in Communications, vol. 37, no. 8, pp. 1703--1720, Aug. 2019, doi: 10.1109/JSAC.2019.29270Google ScholarDigital Library
- X. Zhang, W. Gu, H. Zhang and M. Wang, "Hybrid Communication Path Orchestration for 5G Heterogeneous Ultra-Dense Networks," in IEEE Network, vol. 33, no. 4, pp. 112--118, July/August 2019, doi: 10.1109/MNET.2019.1800402.Google ScholarCross Ref
- X. Zhang, Y. Wang, G. Geng and J. Yu, "Delay-Optimized Multicast Tree Packing in Software-Defined Networks" in IEEE Transactions on Services Computing, vol., no. 01, pp. 1--1, 5555.Google Scholar
- Zhang, Xinchang & Wang, Yinglong & Yang, Meihong & Geng, Guanggang. (2021). Toward Concurrent Video Multicast Orchestration for Caching-Assisted Mobile Networks. IEEE Transactions on Vehicular Technology. PP. 1--1. 10.1109/TVT.2021.3119429.Google Scholar
- Zhiwei Yan, Jong Hyouk Lee, Sean Shen, Chunming Qiao. Novel Branching-Router based Multicast Routing Protocol with Mobility Support. IEEE Transactions on Parallel and Distributed Systems, Institute of Electrical and Electronics Engineers, 2012, 24 (10), pp.20.Google Scholar
Index Terms
- A Fast Light Baking System for Mobile VR Game Based on Edge Computing Framework
Recommendations
The making of welcome to light fields VR
SIGGRAPH '18: ACM SIGGRAPH 2018 TalksLight fields can provide transportive immersive experiences with a level of realism unsurpassed by any other imaging technology. Within a limited viewing volume, light fields accurately reproduce stereo parallax, motion parallax, reflections, ...
Interactive Realism for Visualization Using Ray Tracing
VIS '95: Proceedings of the 6th conference on Visualization '95Visual realism is necessary for many virtual reality applications. In order to convince the user that the virtual environment is real, the scene presented should faithfully model the expected actual environment. A highly accurate, fully modeled, ...
Comments