ABSTRACT
With the recent proliferation of high-fidelity head-mounted displays (HMDs), there is increasing demand for realistic 3D content that can be integrated into virtual reality environments. However, creating photorealistic models is not only difficult but also time consuming. A simpler alternative involves scanning objects in the real world and rendering their digitized counterpart in the virtual world. Capturing objects can be achieved by performing a 3D scan using widely available consumer-grade RGB-D cameras. This process involves reconstructing the geometric model from depth images generated using a structured light or time-of-flight sensor. The colormap is determined by fusing data from multiple color images captured during the scan. Existing methods compute the color of each vertex by averaging the colors from all these images. Blending colors in this manner creates low-fidelity models that appear blurry. (Figure 1 right). Furthermore, this approach also yields textures with fixed lighting that is baked on the model. This limitation becomes more apparent when viewed in head-tracked virtual reality, as the illumination (e.g. specular reflections) does not change appropriately based on the user's viewpoint.
Supplemental Material
Available for Download
Supplemental files.
- Nakashima, Y., Uno, Y., Kawai, N., Sato, T., and Yokoya, N. 2015. Ar image generation using view-dependent geometry modification and texture mapping. Virtual Reality 19, 2, 83--94. Google ScholarDigital Library
- Zhou, Q.-Y., and Koltun, V. 2014. Color map optimization for 3d reconstruction with consumer depth cameras. ACM Trans. Graph. 33, 4 (July), 155:1--155:10. Google ScholarDigital Library
Index Terms
- Real-time 3D rendering using depth-based geometry reconstruction and view-dependent texture mapping
Recommendations
Real-time high-quality View-Dependent Texture Mapping using per-pixel visibility
GRAPHITE '05: Proceedings of the 3rd international conference on Computer graphics and interactive techniques in Australasia and South East AsiaWe present an extension of View-Dependent Texture Mapping (VDTM) allowing rendering of complex geometric meshes at high frame rates without usual blurring or skinning artifacts. We combine a hybrid geometric and image-based representation of a given 3D ...
Real-time rendering of plant leaves
SIGGRAPH '05: ACM SIGGRAPH 2005 PapersThis paper presents a framework for the real-time rendering of plant leaves with global illumination effects. Realistic rendering of leaves requires a sophisticated appearance model and accurate lighting computation. For leaf appearance we introduce a ...
Real-time rendering of realistic-looking grass
GRAPHITE '05: Proceedings of the 3rd international conference on Computer graphics and interactive techniques in Australasia and South East AsiaThe absence of accurately rendered grass in real-time applications such as games and simulation systems can be directly attributed to the massive amounts of geometry required to model grass patches. This in turn is responsible for the drastic increase ...
Comments