Abstract
In virtual environments, head pose and/or eye-gaze estimation can be employed to improve the visual experience of the user by enabling adaptive level of detail during rendering. In this study, we present a real-time system for rendering complex scenes in an immersive virtual environment based on head pose estimation and perceptual level of detail. In our system, the position and orientation of the head are estimated using stereo vision approach and markers placed on a pair of glasses used to view images projected on a stereo display device. The main innovation of our work is the incorporation of uncertainty estimates to improve the visual experience perceived by the user. The estimated pose and its uncertainty are used to determine the desired level of detail for different parts of the scene based on criteria originating from physiological and psychological aspects of human vision. Subject tests have been performed to evaluate our approach.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Clark, J.H.: Hierarchical Geometric Models for Visible Surface Algorithms. Communications of the ACM 17(2), 547–554 (1976)
Oshima, T., Yamamoto, H., Tamura, H.: Gaze-Directed Adaptive Rendering for Interacting with Virtual Space. In: Proceedings of 1996 IEEE Virtual Reality Annual International Symposium, pp. 103–110 (1996)
Luebke, D., et al.: Perceptually Driven Simplification Using Gaze-Directed Rendering. University of Virginia Technical Report CS-2000-04 (2000)
Luebke, D., et al.: Level of Detail for 3D Graphics, 1st edn. Morgan Kaufmann Publishers, San Francisco (2003)
Luebke, D.: A Developer’s Survey of Polygonal Simplification Algorithms. IEEE Computer Graphics & Applications (May 2001)
Junkins, S., Hux, A.: Subdividing Reality. Intel Architecture Labs White Paper (2000)
Warren, J., Schaefer, S.: A factored approach to subdivision surfaces. IEEE Computer Graphics and Applications, 74–81 (2004)
Eberly, D.H.: 3D Game Engine Design. Morgan Kaufmann Publishers, San Francisco (2001)
Mannos, J.L., Sakrison, D.J.: The Effects of a Visual Fidelity Criterion on the Encoding of Images. IEEE Transactions on Information Theory 20(4), 525–535 (1974)
Reddy, M.: Perceptually Modulated Level of Detail for Virtual Environments. PhD. Thesis. CST-134-97. University of Edinburgh, Edinburgh, Scotland (1997)
Duchowski, A.T.: Acuity-Matching Resolution Degradation Through Wavelet Coefficient Scaling. IEEE Transactions in Image Processing 9(8), 1437–1440 (2000)
Geisler, W.S., Perry, J.S.: Real-time Simulation of Arbitrary Visual Fields. In: ACM Symposium on Eye Tracking Research & Applications (2002)
Perry, J.S., Geisler, W.S.: Gaze-contingent real-time simulation of arbitrary visual fields. In: Proceedings of SPIE: Human Vision and Electronic Imaging, San Jose, CA (2002)
Ji, Q., Haralick, R.M.: Error Propagation for Computer Vision Performance Characterization. In: International Conference on Imaging Science, Systems, and Technology, Las Vegas (June 1999)
Murray, D., Little, J.J.: Patchlets: Representing Stereo Vision Data with Surface Elements. In: Workshop on the Applications of Computer Vision, WACV (2005)
Forsyth, D.A., Ponce, J.: Computer Vision A Modern Approach, 1st edn. Prentice Hall, Englewood Cliffs (2003)
Murphy, H., Duchowski, A.T.: Gaze-Contingent Level Of Detail Rendering. In: EuroGraphics Conference (September 2001)
Williams, N., et al.: Perceptually guided simplification of lit, textured meshes. In: Proceedings of the 2003 Symposium on Interactive 3D graphics, Monterrey, CA (2003)
Arun, K., et al.: Least-squares fitting of two 3-D point sets. IEEE Transactions on Pattern Analysis and Machine Intelligence 9(5), 698–700 (1987)
Owens, R.: Lecture notes, http://homepages.inf.ed.ac.uk/rbf/CVonline/LOCAL_COPIES/OWENS/LECT11/node5.html
VirtualgloveBox, http://biorvis.arc.nasa.gov/vislab/vgx.htm
Effective Human-Computer Interaction in Virtual Environments, http://www.cse.unr.edu/CVL/current_proj.php
Martinez, J.: Rendering Optimizations Guided by Head-Pose Estimates and Their Uncertainty. M.S. Thesis, Dept of Computer Science and Engineering, University of Nevada, Reno (August 2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Martínez, J.E., Erol, A., Bebis, G., Boyle, R., Twombly, X. (2005). Rendering Optimizations Guided by Head-Pose Estimates and Their Uncertainty. In: Bebis, G., Boyle, R., Koracin, D., Parvin, B. (eds) Advances in Visual Computing. ISVC 2005. Lecture Notes in Computer Science, vol 3804. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11595755_31
Download citation
DOI: https://doi.org/10.1007/11595755_31
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30750-1
Online ISBN: 978-3-540-32284-9
eBook Packages: Computer ScienceComputer Science (R0)