Abstract
In a virtual environment (VE), efficient techniques are often needed to economize on rendering computation without compromising the information transmitted. The reported experiments devise a functional fidelity metric by exploiting research on memory schemata. According to the proposed measure, similar information would be transmitted across synthetic and real-world scenes depicting a specific schema. This would ultimately indicate which areas in a VE could be rendered in lower quality without affecting information uptake. We examine whether computationally more expensive scenes of greater visual fidelity affect memory performance after exposure to immersive VEs, or whether they are merely more aesthetically pleasing than their diminished visual quality counterparts. Results indicate that memory schemata function in VEs similar to real-world environments. “High-level” visual cognition related to late visual processing is unaffected by ubiquitous graphics manipulations such as polygon count and depth of shadow rendering; “normal” cognition operates as long as the scenes look acceptably realistic. However, when the overall realism of the scene is greatly reduced, such as in wireframe, then visual cognition becomes abnormal. Effects that distinguish schema-consistent from schema-inconsistent objects change because the whole scene now looks incongruent. We have shown that this effect is not due to a failure of basic recognition.
- Bartlett, F. C. 1932. Remembering. Cambridge University Press, Cambridge, U.K.Google Scholar
- Brewer, W. F. and Treyens, J. C. 1981. Role of schemata in memory for places. Cog. Psych. 13, 207--230.Google ScholarCross Ref
- Cater, K. Chalmers, A., and Ward, G. 2003. Detail to attention: Exploiting visual tasks for selective rendering. In Proceedings of the Eurographics Workshop on Rendering. 270--280. Google ScholarDigital Library
- Ferwerda, J. 2001. Hi-fi rendering. In Proceedings of the Campfire in Perceptually Adaptive Graphics. http://isg.cs.tcd.ie/campfire/jimferwerda2.html.Google Scholar
- Ferwerda, J. 2003. Three varieties of realism in computer graphics. In Proceedings of the SPIE Human Vision and Electronic Imaging. 290--297.Google ScholarCross Ref
- Flannery, K. A. and Walles, R. 2003. How does schema theory apply to real versus virtual memories? Cyberspych. Behav. 6, 2, 151--159.Google ScholarCross Ref
- Friedman, A. 1979. Framing Pictures: The role of knowledge in automatized encoding and memory for gist. J. Exp. Psyc. Gen. 108, 3, 316--355.Google ScholarCross Ref
- Goodman, G. S. 1980. Picture memory: How the action schema affects retention. Cog. Psych. 12, 473--495.Google ScholarCross Ref
- Haber, J., Myszkowski, K., Yamauchi, H., and Seidel, H. P. 2001. Perceptually guided corrective splatting. Comput. Graph. For. 20, 3, 142--152.Google Scholar
- Hock, H. S., Romanski, L., Galie, A., and Williams, C. S. 1978. Real-world schemata and scene recognition in adults and children. Mem. Cog. 6, 4, 423--431.Google ScholarCross Ref
- Kuipers, B. J. 1975. A frame for frames: Representing knowledge for recognition. In Representation and Understanding: Studies in Cognitive Science, D. G. Bobrow and A. Collins, Eds. Academic Press, New York, NY.Google Scholar
- Land, M. F. 1999. Motion and vision: Why animals move their eyes. J. Compar. Phys. A: Neuroethol. Sens. Neur. Behav. Phys. 185, 4, 341--352.Google ScholarCross Ref
- Liu, G., Austen, E. L., Booth, K. S., Fisher, B. D., Rempel, M. I., and Enns, J. T. 2005. Multiple object tracking is based on scene, not retinal, coordinates. J. Exper. Psych. Hum. Percept. Perform. 31, 2, 235--247.Google ScholarCross Ref
- Loftus, G. R., and Mackworth, N. H. 1978. Cognitive determinants of fixation location during picture viewing. J. Education. Psych. Hum. Percept. Perform. 4, 4, 565--572.Google ScholarCross Ref
- Mania, K., Adelstein, B., Ellis, S.R., and Hill, M. 2004. Perceptual sensitivity to head tracking latency in virtual environments with varying degrees of scene complexity. In Proceedings of the 1st Symposium on Applied Perception in Graphics and Visualization. 39--47. Google ScholarDigital Library
- Mania, K., Robinson, A., and Brandt, K. 2005. The effect of memory schemata on object recognition in virtual environments. Pres. Teleop. Virt. Environ. 14, 5, 606--615. Google ScholarDigital Library
- Mania, K., Troscianko, T., Hawkes, R., and Chalmers, A. 2003. Fidelity metrics for virtual environment simulations based on human judgments of spatial memory awareness states. Pres. Teleop. Virt. Environ. 12, 3, 296--310. Google ScholarDigital Library
- Marmitt, G. and Duchowski, A. T. 2002. Modeling visual attention in VR: Measuring the accuracy of predicted scanpaths. In Eurographics Short Presentations. 217--226.Google Scholar
- McConcie, G. W. and Loschy, L. C. 1997. Human performance with a gaze linked multi-resolutional display. In Proceedings of the 1st Advanced Displays and Interactive Displays Annual Symposium. 25--34.Google Scholar
- Nemire, K., Jacoby, R. H., and Ellis, S. R. 1994. Simulation fidelity of a virtual environment display. Hum. Fact. 36, 1, 79--93.Google ScholarCross Ref
- Pezdek, K., Whetstone, T., Reynolds, K., Askari, N., and Dougherty, T. 1989. Memory for real-world scenes: The role of consistency with schema expectation. J. Exper. Psych. Learn. Mem. Cog. 15, 4, 587--595.Google ScholarCross Ref
- Rodger, J. C. and Browse, R. A. 2000. Choosing rendering parameters for effective communication of 3D shape. IEEE Comput. Graph. Appl. 20, 2, 20--28. Google ScholarDigital Library
- Rojahn, K. and Pettigrew, T. F. 1992. Memory for schema-relevant information: A meta-analytic resolution. Brit. J. Soc. Psych. 31, 2, 81--109.Google ScholarCross Ref
- Saab, Z., Trottier, J., and Wall, H. M. 1984. Memory for places: Role of schemata-related expectancy and saliency in recall and recognition. Psych. Rep. 54, 607--610.Google ScholarCross Ref
- Wagner, L. 1987. The effects of shadow quality on the perception of spatial relationships in computer generated imagery. In Proceedings of the Symposium on Interactive 3D Graphics. 39--42. Google ScholarDigital Library
- Waller, D., Hunt, E., and Knapp, D. 1998. The transfer of spatial knowledge in virtual environment training. Pres. Teleop. Virt. Environ. 7, 2, 129--143. Google ScholarDigital Library
- Watson, B. Friedman, A., and McGaffey, A. 2001. Measuring and predicting visual fidelity. In Proceedings of the 28th Height Annual Conference on Computer Graphics and Interactive Techniques. 213--220. Google ScholarDigital Library
- Watson, B. A., Walker, N., Hodges, L.F., and Reddy, M. 1997. An evaluation of level of detail degradation in head-mounted display peripheries. Pres. Teleop. Virt. Environ. 6, 6, 630--637.Google ScholarDigital Library
- Wickens, T. D. 2001. Elementary Signal Detection Theory. Oxford University Press, Oxford, UK.Google Scholar
Index Terms
- Quantifying fidelity for virtual environment simulations employing memory schema assumptions
Recommendations
Visual Realism Enhances Realistic Response in an Immersive Virtual Environment-Part 2
Does realistic lighting in an immersive VR application enhance presence—that is, the participants' feeling that they're actually in the scene and behaving accordingly? Part 1 of this study indicated that presence is more likely with real-time ray ...
Photometric Image-Based Rendering for Virtual Lighting Image Synthesis
IWAR '99: Proceedings of the 2nd IEEE and ACM International Workshop on Augmented RealityA concept named Photometric Image-Based Rendering (PIBR) is introduced for a seamless augmented reality. The PIBR is defined as Image-Based Rendering which covers appearance changes caused by the lighting condition changes, while Geometric Image-Based ...
Virtual Reality in Brazil 2011: RPR-SORS: Real-time photorealistic rendering of synthetic objects into real scenes
This paper presents a review of the Photorealistic Augmented Reality field and proposes a solution for interactively rendering virtual objects into dynamic real scenes in a photorealistic way. This solution features a rendering pipeline that comprises ...
Comments