Skip to main content
SpringerLink
Log in

Real-Time Aspects of VR Systems

  • Chapter
  • First Online:
Virtual and Augmented Reality (VR/AR)

Abstract

The term real-time refers to the ability of computer systems to deliver results reliably within a predictable – usually as short as possible – time span. Real-time capability is one of the most difficult requirements for VR systems: users expect a VR system to let them experience the effects of interactions without noticeable delays. This chapter deals with selected topics concerning the real-time capability of VR systems. In the first section, an overall view of VR systems shows which types of latencies occur between user input and system reaction. It also discusses how latencies of the sub-components of VR systems can be estimated or measured. The second section presents common methods for efficient collision detection, such as the use of bounding volumes, which are important in real-time simulation of dynamic virtual worlds. The third section deals with real-time aspects when rendering virtual worlds.

Dedicated website for additional material: vr-ar-book.org

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Abrash M (2012) Latency – the sine qua non of AR and VR. http://blogs.valvesoftware.com/abrash/latency-the-sine-qua-non-of-ar-and-vr/. Archived at https://perma.cc/J29Q-KEQ8. Accessed 6 Feb 2021

  • Adelstein BD, Johnston ER, Ellis SR (1996) Dynamic response of electromagnetic spatial displacement trackers. Presence 5(3):302–318

    Article  Google Scholar 

  • Akenine-Möller T, Haines E, Hoffman N, Pesce A, Iwanicki M, Hillaire S (2018) Real-time rendering, 4th edn. Taylor & Francis

    Book  Google Scholar 

  • Assarsson U, Möller T (2000) Optimized view frustum culling algorithms for bounding boxes. J Gr Tool 5(1):9–22

    Article  Google Scholar 

  • Baraff D (1992) Dynamic simulation of non-penetrating rigid bodies. Dissertation, Cornell University

    Google Scholar 

  • Bauer F, Cheadle SW, Parton A, Muller HJ, Usher M (2009) Gamma flicker triggers attentional selection without awareness. Proc Natl Acad Sci 106(5):1666–1671

    Article  Google Scholar 

  • Bogomjakov A, Gotsman C (2002) Universal rendering sequences for transparent vertex caching of progressive meshes. Comp Gr Forum 21(2):137–149

    Article  Google Scholar 

  • Brooks FP (1999) What’s real about virtual reality? IEEE Comp Gr Appl 19(6):16–27

    Article  Google Scholar 

  • Cameron S (1997) Enhancing GJK: computing minimum and penetration distances between convex polyhedral. Proceedings of International Conference on Robotics and Automation, pp 3112–3117

    Google Scholar 

  • Carmack J (2013) Latency mitigation strategies. #AltDevBlog. Internet Archive: https://web.archive.org/web/20140719085135/http://www.altdev.co/2013/02/22/latency-mitigation-strategies/. Accessed 6 Feb 2021

  • Catto E (2020) Box2d – a 2D physics engine for games. http://box2d.org/. Accessed 6 Feb 2021

  • Dong Y, Peng C (2019) Screen partitioning load balancing for parallel rendering on a multi-GPU multi-display workstation. Eurographics Symposium on Parallel Graphics and Visualization, Eurographics Association

    Google Scholar 

  • Eger Passos D, Jung B (2020) Measuring the accuracy of inside-out tracking in XR devices using a high-precision robotic arm. HCI International 2020 – Posters. HCI International 2020, 22nd International Conference on Human-Computer Interaction, Proceedings, Part I, pp 19–26

    Google Scholar 

  • Ellis SR (1994) What are virtual environments? IEEE Comp Gr Appl 14(1):17–22

    Article  Google Scholar 

  • Ellis SR (2009) Latency and user performance in virtual environments and augmented reality. Distributed Simulation and Real Time Applications, DS-RT 09, p. 69

    Google Scholar 

  • Ericson C (2005) Real-time collision detection. Morgan Kaufmann, San Francisco

    Google Scholar 

  • Evans F (1998) Stripe. http://www.cs.sunysb.edu/~stripe/. Accessed 6 Feb 2021

  • Evans F, Skiena S, Varshney A (1996). Optimizing triangle strips for fast rendering. In: Proceedings of Visualization’96, IEEE, pp 319–326

    Google Scholar 

  • Forsyth T (2006) Linear-speed vertex cache optimisation. https://tomforsyth1000.github.io/papers/ fast_vert_cache_opt.html. Accessed 6 Feb 2021

  • Gilbert EG, Johnson DW, Keerthi SS (1988) A fast procedure for computing the distance between complex objects in three-dimensional space. J Robot Autom 4(2):193–203

    Article  Google Scholar 

  • Gregory J (2009) Game engine architecture. A K Peters, Natick

    Book  Google Scholar 

  • He D, Liu F, Pape D, Dawe G, Sandin D (2000) Video-based measurement of system latency. In: Fourth international immersive projection technology workshop (IPT2000)

    Google Scholar 

  • Hoppe H (1999) Optimization of mesh locality for transparent vertex caching. In: Proceedings of 26th Annual Conference on Computer Graphics and Interactive Techniques, pp 269–276

    Google Scholar 

  • Hübner T, Zhang Y, Pajarola R (2007) Single pass multi view rendering. IADIS Int J Comp Sci Infor Syst 2(2):122–140

    Google Scholar 

  • Jerald J, Whitton M, Brooks FP (2012) Scene-motion thresholds during head yaw for immersive virtual environments. ACM Trans Appl Percept 9(1):1–23

    Article  Google Scholar 

  • Lengyel E (2002) Mathematics for 3D game programming and computer graphics, 2nd edn. Charles River Media, Rockland

    MATH  Google Scholar 

  • Liang J, Shaw C, Green M (1991) On temporal-spatial realism in the virtual reality environment. In: Proceedings of UIST, pp 19–25

    Google Scholar 

  • Lin MC, Canny JF (1991) A fast algorithm for incremental distance calculation. Proc IEEE Int Conf Robot Autom 2:1008–1014

    Google Scholar 

  • Luebke DP, Reddy M, Cohen J, Varshney A, Watson B, Huebner R (2003) Level of detail for 3D graphics. Morgan Kaufmann, San Francisco

    Google Scholar 

  • Meehan M, Razzaque S, Whitton MC, Brooks FP (2003) Effect of latency on presence in stressful virtual environments. In: Proceedings of IEEE Virtual Reality, pp 141–148

    Google Scholar 

  • Mine M (1993) Characterization of end-to-end delays in head-mounted display systems. Technical Report 93–001, University of North Carolina at Chapel Hill

    Google Scholar 

  • NVidia (2004) NvTriStrip library. https://github.com/turbulenz/NvTriStrip. Accessed 6 Feb 2021

  • Reuter P, Behr J, Alexa M (2005) An improved adjacency data structure for fast triangle stripping. J Gr GPU Game Tool 10(2):41–50

    Google Scholar 

  • Rohlf J, Helman J (1994) Iris performer: a high performance multiprocessing toolkit for real-time 3D graphics. In: Proceedings of 21st annual conference on computer graphics and interactive techniques. ACM, pp 381–394

    Google Scholar 

  • Sathe R, Lake A (2006) Rigid body collision detection on the GPU. In: ACM SIGGRAPH 2006 research posters. ACM, New York

    Google Scholar 

  • Skogstad SA, Nymoen K, Høvin M (2011) Comparing inertial and optical MoCap technologies for synthesis control. In: Proceedings of the 8th Sound and Music Computing Conference

    Google Scholar 

  • Steed A (2008) A simple method for estimating the latency of interactive, real-time graphics simulations. Proc VRST:123–129

    Google Scholar 

  • Swindells C, Dill JC, Booth KS (2000) System lag tests for augmented and virtual environments. Proc UIST 00:161–170

    Google Scholar 

  • Weller R (2012) New geometric data structures for collision detection. Dissertation, Universität Bremen. http://nbn-resolving.de/urn:nbn:de:gbv:46-00102857-18. Accessed 11 Aug 2020

  • Welzl E (1991) Smallest enclosing disks (balls and ellipsoids). In: Results and new trends in computer science. Springer, Berlin/Heidelberg, pp 359–370

    Chapter  Google Scholar 

  • Xavier PG (1997) Fast swept-volume distance for robust collision detection. Proc IEEE Int Conf Robot Autom 2:1162–1169

    Article  Google Scholar 

  • You S, Neumann U (2001) Fusion of vision and gyro tracking for robust augmented reality registration. Proceedings of IEEE Virtual Reality, pp 71–78

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute for Informatics, Technical University Bergakademie Freiberg, Freiberg, Germany

    Bernhard Jung

Authors
  1. Mathias Buhr
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thies Pfeiffer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dirk Reiners
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Carolina Cruz-Neira
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Bernhard Jung
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bernhard Jung .

Editor information

Editors and Affiliations

  1. Department of Design, Computer Science, Media, RheinMain University of Applied Sciences, Wiesbaden, Germany

    Ralf Doerner

  2. Department of Computer Science and Automation / Department for Economic Science and Media, Ilmenau University of Technology, Ilmenau, Germany

    Wolfgang Broll

  3. Department of Media, Darmstadt University of Applied Sciences, Darmstadt, Germany

    Paul Grimm

  4. Institute for Informatics, TU Bergakademie Freiberg, Freiberg, Germany

    Bernhard Jung

Recommended Reading

Recommended Reading

  • Jerald JJ (2010) Scene-motion- and latency-perception thresholds for head-mounted displays. Dissertation, UNC, Chapel Hill, http://www.cs.unc.edu/techreports/10-013.pdf. Accessed August 11, 2020 – Jerald’s doctoral thesis deals intensively with the topic of visual latencies in virtual reality and contains an extensive collection of literature on the subject.

  • Ericson C (2004) Real-time collision detection. CRC Press – The book provides a comprehensive and in-depth overview of collision detection methods.

  • Akenine-Möller T, Haines E, Hoffman N, Pesce A (2018) Real-time rendering, 4th edn. CRC Press – Textbook on advanced topics in computer graphics, providing a comprehensive overview of techniques for real-time rendering of 3D worlds.

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Buhr, M., Pfeiffer, T., Reiners, D., Cruz-Neira, C., Jung, B. (2022). Real-Time Aspects of VR Systems. In: Doerner, R., Broll, W., Grimm, P., Jung, B. (eds) Virtual and Augmented Reality (VR/AR). Springer, Cham. https://doi.org/10.1007/978-3-030-79062-2_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-79062-2_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-79061-5

  • Online ISBN: 978-3-030-79062-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation