Skip to main content
Springer Nature Link
Log in

The Value of Constraints for 3D User Interfaces

  • Chapter
  • First Online:
Virtual Realities

Abstract

User interfaces to three-dimensional environments are becoming more and more popular. Today this trend is fuelled through the introduction of social communication via virtual worlds, console and computer games, as well as 3D televisions.

We present a synopsis of the relevant abilities and restrictions introduced by both input and output technologies, as well as an overview of related human capabilities and limitations, including perceptual and cognitive issues.

Partially based on this, we present a set of guidelines for 3D user interfaces. These guidelines are intended for developers of interactive 3D systems, such as computer and console games, 3D modeling packages, augmented reality systems, computer aided design systems, and virtual environments. The guidelines promote techniques, such as using appropriate constraints, that have been shown to work well in these types of environments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Agilent ADNS-3080 Optical Mouse Sensor datasheet, Agilent Technologies, (2005), http://www.alldatasheet.com/datasheet-pdf/pdf/193358/HP/ADNS-3080.html. Cited 13 April 2010.

  2. A.S. Arif, W. Stuerzlinger, Predicting the Cost of Error Correction in Character-Based Text Entry Technologies, In ACM CHI 2010, (April 2010).

    Google Scholar 

  3. R. Arsenault, C. Ware, Frustum View Angle, Observer View Angle and VE Navigation, Proceedings of SVR, (2002).

    Google Scholar 

  4. R. Azuma, A Survey of Augmented Reality. In Presence: Teleoperators and Virtual Environments 6, 4 (August 1997), pp. 355–385.

    Google Scholar 

  5. J. Bakdash, J. Augustyn, D. Proffitt, Large displays enhance spatial knowledge of a virtual environment. In Symposium on Applied Perception in Graphics and Visualization, (2006), pp. 59–62.

    Google Scholar 

  6. F. Bérard, J. Ip, M. Benovoy, D. El-Shimy, J. Blum, J. Cooperstock, Did “Minority Report” Get It Wrong? Superiority of the Mouse over 3D Input Devices in a 3D Placement Task. In Interact 2009, pp. 400–414.

    Google Scholar 

  7. D. Bowman, J. Chen, C. Wingrave, et al., New Directions in 3D User Interfaces, In International Journal of Virtual Reality, 5(2), (2006), pp. 3–14.

    Google Scholar 

  8. D. Bowman, D. Johnson, L. Hodges, Testbed Evaluation of Virtual Environment Interaction Techniques, In Virtual Reality Software and Technology, (1999), pp. 26–33.

    Google Scholar 

  9. D. Bowman, D. Koller, L. Hodges, Travel in Immersive Virtual Environments: An Evaluation of Viewpoint Motion Control Techniques, In VRAIS, (1997), pp. 45–52.

    Google Scholar 

  10. D. Bowman, E. Kruijff, J. LaViola, I. Poupyrev, 3D User Interfaces: Theory and Practice. (Addison-Wesley, Reading, 2005).

    Google Scholar 

  11. D. Bowman, R. McMahan, Virtual Reality: How Much Immersion is Enough?, In IEEE Computer, 40(7), (2007), pp. 36–43.

    Article  Google Scholar 

  12. D. Bowman, C. Wingrave, Design and Evaluation of Menu Systems for Immersive Virtual Environments. In Proceedings of IEEE Virtual Reality, 2001, pp. 149–156.

    Google Scholar 

  13. D. Bowman, C. Wingrave, J. Campbell, V. Ly, Using Pinch Gloves TM for both Natural and Abstract Interaction Techniques in Virtual Environments. In Proceedings of HCI International, 2001, pp. 629–633.

    Google Scholar 

  14. F. Brooks, What’s Real About Virtual Reality?, In IEEE Computer Graphics & Applications, 19(6), (Nov. 1999), pp. 16–27.

    Article  MathSciNet  Google Scholar 

  15. J. Chen, D. Bowman, J. Lucas, C. Wingrave, Interfaces for Cloning in Immersive Virtual Environments, In Eurographics Workshop on Virtual Environments, (2004), pp. 91–98.

    Google Scholar 

  16. A Cockburn, B McKenzie, Evaluating Spatial Memory in Two and Three Dimensions. In International Journal of Human-Computer Studies, 61(30), (2004), pp. 359–373.

    Google Scholar 

  17. C. Cruz-Neira, J. Sandm, T. A. DeFanti, Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE, In Computer Graphics, ACM SIGGRAPH, (August 1993), pp. 135–142.

    Google Scholar 

  18. M. Czerwinski, D. Tan, G. Robertson, Women take a wider view. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Changing Our World, Changing Ourselves, (2002), pp. 195–202.

    Google Scholar 

  19. K. Dave, K. Dinesh, CInDeR: Collision and Interference Detection in Real-time using graphics hardware, In Graphics Interface, (2003), pp. 73–80.

    Google Scholar 

  20. D. Diner, D. Fender, Human Engineering in Stereoscopic Viewing Devices. (Plenum Press, New York, 1993).

    Google Scholar 

  21. Electronic Arts, Spore, http://www.spore.com/, Cited 4 April 2010.

  22. S. Ellis, M. Young, B. Adelstein, S. Ehrlich, Discrimination of Changes of Latency During Voluntary Hand Movement of Virtual Objects, In Human Factors and Ergonomics Society, (1999), pp. 1129–1136.

    Google Scholar 

  23. B. Fröhlich, J. Plate, The cubic mouse: a new device for three-dimensional input, In ACM CHI, (2000), pp. 526–531.

    Google Scholar 

  24. Google, Google SketchUp, http://sketchup.google.com/. Cited 4 April 2010.

  25. N. Govindaraju, S. Redon, M. Lin, D. Manocha, Cullide: Interactive Collision Detection between Complex Models in Large Environments Using Graphics Hardware, In SIGGRAPH Workshop on Graphics Hardware, (2003), pp. 25–32.

    Google Scholar 

  26. T. Grossman, R. Balakrishnan, An evaluation of depth perception on volumetric displays, In AVI, (2006), pp. 193–200.

    Google Scholar 

  27. T. Grossman, D. Wigdor, R. Balakrishnan, Exploring and reducing the effects of orientation on text readability in volumetric displays, In ACM CHI, (2007), pp. 483-492.

    Google Scholar 

  28. K. Herndon, A. Van Dam, M. Gleicher, Workshop on the Challenges of 3D Interaction, In SIGCHI Bulletin, 26(4), (1994), pp. 1–9.

    Google Scholar 

  29. K. Hinckley, R. Paush, J. Goble, N. Kassell, Passive Real-World Interface Props for Neurosurgical Visualization, In CHI, (1994), pp. 452-458.

    Google Scholar 

  30. M. Hoffman, P. Varcholik, J. LaViola, Breaking the Status Quo: Improving 3D Gesture Recognition with Spatially Convenient Input Devices, In Proceedings of IEEE Virtual Reality, (March, 2010), pp. 59–66.

    Google Scholar 

  31. R.J.K. Jacob, A. Girouard, L.M. Hirshfield, M.S. Horn, O. Shaer, E.T. Solovey, J. Zigelbaum, Reality-Based Interaction: A Framework for Post-WIMP Interfaces, In CHI, (2008), pp. 201–210.

    Google Scholar 

  32. A. Jones, I. McDowall, H. Yamada, M. Bolas, P. Debevec, Rendering for an interactive 360 ∘ light field display, In ACM SIGGRAPH, (2007), article no. 40.

    Google Scholar 

  33. Y. Kitamura, F. Kishino, Consolidated Manipulation of Virtual and Real Objects, In VRST, (1997), pp. 133–138.

    Google Scholar 

  34. G. Kessler, L. Hodges, N. Walker, Evaluation of a Whole-Hand Input Device, In ACM Transactions on Computer- Human Interaction, 2(4) (Dec. 1995), pp. 263–283.

    Google Scholar 

  35. A. Kulik, Building on Realism and Magic for Designing 3D Interaction Techniques, In IEEE Computer Graphics & Applications, 29(6), (November/December 2009), pp. 22–33.

    Google Scholar 

  36. K. Larson, M. van Dantzich, M. Czerwinski, G. Robertson, Text in 3D: some legibility results, In ACM CHI Extended Abstracts, (2000), pp. 145–146.

    Google Scholar 

  37. J. LaViola, A Discussion of Cybersickness in Virtual Environments, In SIGCHI Bulletin 32(1), (Jan. 2000), pp. 47–56.

    Google Scholar 

  38. I. S. MacKenzie, C. Ware, Lag as a determinant of human performance in interactive systems, In ACM CHI, (1993), pp. 488–493.

    Google Scholar 

  39. J. Marbach, Image Blending and View Clustering for Multi-Viewer Immersive Projection Environments, In IEEE Virtual Reality, (2009), pp. 51–54.

    Google Scholar 

  40. M. S. Meehan, S. Razzaque, M. Whitton, F. Brooks, Effects of Latency on Presence in Stressful Virtual Environments, In IEEE Virtual Reality, (2003), pp. 141–148.

    Google Scholar 

  41. B. Myers, Why are Human-Computer Interfaces Difficult to Design and Implement?, In Technical Report CMU-CS-93–183, (1993).

    Google Scholar 

  42. T. Ni, G. Schmidt, O. Staadt, M. Livingston, R. Ball, R. May, A survey of large high-resolution display technologies, techniques, and applications, In IEEE Virtual Reality, (2006), pp. 223–236.

    Google Scholar 

  43. J.-Y. Oh, W. Stuerzlinger, Intelligent Manipulation Techniques for Conceptual 3D Design, In Human Computer Interaction: Interact, (2003), pp. 319–326.

    Google Scholar 

  44. J.-Y. Oh, W. Stuerzlinger, Moving Objects with 2D Input Devices in CAD Systems and Desktop Virtual Environments, In Graphics Interface, (2005), pp. 195-202.

    Google Scholar 

  45. J.-Y. Oh, W. Stuerzlinger, J. Danahy, SESAME: Towards Better 3D Conceptual Design Systems, In ACM Designing Interactive Systems, (2006), pp. 80–89.

    Google Scholar 

  46. J.-Y. Oh, W. Stuerzlinger, D. Dadgari, Group Selection Techniques for Efficient 3D Modeling, In IEEE Symposium on 3D User Interfaces, (2006), pp. 95–102.

    Google Scholar 

  47. R. Pausch, T. Burnette, D. Brockway, M. Weiblen, Navigation and locomotion in virtual worlds via flight into hand-held miniatures, In SIGGRAPH, (1995), pp. 399–400.

    Google Scholar 

  48. A. Pavlovych, W. Stuerzlinger, The Tradeoff between Spatial Jitter and Latency in Pointing Tasks, ACM Symposium on Engineering Interactive Computing Systems 2009, 187–196.

    Google Scholar 

  49. C. Phillips, J. Granieri, N. Badler, Automatic viewing control for 3D direct manipulation, In Symposium on Interactive 3D Graphics, (1992), pp. 71–74.

    Google Scholar 

  50. I. Poupyrev, S. Weghorst, M. Billinghurst, T. Ichikawa, Egocentric Object Manipulation in Virtual Environments: Empirical Evaluation of Interaction Techniques, In Siggraph/Eurographics Workshop Graphics Hardware, (1998), pp. 41–52.

    Google Scholar 

  51. R. Raskar, G. Welch, M. Cutts, A. Lake, L. Stesin, H. Fuchs, The office of the future: A unified approach to image-based modeling and spatially immersive displays. In SIGGRAPH, (1998), pp. 179–188.

    Google Scholar 

  52. B. Reeves, A. Lang, E. Y. Kim, D. Tatar, The Effects of Screen Size and Viewer Contents on Attention and Arousal. In Journal of Media Psychology, 1(1), (1999), pp. 49–67.

    Google Scholar 

  53. G. Robles-De-La-Torre, The Importance of the Sense of Touch in Virtual and Real Environments, In Special issue on Haptic User Interfaces for Multimedia Systems, IEEE Multimedia, 13(3), (2006), pp. 24–30.

    Google Scholar 

  54. T. Salzman, S. Stachniak, W. Stuerzlinger, Unconstrained vs. Constrained 3D Scene Manipulation, In Engineering for Human-Computer Interaction, (2001), pp. 207–219.

    Google Scholar 

  55. B. Shneiderman, Why Not Make Interfaces Better than 3D Reality?, In IEEE Computer Graphics and Applications, 23(6), (Nov./Dec. 2003), pp. 12–15.

    Google Scholar 

  56. G. Smith, T. Salzman, W. Stuerzlinger, 3D Scene Manipulation with 2D Devices and Constraints, In Graphics Interface, (2001), pp. 135–142.

    Google Scholar 

  57. A. Steed, Some Useful Abstractions for Re-Usable Virtual Environment Platforms, In IEEE Virtual Reality Workshop for Software Engineering and Architectures for Realtime Interactive Systems, (2008).

    Google Scholar 

  58. P. Strauss, R. Carey, An object-oriented 3D graphics toolkit, In SIGGRAPH, (1992), pp. 341–349.

    Google Scholar 

  59. W. Stuerzlinger, G. Smith, Efficient Manipulation of Object Groups in Virtual Environments, In IEEE VR, (2002), pp. 251–258.

    Google Scholar 

  60. Z. Szalavári, M. Gervautz, The Personal Interaction Panel—a Two-Handed Interface for Augmented Reality, In Computer Graphics Forum, 16(3), (1997), pp. 335–346.

    Article  Google Scholar 

  61. R. Teather, W. Stuerzlinger, Assessing the Effects of Orientation and Device on (Constrained) 3D Movement Techniques, In IEEE Symposium on 3D User Interfaces (2008), pp. 43–50.

    Google Scholar 

  62. R. Teather, A. Pavlovych, W. Stuerzlinger, S. MacKenzie, Effects of tracking technology, latency, and spatial jitter on object movement, In IEEE Symposium on 3D User Interfaces (2009), pp. 43–50.

    Google Scholar 

  63. A. van Dam, Post-WIMP user interfaces. Commun. ACM, 40(2), (Feb. 1997), pp. 63–67.

    Google Scholar 

  64. C. Ware, K. Lowther, Selection Using a One-Eyed Cursor in a Fish Tank VR Environment, In ACM Transactions on Computer-Human Interaction, 4(4), (1997), pp. 309–322.

    Article  Google Scholar 

  65. Z. Wartell, L.F. Hodges, W. Ribarsky, A Geometric Comparison of Algorithms for Fusion Control in Stereoscopic HTDs, In IEEE Trans. Visualization & Computer Graphics, 8(2), (2002), pp.129–143.

    Article  Google Scholar 

  66. B. Watson, The Effects of Variation of System Responsiveness on User Performance in Virtual Environments, Human Factors, 40, (1998), pp. 403–414.

    Article  Google Scholar 

  67. G. Welch, E. Foxlin, Motion Tracking: No Silver Bullet, but a Respectable Arsenal, In IEEE Computer Graphics and Applications, 22(6), (2002), pp. 24–38.

    Article  Google Scholar 

  68. C. Wickens, J. Hollands, Engineering Psychology and Human Performance, 3rd ed., (Prentice-Hall, NJ, 1999).

    Google Scholar 

  69. C. Wingrave, J. LaViola, Reflection on the Design and Implementation of Virtual Environments. In Special Issue of Presence: Teleoperators and Virtual Environments: Reflections on the Design and Implementation of Virtual Environment Systems, 19(2), (2010).

    Google Scholar 

  70. C. Wingrave, B. Williamson, P. Varcholik, J. Rose, A. Miller, E. Charbonneau, J. Bott, J. LaViola, Wii Remote and Beyond: Using Spatially Convenient Devices for 3DUIs. In IEEE Computer Graphics and Applications, 30(2), 2010, pp. 71–85.

    Google Scholar 

Download references

Acknowledgements

Many thanks to the reviewers for the suggestions that helped greatly to refine the structure of this work.

Author information

Authors and Affiliations

  1. York University, Toronto, Canada

    Wolfgang Stuerzlinger

  2. University of Central Florida, Orlando, FL, USA

    Chadwick A. Wingrave

Authors
  1. Wolfgang Stuerzlinger
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chadwick A. Wingrave
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wolfgang Stuerzlinger .

Editor information

Editors and Affiliations

  1. Fak. Informatik, Professur für Graphische, TU Chemnitz, Straße der Nationen 62, Chemnitz, 09107, Germany

    Guido Brunnett

  2. ZIRST, INRIA Rhône-Alpes, avenue de l'Europe 655, St.Ismier, 38334, France

    Sabine Coquillart

  3. Dept. Computer Science, University of North Carolina, Sitterson Hall, Chapel Hill, 27599-3175, North Carolina, USA

    Greg Welch

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag/Wien

About this chapter

Cite this chapter

Stuerzlinger, W., Wingrave, C.A. (2011). The Value of Constraints for 3D User Interfaces. In: Brunnett, G., Coquillart, S., Welch, G. (eds) Virtual Realities. Springer, Vienna. https://doi.org/10.1007/978-3-211-99178-7_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-211-99178-7_11

  • Published:

  • Publisher Name: Springer, Vienna

  • Print ISBN: 978-3-211-99177-0

  • Online ISBN: 978-3-211-99178-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics