Skip to main content
Log in

The design-by-adaptation approach to universal access: learning from videogame technology

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

This paper proposes an alternative approach to the design of universally accessible interfaces to that provided by formal design frameworks applied ab initio to the development of new software. This approach, design-by-adaptation, involves the transfer of interface technology and/or design principles from one application domain to another, in situations where the recipient domain is similar to the host domain in terms of modelled systems, tasks and users. Using the example of interaction in 3D virtual environments, the paper explores how principles underlying the design of videogame interfaces may be applied to a broad family of visualization and analysis software which handles geographical data (virtual geographic environments, or VGEs). One of the motivations behind the current study is that VGE technology lags some way behind videogame technology in the modelling of 3D environments, and has a less-developed track record in providing the variety of interaction methods needed to undertake varied tasks in 3D virtual worlds by users with varied levels of experience. The current analysis extracted a set of interaction principles from videogames which were used to devise a set of 3D task interfaces that have been implemented in a prototype VGE for formal evaluation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Notes

  1. Considering the hand’s position, sampled over the last 5 s at a rate of 10 Hz, to be sufficient to determine the current state of the system, then 50 input values need to be considered, and hence 50 DOF.

  2. Metaphoric entailments are the implications of the signifier—i.e., the metaphor—about the signified—i.e., the interface.

References

  1. Andrienko, N., Andrienko, G.: Informed spatial decisions through coordinated views. Inf. Vis. 2, 270–285 (2003)

    Article  Google Scholar 

  2. Angus, I.G., Sowizral, H.A.: Embedding the 2D interaction metaphor in a real 3D virtual environment. In: Fisher S.S., Merritt, J.O., Bolas M.T. (eds.) Proceedings SPIE, vol. 2409, pp. 282–293. Stereoscopic Displays and Virtual Reality Systems II (1995)

  3. Bandelloni, R., Berti, S., Paternò, F.: Analysing trans-modal interface migrations. In: Proceedings INTERACT ‘05, Roma, Lecture Notes in Computer Science, 3585, pp. 1071–1074. Springer, Berlin (2005)

  4. Banks, R., Wickens, C.D.: Commanders’ display of terrain information: manipulations of display dimensionality and frame of reference to support battlefield visualization, Technical Report ARL-97-12/FED-LAB-97-2, US Army Research Laboratory, Aberdeen, MD (1997)

  5. Barr, P., Biddle, R.: A taxonomy of user-interface metaphors. In: Jones, Masoodian (eds.) Proceedings of the SIGCHI-NZ Symposium on Computer–Human Interaction (2002)

  6. Barr, P., Khaled, R., Noble, J., Biddle, RA.: Taxonomic analysis of user-interface metaphors in the Microsoft Office Gallery project. Proceedings of the 6th Australian User Interface Conference (AUIC2005), pp. 109–117 (2005)

  7. Bolt, N., Tulathimutte, T.: Researching videogames the UX way. http://www.boxesandarrows.com/view/research-video. (2009). Accessed 12 Aug 2009

  8. Bowman, D.A.: Interaction techniques for common tasks in immersive virtual environments. Doctoral Thesis, Georgia Institute of Technology (1999)

  9. Bowman, D.A., Kruijff, E., LaViola, J.J., Poupyrey, I.: 3D User Interfaces: Theory and Practice. Addison-Wesley Professional (2004)

  10. Burigat, S., Chittaro, L.: Navigation in 3D virtual environments: effects of user experience and location-pointing navigation aids. Int Human–Computer Studies 6 5, 945–958 (2007)

    Article  Google Scholar 

  11. Butz, A., Krűger, A.: A generalized peephole metaphor for augmented reality and instrumental environments. In: Proceedings of the International Workshop on Software Technology for Augmented Reality Systems (STARS) (2003)

  12. Calomeni, A., Celes, W.: Assisted and automatic navigation in black oil reservoir models based on probabilistic roadmaps, Proceedings of the 2006 Symposium on Interactive 3D Graphics and Games, pp. 175–182 (2006)

  13. Card, S.K., Mackinlay, J.D., Robertson, G.G.: The design space of input devices. In: Proceedings CHI ‘90, pp. 117–124. ACM Press, New York (1990)

  14. Carroll, J.M., Mack, R.L., Kellogg, W.A.: Interface metaphors and user interface design. In: Helander, M. (ed.) Handbook of Human-computer interaction, pp. 67–85. Elsevier Science Publishers, North-Holland (1988)

    Google Scholar 

  15. Chittaro, L., Ranon, R. Ieronutti, L. Guiding visitors of Web3D worlds through automatically generated tours. In: Proceedings of Web3D 2003, pp. 27–38. ACM Press, New York (2003)

  16. Clanton, C.: Lessons from game design. In: Bergman, E. (ed.) Information Appliances and beyond: interaction design for consumer products. Morgan Kaufman Publishers, San Fransisco, CA (2000)

    Google Scholar 

  17. Clarke-Wilson, S. Applying game design to virtual environments. In: Dodsworth C (ed.) Digital illusions: entertaining the future with high technology. Addison Wesley, Reading, MA, pp. 229–239 (1998)

  18. Darken, R.P., Sibert, J.L.: Wayfinding strategies and behaviours in large virtual worlds. In: Proceedings VHI ’96. ACM Press, New York, pp. 142–149 1996

  19. Dourish, P.: Where the action is: the foundations of embodied interaction. MIT Press, Cambridge MA (2001)

    Google Scholar 

  20. Erickson, T.D.: Working with interface metaphors. In: Laurel, B. (ed.) The Art of Human–Computer Interface Design, pp. 65–73. Addison Wesley, Reading (1990)

  21. Franck, A.U.: The use of geographical information systems: the user interface is the system. In: Medyckyj-Scott, D., Hearnshaw, H. (eds.) Human Factors in Geographical Information Systems, pp. 3–14. Belhaven Press, London (1993)

    Google Scholar 

  22. Fröhlich, B., Barrass, S., Zehner, B, Plate, J. Göbel, M.: Exploring geo-scientific data in virtual environments, In: IEEE Visualization, Proceedings of the Conference on Visualization ‘99: celebrating 10 years, pp. 169–173. IEEE Computer Society Press, Los Alamos, CA (1999)

  23. Galyean, T.A.: Guided navigation of virtual environments. In: Symposium on Interactive 3D Graphics, Proceedings of the 1995 Symposium on Interactive 3D Graphics, pp. 103–104, 210 (1995)

  24. Guo, D., Chen, J., MacEachren, A.M.: A visualization system for space-time and multivariate patterns (VIS-STAMP). IEEE Trans. Vis. Comput. Graphics 12(6), 1461–1474 (2006)

    Article  Google Scholar 

  25. Guy, B., Bidwell, N.J. Musumeci, P.: GamePlan: serious gaming for place making. In: Proceedings of the Second Australian Conference on Interactive Entertainment, pp. 252–255 (2005)

  26. Hacklay, M.E.: Virtual reality and GIS. In: Fisher, P., Unwin, D.J. (eds.) Virtual Reality in Geography, pp. 47–57. Taylor & Francis, London (2002)

    Google Scholar 

  27. Haik, E., Barker, T., Sapsford, J., Trainis, S.: Investigation into effective navigation in desktop virtual interfaces, 3D Technologies for the World Wide Web. In: Proceedings of the seventh International Conference on 3D Web Technology, ACM Press, New York, pp. 59–66 (2002)

  28. Hanson, A., Wernert, E.: Constrained 3D navigation with 2D controllers. In: IEEE Visualization, pp. 175–182 (1997)

  29. Harris, D., Harris, F.J.: Evaluating the transfer of technology between application domains: a critical evaluation of the human component in the system. Technol. Soc. 26, 551–565 (2004)

    Article  Google Scholar 

  30. Hassenzahl, M., Tractinsky, N.: User experience—a research agenda. Behav. Inform. Technol. 25(2), 91–97 (2006)

    Article  Google Scholar 

  31. Hughes, S.B. Coordination strategies for assisted viewpoint interaction. In: Proceedings of the 2006 IEEE Symposium on 3D User Interfaces (3DUI’06), pp. 17–24 (2006)

  32. Jacko, J.A., Hanson, V.L.: Universal access and inclusion in design. Univ. Access Inf. Soc. 2, 1–2 (2002)

    Article  Google Scholar 

  33. Jacko, J.A., Vitense, H.S.: A review and reappraisal of information technologies within a conceptual framework for individuals with disabilities. Univ. Access Inf. Soc. 1, 56–76 (2001)

    Google Scholar 

  34. Jennett, C., Cox, A.L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., Walton, A.: Measuring and defining the experience of immersion in games. Int. J. Hum. Comput. Stud. 66, 641–661 (2008)

    Article  Google Scholar 

  35. Joiner, D.: Real interactivity in interactive entertainment. In: Dodsworth, C. (ed.) Digital Illusion: entertaining the future with high technology, pp. 151–159. ACM Press, New York (1998)

    Google Scholar 

  36. Keesing, R.M.: Conventional metaphors and anthropological metaphysics: the problematic of cultural translation. J. Anthropol. Res. 41(2), 201–217 (1985)

    Google Scholar 

  37. Kitamura, Y, Ogata, S., Kishino, F.: A manipulation environment of virtual and real objects using a magnetic metaphor. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology (2002)

  38. Kruger, W., Bohn, C.-A., Froblich, B., Schuth, H., Strauss, W., Wesche, G.: The responsive workbench: a virtual work environment. Computer 28(7), 42–48 (1995)

    Article  Google Scholar 

  39. Kuhn, W.: Various perspectives on interface metaphors. In: Proceedings of the Fourth European Conference and Exhibition on GIS, EGIS ‘93, pp. 456–463. Genoa, Italy (1993a)

  40. Kuhn, W.: Metaphors create theories for users. In: Franck, A.U., Campari, I. (eds.) Lecture Notes in Computer Science, 716, pp. 366–376 (1993b)

  41. Leclerc, Y.G., Reddy, M., Iverson, L., Bletter, N.: Digital Earth: building the new world. http://www.ai.sri.com/~reddy/pubs/vsmm99/ (1999). Accessed 19 Nov 2007

  42. Lewis, M., Jacobson, J.: Game engines in scientific research. Commun. ACM 45(1), 31 (2002)

    Article  Google Scholar 

  43. Li, T.-Y., Ting, H.-K.: An intelligent user interface with motion planning for 3D navigation. In: Proceedings of the IEEE VR 2000 Conference, pp. 177–184 (2000)

  44. Manninen, T.: Interaction manifestations in multi-player games. In: Riva, G., Davide, F., Ijsselsteijn, W.A. (eds.) Being There: concepts. effects and measurement in synthetic environments, pp. 295–304. Ios Press, Amsterdam (2003)

    Google Scholar 

  45. Manninen, T.: Rich interaction model for game and virtual environment design. Dissertation, Department of Information Processing Science, University of Oulu, Finland. http://www.herkules.oulu.fi/isbn9514272544/isbn9514272544.pdf (2004). Accessed 10 Nov 2007

  46. Mark, D.M.: Spatial metaphors for human-computer interaction. In: Proceedings of the Fifth International Conference on Spatial Data Handling, Charleston, vol. 1, pp. 104–112 (1992)

  47. Marsh, S.L., Dykes, J., Attilakou, F.: Evaluating a visualization prototype with two approaches: remote instructional vs. face-to-face exploratory. In: Proceedings of Information Visualization (IV ‘06) (2006)

  48. Masliah, M.R., Milgram, P.: Measuring the allocation of control in a 6-degree-of-freedom docking experiment, CHI 2000 Papers, pp. 25–32 (2000)

  49. McCormick, E.P., Wickens, C.D., Banks, R., Yeh, M.: Frame of reference effects on scientific visualization subtasks. Hum. Factors 40(3), 443–451 (1998)

    Article  Google Scholar 

  50. Meyer, M.: ALCOVE: design and implementation of an object-centric virtual environment. Master of Science Thesis, Passadena, California Institute of Technology, CA (2000)

  51. MicroImages.: Floating North Arrow in 3D simulation. http://www.microimages.com/documentation/cplates/62NorthArrow.pdf (2006). Accessed 21 Aug 2009

  52. Miesenberger, K., Searle, G., Ossmann, R., Archambault, D., Holzinger, A.: More Than Just a Game: Accessibility in Computer Games, In: Human-Computer Interaction and Usability for Education and Work. pp. 247–260 (2008). https://online.tu-graz.ac.at/tug_online/voe_main2.getVollText?pDocumentNr=95371&pCurrPk=40168

  53. Milgram, P., Colquhoun, H.W.: A framework for relating head-mounted displays to mixed reality displays. In: Proceedings of the Human Ergonomics Society 43rd Annual Meeting, pp. 1177–1181 (1999a)

  54. Milgram, P., Colquhoun, H.: A taxonomy of real and virtual world display integration. In: Tamura, Y. O. a.H. (ed.) Mixed Reality—Merging Real and Virtual Worlds, pp. 1–16. Springer, New York (1999b)

  55. Miliano, V.: Unrealty: application of a 3D game engine to enhance the design, visualization and presentation of commercial real estate, VSMM99 (1999)

  56. Monmonier, M.: Graphic narratives for analysing environmental risk. In: Monmonier, M., McEachren, A.M. (eds.) Visualization in Modern Cartography. Pergamon Press, London (1994)

  57. Olive, J., Thouvenin, I., Lenne, D.: A new knowledge visualization and manipulation metaphor for collaborative and immersive environment, In: Proceedings of ENACTIVEOS, 2nd International Conference on Enactive Interfaces, Genoa, Italy (2005)

  58. Pagulayan, R.J., Keeker, K., Wixon, D., Romero, R.L., Fuller, T.: User-centred design in games. In: Jacko, J.A., Sears, A. (eds.) The Human–Computer Interaction Handbook: Fundamentals, evolving technologies and emerging applications, pp. 883–906. Lawrence Erlbaum Associates, Publishers, London (2003)

  59. Paternò, F., Santoro, C., Scorcia, A.: Evaluating migratory user interfaces. In: Law, E.L-C., Bevan, N., Christou, G., Springett, M., Lárusdóttir, M. (eds.) Proceedings of the International Workshop on Meaningful Measures: Valid Useful User Experience Measurement (VUUM), pp. 79–85, June 18, Reykyavik, Iceland (2008)

  60. Plumlee, M., Ware, C.: An evaluation of methods for linking 3D views. In: Proceedings ACM SIGGRAPH 2003, Symposium on Interactive 3D Graphics, pp. 193–201, ACM Press, New York (2003)

  61. Powell, A.: Composite metaphor, games and interface. In: Proceedings of the Second Australasian Conference on Interactive Entertainment, Sydney, Australia, pp. 159–162 (2005)

  62. Raybourn, E.M., Bos, N.: Design and evaluation challenges of serious games. In: Proceedings CHI ‘05, pp. 2049–2050. ACM Press, New York (2005)

  63. Rhyne, T.-M.: Computer games and scientific visualization. Commun. ACM 45(7), 40–44 (2002)

    Article  Google Scholar 

  64. Savidis, A., Stephanidis, C.: Unified user interface development: the software engineering of universally accessible interactions. Univ Access Inf Soc 3, 165–193 (2004)

    Article  Google Scholar 

  65. Sayers, H.M.: Desktop virtual environments: a study of navigation and age. Interact Comput 16, 939–956 (2004)

    Article  Google Scholar 

  66. Sayers, H.M., Wilson, S., McNeil, M.D.J.: Navigational tools for desktop virtual environment interfaces. Virtual Real 7(3–4), 131–139 (2004)

    Google Scholar 

  67. Schmitz, M., Baus, J., Schmidt, S.: Towards anthropomorphized objects: a novel interaction metaphor for instrumented spaces (2006). http://www.w5.cs.uni-sb.de/publication/file/184/AnthropomorphizedObjects_CRV.pdf. Accessed 10 Nov 2007

  68. Schneiderman, B., Maes, P.: Direct manipulation vs. interface agents. Interactions 4(6), 42–61 (1997)

    Article  Google Scholar 

  69. Shepherd, I.D.H.: Key skills: teaching and learning for transfer. Geography Discipline Network, DfEE, London, Cheltenham (2000)

  70. Shepherd, I.D.H.: It’s only a game: using interactive graphics middleware to visualise historical data. Soc. Cartographers Bull. 36(2), 51–55 (2002)

    Google Scholar 

  71. Shepherd, I.D.H.: Travails in the third dimension: a critical evaluation of three-dimensional geographical visualization’. In: Dodge, M., McDerby, M., Turner, M. (eds.) Geographic Visualization: Concepts, Tools and Applications, Chapter 10, pp. 199–222. Wiley, New York (2008)

  72. Shepherd, I.D.H.: From Geography Department to Business School: strategies for transplanting GIS courses between disciplines. J Geograph. Higher Educ. 33(Suppl.), 1–18 (2009)

    Google Scholar 

  73. Shepherd, I.D.H., Bleasdale-Shepherd, I.D.: Videogames: the new GIS? In: Lin, H., Batty, M. (eds.) Virtual Geographic Environments, Chapter 22, pp. 311–344. Science Press (2009a)

  74. Shepherd, I.D.H., Bleasdale-Shepherd, I.D.: ‘Experiential Engagement with VGEs: What can we learn from videogames? In: Proceedings of the ISDE 6th International Symposium on Digital Earth, Beijing (2009b)

  75. Steinicke, F., Ropinski, T., Hinrichs, K.: Multimodal interaction metaphors for manipulation of distant objects in immersive virtual environments. In: WSCG2005, the 13th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (2005)

  76. Stoakley, R., Conway, M., Pausch, R.: Virtual reality on a WIM: interactive worlds in miniature. In: Proceedings of CHI 95, pp. 265–272. ACM Press, New York (1995)

  77. Thomas, L.C., Wickens, C.D., Merlo, J.: Immersion and battlefield visualization: frame of reference effects on navigation tasks and cognitive tunnelling, Technical Report ARL-99-3/FED-LAB-99-2, US Army Research Laboratory, Aberdeen, MD (1999)

  78. Tory, M., Kirkpatrick, A.E., Atkins, S., Möller, T.: Visualization task performance with 2D, 3D, and combination displays. IEEE Trans. Vis. Comput. Graphs 12(1), 2–13 (2006)

    Article  Google Scholar 

  79. Treinish, L.: Task-specific visualization design: a case study in operational weather forecasting. In: IEEE Visualization, Proceedings of the Conference on Visualization ‘98, pp. 405–408 (1998)

  80. van Dam, A.: Post-WIMP user interfaces. Commun. ACM 40(2), 63–67 (1997)

    Article  MathSciNet  Google Scholar 

  81. Ware, C., Osborne, S.: Exploration and virtual camera control in virtual three dimensional environments. Comput. Graph. 24(2), 175–183 (1990)

    Article  Google Scholar 

  82. Wickens, C.D.: Frame of Reference for Navigation. In: Gopher, D., Koriat, A. (eds.) Attention and Performance, vol. 16, pp. 113–143. Academic Press, Orlando, FL (1999)

    Google Scholar 

  83. Woods, S.: Loading the dice: the challenge of serious videogames, Game Studies: The International Journal of Videogame Research, 4(1). http://www.gamestudies.org/0401/woods/ (2004). Accessed 19 Nov 2007

  84. Dickey, M.D.: Game design narrative for learning: appropriating adventure game design narrative devices and techniques for the design of interactive learning environments. Educ. Tech. Res. Dev. 54(3), 245–263 (2006)

    Article  Google Scholar 

Download references

Acknowledgments

We wish to thank conference participants who provided comments on an original version of this paper, which was presented at the International Conference on Virtual Geographic Environments, held at the Chinese University of Hong Kong, January 2008, and also to three anonymous referees for their incisive and helpful comments on the journal version of the paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ifan D. H. Shepherd.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Shepherd, I.D.H., Bleasdale-Shepherd, I.D. The design-by-adaptation approach to universal access: learning from videogame technology. Univ Access Inf Soc 10, 319–336 (2011). https://doi.org/10.1007/s10209-010-0204-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-010-0204-x

Keywords

Navigation