skip to main content
10.1145/2336727.2336736acmotherconferencesArticle/Chapter ViewAbstractPublication PagesieConference Proceedingsconference-collections
research-article

Usability attributes in virtual learning environments

Published: 21 July 2012 Publication History

Abstract

The emphasis of many studies investigating Virtual Learning Environments (VLEs), including our own, has been on evaluating whether learning has occurred and in determining what factors might have influenced learning. Participants are typically asked to perform certain tasks and answer many questions about their characteristics, preferences, experiences and what they learnt. But what do participants see as relevant to tell us; perhaps they think we have missed something important? To answer this question, we chose three diverse studies, concerning realism, interactivity and immersion, and analyse the free-text comments to see if any patterns could be found in what users were wanting to tell us. Based on the analysis and literature, we suggest a set of categories and usability attributes to be considered when designing and evaluating VLEs.

References

[1]
Adams, E. (2004) Postmodernism and the Three Types of Immersion. Accessed: 18-2-11. http://www.gamasutra.com/features/20040709/adams_01.shtml.
[2]
Agarwal, R. & Karahana, E. (2000). Time flies when you're having fun: Cognitive Absorption and beliefs about information technology usage. MIS Quarterly, 24 (4), 665--694.
[3]
Banerjee, M. B., Capozzoli, M., McSweeney, L., & Sinha, D. (1999). Beyond Kappa: A Review of Interrater Agreement Measures. The Canadian Journal of Statistics, 27(1), 3--23.
[4]
Bartle, Richard (2003). Designing Virtual Worlds. New Riders.
[5]
Bates, J. (1994) The role of Emotions in Believable Agents, Comm. of the ACM, Spec. Issue on Agents, July 1994, 94--136.
[6]
Bernhaupt, R. (2010). Usability and User Experience Evaluation Methods. In C. Mourlas, & P. Germanakos (Eds.), Mass Customization for Personalized Communication Environments: Integrating Human Factors. Hershey, PA, 232--243.
[7]
Bowman, D. A. Gabbard, J. L. and Deborah Hix (2002) A Survey of Usability Evaluation in Virtual Environments: Classification and Comparison of Methods, Presence: Teleoperators and Virtual Environments, August 2002, Vol. 11, No. 4, 404--424
[8]
Boyatzis, R. E. (1998). Transforming Qualitative Information: Thematic Analysis and Code Development. SAGE
[9]
Brady, L. (2004) The Role of Interactivity in Web-Based Educational Material, http://psychology.wichita.edu/surl/usabilitynews/62/interactivity.htm accessed 18-3-2011
[10]
Cassell, J. and Bickmore, T. (2003). Negotiated Collusion: Modeling Social Language and its Relationship Effects in Intelligent Agents. User Modeling and User-Adapted Interaction 13, 1--2 (Feb. 2003), 89--132.
[11]
Cox, A. L., Cairns, P. A., Berthouze, N & Jennett, C. (2006). The Use of Eyetracking for Measuring Immersion. CogSci 2006.
[12]
Csikszentmihalyi, M. (1990). Flow: The Psychology of Optimal Experience. New York: Harper and Row.
[13]
Csikszentmihalyi, M. and Csikszentmihalyi, I. (1988). Optimal Experience: Psychological Studies of Flow in Consciousness, Cambridge: Cambridge University Press.
[14]
Easterby, R. S. (1970). The perception of symbols for machine displays. Ergonomics, 13:149--58.
[15]
Fassbender, E. and Richards, D. (2008) Using a Dance Pad to navigate through the Virtual Heritage environment of Macquarie Lighthouse, Sydney, Virtual Systems and Multimedia, LNCS Vol 4820/2008, 1--12.
[16]
Harp, S. F., & Mayer, R. E. (1997). The role of interest in learning from scientific text and illustrations: on the distinction between emotional interest and cognitive interest. Journal of Educational Psychology, 89(1), 92--102.
[17]
Harp, S. F., & Mayer, R. E. (1998). How seductive details do their damage: a theory of cognitive interest in science learning. Journal of Educational Psychology, 90(3), 414--434.
[18]
Iowa Department of Transportation. (2007). Evaluation of Virtual Reality Snowplow Simulator Training: Final Report, IOWA State Uni and IOWA Dept of Transport accessed 18-3-11 www.ctre.iastate.edu/reports/snowplow_simulator_final.pdf
[19]
Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., Walton, A. (2008). Measuring and Defining the Experience of Immersion in Games. Int. Journal of Human Computer Studies, 66(9), 641--661.
[20]
Johnson, W. L., and Rickel, J. W. (2000). Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments. Int. Jrnl of AI in Education 11: 47--78.
[21]
Kartiko, I., Kavakli, M. and Cheng, K.(2010).Learning science in a virtual reality application:The impacts of animated-virtual actors' visual complexity, Computers & Educ. 55(2):881--891.
[22]
Kavakli, M.; Szilas, N.; Porte, J. & Kartiko, I. (2007). RiskMan: A Multi-Agent System for Risk Management. In Lin, H. (Ed.), Architectural Design of Multi-Agent Systems: Technologies and Techniques (pp. 356--376). Information Science Reference.
[23]
Kennedy, R. S., Lane, N. E. Berbaum, K. S. and Lilienthal, M. G. (1993). Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. International Journal of Aviation Psychology, 3(3):203--220.
[24]
Lin, J. J.-W.; Duh, H. B.; Parker, D. E.; Abi-Rached, H. & Furness, T. A. (2002) Effects of Field of View on Presence, Enjoyment, Memory, and Simulator Sickness in a Virtual Environment In Proc. IEEE Virtual Reality Conference 2002 (VR '02). IEEE Computer Society, Washington, DC, USA, 164.
[25]
Loyall, B. (1997). Believable Agents. Ph.D. Thesis, Tech. Report CMU-CS-97-123, Carnegie Mellon Uni.
[26]
Maciaszek L. A (2007) Requirements Analysis and System Design, 3 ed. Addison Wesley.
[27]
Marsella, S., W. L. Johnson, and C. M. LaBore, (2000). Interactive Pedagogical Drama. In Proceedings of the 4th International Conference on Autonomous Agents, Agents' 2000.
[28]
Mayer, R. E. (2003). The promise of multimedia learning: using the same instructional design methods across different media. Learning and Instruction, 13(2), 125--139.
[29]
Moreno, R. (2007). Optimising learning from animations by minimising cognitive load: cognitive and affective consequences of signalling and segmentation methods. Applied Cognitive Psychology, 21(6), 765--781.
[30]
Nielson, J. (1993). Usability Engineering. Morgan Kaufmann, San Francisco, 1993.
[31]
Pressman, R. S. (2010). Software Engineering: A Practitioner's Approach, 7/e, Pressman & Associates, Inc.
[32]
Richards, D. (2006) Is Interactivity Actually Important? Proc.3rd Aust. Conf. on Interactive Entertainment (IE'2006), 4--6 Dec. 2006, Perth, 59--66.
[33]
Richards, D. and Barles, J. (2005). Actors vs. Animation for Adult Learning? Interactive Entertainment, IE'2005, Sydney Nov. 23--25, 2005.
[34]
Richards, D., Dras, M., Porte, J. and Taylor, M. (2009). The Role, Measurement and Delivery of Immersion in Training Environments, Proceedings SimTecT 2009 Simulation Conference: Simulation - Concepts, Capability and Technology (SimTecT 2009), Adelaide, Australia, 15--18 June, 2009.
[35]
Richards, D. and Porte, J. (2009). Developing an Agent-Based Training Simulation using Game and Virtual Reality Software: Experience Report in Proc. 6th Australasian Conf. on Interactive Entertainment (IE'2009), 17--19 December 2009, Sydney, Australia 2009.
[36]
Richards, D. and Taylor, M. (2011). Scenario Authoring by Domain Trainers, Chapter 11 in Multi-Agent Systems for Education and Interactive Entertainment: Design, Use and Experience. IGI Global Inc. 206--232.
[37]
Richards, D., Taylor, M and Porte, J. (2009). Practically intelligent agents aiding human intelligence In Proc. 8th Autonomous Agents and Multi Agent Systems, (AAMAS'09) May 10--15, Budapest, Hungary, Vol2: 161--2.
[38]
Russell, J. A., & Pratt, G. (1980). A description of the affective quality attributed to environments. Journal of Personality and Social Psychology, 38(2), 311--322.
[39]
Sherman, W. R., & Craig, A. B. (2003). Understanding Virtual Reality: Interface, Application, and Design. San Francisco: Elsevier Science.
[40]
Shneiderman, B., & Plaisant, C. (2005). Designing the User Interface. Boston: Pearson.
[41]
Slater, M and Garau, M (2007) The Use of Questionnaire Data in Presence Studies: Do Not Seriously Likert Presence: Teleoper. Virtual Environ. 16: 4. 447--456.
[42]
Slater, M., Linakis, V., Usoh, M. & Kooper, R. (1996). Immersion, presence, and performance in virtual environments: An experiment using tri-dimensional chess. In Proc. 1996 VR and Software and Technology Conference, Hong Kong.
[43]
Sperring, S. and Strandvall, T, (2006). The experience of entertainment in an interactive television show, 4th Int.l Conf. on Comm. & Mass Media, May 22--24, 2006, Athens, Greece.
[44]
Tijs, T. J. W. (2006). Immersion in Games: An Eyetracking Study. Master's thesis. Department of Computer and Systems Science, Royal Institute of Technology, Stockholm.
[45]
Wilson, S, (1994). Aesthetics and Practice of Designing Interactive Computer Events. SIGGRAPH94 Visual Proc. ACM, Chicago, 1994. accessed 18-3-11 http://userwww.sfsu.edu/~swilson/papers/interactive2.html
[46]
Witmer, B. G.&M.J. Singer (1998). Measuring presence in virtual environments:A presence questionnaire. Presence7:225--240.
[47]
Yang, K., Marsh, T. & Shahabi, C. (2005). Continuous archival and analysis of user data in virtual and immersive game environments. Proc. 2nd ACM workshop on Continuous archival and retrieval of personal experiences, Singapore. pp. 13--22.
[48]
Van Vugt, H.; Konijn, E.; Hoorn, J.; Keur, I. & Eliens, A. (2007). Realism is not all! User engagement with task-related interface characters. Interacting with Computers, HCI Issues in Computer Games 19, 267--280.

Cited By

View all
  • (2022)The Effect of List-Liner-Based Interaction Technique in a 3D Interactive Virtual Biological Learning EnvironmentResearch Anthology on Virtual Environments and Building the Metaverse10.4018/978-1-6684-7597-3.ch032(653-674)Online publication date: 21-Oct-2022
  • (2022)Interactive Laboratories for Science Education: A Subjective Study and Systematic Literature ReviewMultimodal Technologies and Interaction10.3390/mti61000856:10(85)Online publication date: 21-Sep-2022
  • (2020)The Effect of List-Liner-Based Interaction Technique in a 3D Interactive Virtual Biological Learning EnvironmentMobile Devices and Smart Gadgets in Medical Sciences10.4018/978-1-7998-2521-0.ch014(297-317)Online publication date: 21-Feb-2020

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
IE '12: Proceedings of The 8th Australasian Conference on Interactive Entertainment: Playing the System
July 2012
182 pages
ISBN:9781450314107
DOI:10.1145/2336727
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • Auckland University of Technology
  • University of Technology, Sydney: University of Technology, Sydney

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 July 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. education
  2. usability attributes
  3. virtual worlds

Qualifiers

  • Research-article

Funding Sources

Conference

IE '12
Sponsor:
  • University of Technology, Sydney

Acceptance Rates

Overall Acceptance Rate 64 of 148 submissions, 43%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)15
  • Downloads (Last 6 weeks)1
Reflects downloads up to 25 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)The Effect of List-Liner-Based Interaction Technique in a 3D Interactive Virtual Biological Learning EnvironmentResearch Anthology on Virtual Environments and Building the Metaverse10.4018/978-1-6684-7597-3.ch032(653-674)Online publication date: 21-Oct-2022
  • (2022)Interactive Laboratories for Science Education: A Subjective Study and Systematic Literature ReviewMultimodal Technologies and Interaction10.3390/mti61000856:10(85)Online publication date: 21-Sep-2022
  • (2020)The Effect of List-Liner-Based Interaction Technique in a 3D Interactive Virtual Biological Learning EnvironmentMobile Devices and Smart Gadgets in Medical Sciences10.4018/978-1-7998-2521-0.ch014(297-317)Online publication date: 21-Feb-2020
  • (2013)Interactivity and Animation Effects towards Student Enhancement of Learning in WAN ProtocolsThird International Visual Informatics Conference on Advances in Visual Informatics - Volume 823710.1007/978-3-319-02958-0_40(435-446)Online publication date: 13-Nov-2013

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media