research-article

Usability attributes in virtual learning environments

Authors:

Deborah Richards,

Iwan KelaiahAuthors Info & Claims

IE '12: Proceedings of The 8th Australasian Conference on Interactive Entertainment: Playing the System

Article No.: 9, Pages 1 - 10

https://doi.org/10.1145/2336727.2336736

Published: 21 July 2012 Publication History

Abstract

The emphasis of many studies investigating Virtual Learning Environments (VLEs), including our own, has been on evaluating whether learning has occurred and in determining what factors might have influenced learning. Participants are typically asked to perform certain tasks and answer many questions about their characteristics, preferences, experiences and what they learnt. But what do participants see as relevant to tell us; perhaps they think we have missed something important? To answer this question, we chose three diverse studies, concerning realism, interactivity and immersion, and analyse the free-text comments to see if any patterns could be found in what users were wanting to tell us. Based on the analysis and literature, we suggest a set of categories and usability attributes to be considered when designing and evaluating VLEs.

References

[1]

Adams, E. (2004) Postmodernism and the Three Types of Immersion. Accessed: 18-2-11. http://www.gamasutra.com/features/20040709/adams_01.shtml.

[2]

Agarwal, R. & Karahana, E. (2000). Time flies when you're having fun: Cognitive Absorption and beliefs about information technology usage. MIS Quarterly, 24 (4), 665--694.

Digital Library

[3]

Banerjee, M. B., Capozzoli, M., McSweeney, L., & Sinha, D. (1999). Beyond Kappa: A Review of Interrater Agreement Measures. The Canadian Journal of Statistics, 27(1), 3--23.

[4]

Bartle, Richard (2003). Designing Virtual Worlds. New Riders.

Digital Library

[5]

Bates, J. (1994) The role of Emotions in Believable Agents, Comm. of the ACM, Spec. Issue on Agents, July 1994, 94--136.

Digital Library

[6]

Bernhaupt, R. (2010). Usability and User Experience Evaluation Methods. In C. Mourlas, & P. Germanakos (Eds.), Mass Customization for Personalized Communication Environments: Integrating Human Factors. Hershey, PA, 232--243.

[7]

Bowman, D. A. Gabbard, J. L. and Deborah Hix (2002) A Survey of Usability Evaluation in Virtual Environments: Classification and Comparison of Methods, Presence: Teleoperators and Virtual Environments, August 2002, Vol. 11, No. 4, 404--424

Digital Library

[8]

Boyatzis, R. E. (1998). Transforming Qualitative Information: Thematic Analysis and Code Development. SAGE

[9]

Brady, L. (2004) The Role of Interactivity in Web-Based Educational Material, http://psychology.wichita.edu/surl/usabilitynews/62/interactivity.htm accessed 18-3-2011

[10]

Cassell, J. and Bickmore, T. (2003). Negotiated Collusion: Modeling Social Language and its Relationship Effects in Intelligent Agents. User Modeling and User-Adapted Interaction 13, 1--2 (Feb. 2003), 89--132.

Digital Library

[11]

Cox, A. L., Cairns, P. A., Berthouze, N & Jennett, C. (2006). The Use of Eyetracking for Measuring Immersion. CogSci 2006.

[12]

Csikszentmihalyi, M. (1990). Flow: The Psychology of Optimal Experience. New York: Harper and Row.

[13]

Csikszentmihalyi, M. and Csikszentmihalyi, I. (1988). Optimal Experience: Psychological Studies of Flow in Consciousness, Cambridge: Cambridge University Press.

[14]

Easterby, R. S. (1970). The perception of symbols for machine displays. Ergonomics, 13:149--58.

[15]

Fassbender, E. and Richards, D. (2008) Using a Dance Pad to navigate through the Virtual Heritage environment of Macquarie Lighthouse, Sydney, Virtual Systems and Multimedia, LNCS Vol 4820/2008, 1--12.

Digital Library

[16]

Harp, S. F., & Mayer, R. E. (1997). The role of interest in learning from scientific text and illustrations: on the distinction between emotional interest and cognitive interest. Journal of Educational Psychology, 89(1), 92--102.

[17]

Harp, S. F., & Mayer, R. E. (1998). How seductive details do their damage: a theory of cognitive interest in science learning. Journal of Educational Psychology, 90(3), 414--434.

[18]

Iowa Department of Transportation. (2007). Evaluation of Virtual Reality Snowplow Simulator Training: Final Report, IOWA State Uni and IOWA Dept of Transport accessed 18-3-11 www.ctre.iastate.edu/reports/snowplow_simulator_final.pdf

[19]

Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., Walton, A. (2008). Measuring and Defining the Experience of Immersion in Games. Int. Journal of Human Computer Studies, 66(9), 641--661.

Digital Library

[20]

Johnson, W. L., and Rickel, J. W. (2000). Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments. Int. Jrnl of AI in Education 11: 47--78.

[21]

Kartiko, I., Kavakli, M. and Cheng, K.(2010).Learning science in a virtual reality application:The impacts of animated-virtual actors' visual complexity, Computers & Educ. 55(2):881--891.

Digital Library

[22]

Kavakli, M.; Szilas, N.; Porte, J. & Kartiko, I. (2007). RiskMan: A Multi-Agent System for Risk Management. In Lin, H. (Ed.), Architectural Design of Multi-Agent Systems: Technologies and Techniques (pp. 356--376). Information Science Reference.

[23]

Kennedy, R. S., Lane, N. E. Berbaum, K. S. and Lilienthal, M. G. (1993). Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. International Journal of Aviation Psychology, 3(3):203--220.

[24]

Lin, J. J.-W.; Duh, H. B.; Parker, D. E.; Abi-Rached, H. & Furness, T. A. (2002) Effects of Field of View on Presence, Enjoyment, Memory, and Simulator Sickness in a Virtual Environment In Proc. IEEE Virtual Reality Conference 2002 (VR '02). IEEE Computer Society, Washington, DC, USA, 164.

Digital Library

[25]

Loyall, B. (1997). Believable Agents. Ph.D. Thesis, Tech. Report CMU-CS-97-123, Carnegie Mellon Uni.

[26]

Maciaszek L. A (2007) Requirements Analysis and System Design, 3 ed. Addison Wesley.

Digital Library

[27]

Marsella, S., W. L. Johnson, and C. M. LaBore, (2000). Interactive Pedagogical Drama. In Proceedings of the 4th International Conference on Autonomous Agents, Agents' 2000.

Digital Library

[28]

Mayer, R. E. (2003). The promise of multimedia learning: using the same instructional design methods across different media. Learning and Instruction, 13(2), 125--139.

[29]

Moreno, R. (2007). Optimising learning from animations by minimising cognitive load: cognitive and affective consequences of signalling and segmentation methods. Applied Cognitive Psychology, 21(6), 765--781.

[30]

Nielson, J. (1993). Usability Engineering. Morgan Kaufmann, San Francisco, 1993.

[31]

Pressman, R. S. (2010). Software Engineering: A Practitioner's Approach, 7/e, Pressman & Associates, Inc.

Digital Library

[32]

Richards, D. (2006) Is Interactivity Actually Important? Proc.3rd Aust. Conf. on Interactive Entertainment (IE'2006), 4--6 Dec. 2006, Perth, 59--66.

Digital Library

[33]

Richards, D. and Barles, J. (2005). Actors vs. Animation for Adult Learning? Interactive Entertainment, IE'2005, Sydney Nov. 23--25, 2005.

Digital Library

[34]

Richards, D., Dras, M., Porte, J. and Taylor, M. (2009). The Role, Measurement and Delivery of Immersion in Training Environments, Proceedings SimTecT 2009 Simulation Conference: Simulation - Concepts, Capability and Technology (SimTecT 2009), Adelaide, Australia, 15--18 June, 2009.

[35]

Richards, D. and Porte, J. (2009). Developing an Agent-Based Training Simulation using Game and Virtual Reality Software: Experience Report in Proc. 6th Australasian Conf. on Interactive Entertainment (IE'2009), 17--19 December 2009, Sydney, Australia 2009.

Digital Library

[36]

Richards, D. and Taylor, M. (2011). Scenario Authoring by Domain Trainers, Chapter 11 in Multi-Agent Systems for Education and Interactive Entertainment: Design, Use and Experience. IGI Global Inc. 206--232.

[37]

Richards, D., Taylor, M and Porte, J. (2009). Practically intelligent agents aiding human intelligence In Proc. 8th Autonomous Agents and Multi Agent Systems, (AAMAS'09) May 10--15, Budapest, Hungary, Vol2: 161--2.

Digital Library

[38]

Russell, J. A., & Pratt, G. (1980). A description of the affective quality attributed to environments. Journal of Personality and Social Psychology, 38(2), 311--322.

[39]

Sherman, W. R., & Craig, A. B. (2003). Understanding Virtual Reality: Interface, Application, and Design. San Francisco: Elsevier Science.

Digital Library

[40]

Shneiderman, B., & Plaisant, C. (2005). Designing the User Interface. Boston: Pearson.

[41]

Slater, M and Garau, M (2007) The Use of Questionnaire Data in Presence Studies: Do Not Seriously Likert Presence: Teleoper. Virtual Environ. 16: 4. 447--456.

Digital Library

[42]

Slater, M., Linakis, V., Usoh, M. & Kooper, R. (1996). Immersion, presence, and performance in virtual environments: An experiment using tri-dimensional chess. In Proc. 1996 VR and Software and Technology Conference, Hong Kong.

Digital Library

[43]

Sperring, S. and Strandvall, T, (2006). The experience of entertainment in an interactive television show, 4th Int.l Conf. on Comm. & Mass Media, May 22--24, 2006, Athens, Greece.

[44]

Tijs, T. J. W. (2006). Immersion in Games: An Eyetracking Study. Master's thesis. Department of Computer and Systems Science, Royal Institute of Technology, Stockholm.

[45]

Wilson, S, (1994). Aesthetics and Practice of Designing Interactive Computer Events. SIGGRAPH94 Visual Proc. ACM, Chicago, 1994. accessed 18-3-11 http://userwww.sfsu.edu/~swilson/papers/interactive2.html

[46]

Witmer, B. G.&M.J. Singer (1998). Measuring presence in virtual environments:A presence questionnaire. Presence7:225--240.

Digital Library

[47]

Yang, K., Marsh, T. & Shahabi, C. (2005). Continuous archival and analysis of user data in virtual and immersive game environments. Proc. 2nd ACM workshop on Continuous archival and retrieval of personal experiences, Singapore. pp. 13--22.

Digital Library

[48]

Van Vugt, H.; Konijn, E.; Hoorn, J.; Keur, I. & Eliens, A. (2007). Realism is not all! User engagement with task-related interface characters. Interacting with Computers, HCI Issues in Computer Games 19, 267--280.

Digital Library

Cited By

Ali NUllah SMusa Z(2022)The Effect of List-Liner-Based Interaction Technique in a 3D Interactive Virtual Biological Learning EnvironmentResearch Anthology on Virtual Environments and Building the Metaverse10.4018/978-1-6684-7597-3.ch032(653-674)Online publication date: 21-Oct-2022
https://doi.org/10.4018/978-1-6684-7597-3.ch032
Ali NUllah SKhan D(2022)Interactive Laboratories for Science Education: A Subjective Study and Systematic Literature ReviewMultimodal Technologies and Interaction10.3390/mti61000856:10(85)Online publication date: 21-Sep-2022
https://doi.org/10.3390/mti6100085
Ali NUllah SMusa Z(2020)The Effect of List-Liner-Based Interaction Technique in a 3D Interactive Virtual Biological Learning EnvironmentMobile Devices and Smart Gadgets in Medical Sciences10.4018/978-1-7998-2521-0.ch014(297-317)Online publication date: 21-Feb-2020
https://doi.org/10.4018/978-1-7998-2521-0.ch014

Index Terms

Usability attributes in virtual learning environments
1. Applied computing
  1. Enterprise computing
2. Software and its engineering
  1. Software notations and tools
    1. Development frameworks and environments
      1. Integrated and visual development environments

Recommendations

Software Techniques to Reduce Cybersickness Among Users of Immersive Virtual Reality Environments
Intelligent Information and Database Systems
Abstract
The virtual worlds are photorealistic, the users have difficulty distinguishing the reality and virtuality. The high degree of realism of artificial virtual worlds results in deep immersion in virtual environments. The users immerse themselves in ...
Usability of virtual worlds
DUXU'13: Proceedings of the Second international conference on Design, User Experience, and Usability: design philosophy, methods, and tools - Volume Part I

In recent years virtual worlds left their origins driven by new technologies. As a consequence 3D-based environments moved into business related domains and are used e.g. to support virtual meetings or product presentations. However, enterprises have to ...
Teaching Engineering Education Using Virtual Worlds and Virtual Learning Environments
ACT '09: Proceedings of the 2009 International Conference on Advances in Computing, Control, and Telecommunication Technologies

In recent years there has been significant growth in the use of 3D virtual worlds for e-learning and distance education. Virtual learning environments’ support teaching and learning in an educational context, offering the functionality to manage the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

IE '12: Proceedings of The 8th Australasian Conference on Interactive Entertainment: Playing the System

July 2012

182 pages

ISBN:9781450314107

DOI:10.1145/2336727

Conference Chairs:
Daniel Cermak-Sassenrath
Auckland University of Technology
,
Charles Walker
Auckland University of Technology
,
Program Chair:
Chek Tien Tan
University of Technology, Sydney

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Auckland University of Technology
University of Technology, Sydney: University of Technology, Sydney

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 July 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Australian Research Council

Conference

IE '12

Sponsor:

University of Technology, Sydney

IE '12: The 8th Australasian Conference on Interactive Entertainment

July 21 - 22, 2012

Auckland, New Zealand

Acceptance Rates

Overall Acceptance Rate 64 of 148 submissions, 43%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
439
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ali NUllah SMusa Z(2022)The Effect of List-Liner-Based Interaction Technique in a 3D Interactive Virtual Biological Learning EnvironmentResearch Anthology on Virtual Environments and Building the Metaverse10.4018/978-1-6684-7597-3.ch032(653-674)Online publication date: 21-Oct-2022
https://doi.org/10.4018/978-1-6684-7597-3.ch032
Ali NUllah SKhan D(2022)Interactive Laboratories for Science Education: A Subjective Study and Systematic Literature ReviewMultimodal Technologies and Interaction10.3390/mti61000856:10(85)Online publication date: 21-Sep-2022
https://doi.org/10.3390/mti6100085
Ali NUllah SMusa Z(2020)The Effect of List-Liner-Based Interaction Technique in a 3D Interactive Virtual Biological Learning EnvironmentMobile Devices and Smart Gadgets in Medical Sciences10.4018/978-1-7998-2521-0.ch014(297-317)Online publication date: 21-Feb-2020
https://doi.org/10.4018/978-1-7998-2521-0.ch014
Abdul Salam NMohd Rias RYusof WAbdul Manap A(2013)Interactivity and Animation Effects towards Student Enhancement of Learning in WAN ProtocolsThird International Visual Informatics Conference on Advances in Visual Informatics - Volume 823710.1007/978-3-319-02958-0_40(435-446)Online publication date: 13-Nov-2013
https://dl.acm.org/doi/10.1007/978-3-319-02958-0_40

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten