Skip to main content
SpringerLink
Log in

Evaluation of leap motion controller effectiveness on 2D game environments using usability heuristics

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The use of sensors for tasks such as (1) interface manipulation, (2) digital games and (3) simulations is quickly becoming commonplace. Novel digital interfaces are being established and, as a result, users are getting better and better at both learning and using them. Medicine, engineering, and entertainment are but a few of the fields making use of sensors for the purpose of scientific progress or to improve the user’s experience. However, the use of emerging sensor devices is significantly more prominent in 3D games and simulations. This article evaluates the effectiveness of the Leap Motion Controller in 2D gaming environments. In the study, other devices such as a mouse, keyboard, gamepad, and touch screen are used to further analyze the performance data gathered with the Leap Motion Controller. Data collection employs user experience heuristics and pre-determined key performance indicators. The indicators were used to measure the effectiveness of the controllers in four main tasks: interface handling, character movement, item collection and combat gameplay. Users showed more effective control in item collection and combat gameplay, according to the data gathered from our subject’s gameplay sessions. Item collection was performed better with the Leap Motion Controller and touch screen, based on the data collected. Observed results also showed that conventional interfaces outperformed the Leap Motion Controller in character movement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig 8.
Fig. 9.
Fig. 10.
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. 3D Sensor Market by Type, (Images Sensor, Position Sensor, Acoustic Sensor, Accelerometers) (2020) End-users, technology, (stereo vision, structured light, time-of-flight, ultrasound, and others), connectivity, and region - global forecast to 2025, viewed 19 March 2020. https://www.marketsandmarkets.com/Market-Reports/3d-sensors-market-248537071.html

  2. Abdullah SZ, Ali NM, Lee H (2015) Interaction and game engagement based on players´ background and preferences. Game Physics and Mechanics International Conference (GAMEPEC), August 25–27, 2015, Langkawi, Kedah

  3. Austen J (2019) Xbox One gets keyboard and mouse support. Collaboration open Razer viewed 10 February 2019. <https://www.techbyte.sk/wp-content/uploads/2018/09/xbox-one-tit.jpg>

  4. Bachl Stefan, Tomitsch Martin, Wimmer Christoph, Grechenig Thomas (2010) Challenges for designing the user experience of multi-touch interfaces

  5. Bhuiyan M, Picking R (2009) Gesture-controlled user interfaces, what have we done and what is next. Proceedings on the fifth collaborative research symposium on security, E-learning, internet and networking, pp 59–60

  6. Brown M (2008) Evaluating computer game usability: developing heuristics based on user experience. Conference: Irish Human Computer Interaction Conference. At Cork, Ireland

  7. Michael B, Aidan K, Jurek K, Ian P (2010) Beyond the gamepad: HCI and game controller design and evaluation:197–219. https://doi.org/10.1007/978-1-84882-963-3_12

  8. Brown MA, MacKenzie IS (2013) Evaluating video game controller usability as related to hand size. Proceedings of the International Conference on Multimedia and Human-Computer Interaction -MHCI 2013, Ottawa, pp 114.1–114.8

    Google Scholar 

  9. Hochleitner C, Hochleitner W, Graf C, Tscheligi M (2015) A heuristic framework for evaluating user experience in games: 187–206

  10. Coelho JC, Verbeek FJ (2014) Pointing task evaluation of leap motion controller in 3D virtual environment. Creating the Difference, Proceedings of the Chi Sparks 2014 Conference, pp 78–85

  11. Costa C, Freitas Â, Stefanik I et al (2019) Evaluation of data availability on population health indicators at the regional level across the European Union. Popul Health Metr 17(1):11. https://doi.org/10.1186/s12963-019-0188-6

    Article  Google Scholar 

  12. Desurvire H, Wiberg C (2009) Game usability heuristics (PLAY) for evaluating and designing better games: the next iteration. In: Ozok AA, Zaphiris P (eds) Online Communities and Social Computing. OCSC 2009. Lecture notes in computer science, vol 5621. Springer, Berlin, Heidelberg

    Google Scholar 

  13. Findlater L, Froehlich JE, Fattal K, Wobbrock JO, Tanya D (2013) Age-related differences in performance with touchscreens compared to traditional mouse input. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI ‘13), ACM, New York, NY, USA, pp 343–346

  14. Gesture Recognition Market Analysis by Technology (Touch-Based, Touchless) (2016) By industry (automotive, consumer electronics, healthcare), by region, and segment forecasts, 2018–2015

  15. Hartmann T, Klimmt C (2006) Gender and computer games: exploring females’ dislikes. J Comput-Mediat Commun 11(4):910–993

    Article  Google Scholar 

  16. Johnson MR, Woodcock J (2017) Fighting games and go: exploring the aesthetics of play in professional gaming. Thesis Eleven 138(1):26–45 ISSN 0725-5136

  17. Kim JJ, Gonzalez DA, Mintz A et al (2015) Motor control assessment using leap motion: filtering methods and performance in indoor and outdoor environments. In: Jaffray DA (ed), IFMBE Proceedings, vol 51, Toronto, Canada, pp 1150–1154

  18. Kim Y-H, Lee J-H (2015) Game interface enhancement under smartphone platform focused on touchscreen interaction. Comput Ind Eng 80:45–61, ISSN 0360-8352. https://doi.org/10.1016/j.cie.2014.11.017

    Article  Google Scholar 

  19. Koeffel C, Hochleitner W, Leitner J, Haller M, Geven A, Tscheligi M (2009) Using heuristics to evaluate the overall user experience of video games and advanced interaction games. In: Evaluating user experience in games. Springer, Bernh+aupt R, pp 233–256

    Google Scholar 

  20. Leap Motion App Store (2018) Leap motion app store. [online] Available at: https://gallery.leapmotion.com/category/app-store/ [Accessed 9 Sep. 2018].

  21. Leblanc A, Chaput J-P, Mcfarlane A, Colley R, Thivel D, Biddle S, Maddison R, Leatherdale S, Tremblay M (2013) Active video games and health indicators in children and youth: a systematic review. PLOS One 8:e65351. https://doi.org/10.1371/journal.pone.0065351

    Article  Google Scholar 

  22. Lee B, Lee D, Chin S (2018) Structural motion grammar for universal use of leap motion: amusement and functional contents focused. J Sens 6073786:15. https://doi.org/10.1155/2018/6073786

    Article  Google Scholar 

  23. Malec C, Semwal SK (2016) Enriching play experience across multiple platforms through collaborative real-world actions. 2016 International Conference on Collaboration Technologies and Systems (CTS), Orlando, FL, pp 545–550

    Google Scholar 

  24. Malone TW (1982) Heuristics for designing enjoyable user interfaces: lessons from computer games. In: Proceedings of the 1982 Conference on Human Factors in Computing Systems (Gaithersburg, Maryland, United States, March 15–17, 1982). ACM, New York, NY, pp 63–68

    Google Scholar 

  25. Marin G, Dominio F, Zanuttigh P (2014) Hand gesture recognition with leap motion and kinect devices. 2014 IEEE International Conference on Image Processing (ICIP), Paris, pp 1565–1569

    Google Scholar 

  26. Martins R (2019) Image from an electronic source

  27. Mihal’ov J, Dufala M (2016) Kinect: from entertainment to scientific research on virtual movement. Department of Computers and Informatic, Technical University of Kosice, Letna 9. 20th International Student Conference on Electrical Engineering. Poster 2016, Prague

    Google Scholar 

  28. Milani F, Diogo NR, Mendes TDÁ, Andreis José Henrique D, De Marchi AB, Rafael R (2016) Usability evaluation of menus in a gesture-based game:1–4. https://doi.org/10.1145/3033701.3033739

  29. Mohan D, Fischhoff B, Angus DC, Rosengart MR, Wallace DJ, Yealy DM, Farris C, CCH C, Kerti S, Barnato AE (2018) Serious games may improve physician heuristics in trauma triage, vol 115. Proceedings of the National Academy of Sciences, National Academy of Sciences, pp 9204–9209

  30. Mulder A (1996) Hand gestures for HCI: research on human movement behaviour reviewed in the context of hand Centre input. In: Technical report 96–1. School of Kinesiology, Simon Fraser Universite, Burnaby B.C

    Google Scholar 

  31. Nguyen Hung T (2012) Human computer interaction in game design

  32. Oña ED, Balaguer C, Cano-de la Cuerda R, Collado-Vázquez S, Jardón A (2018) Effectiveness of serious games for leap motion on the functionality of the upper limb in parkinson’s disease: a feasibility study. Comput Intell Neurosci 7148427:17. https://doi.org/10.1155/2018/7148427

    Article  Google Scholar 

  33. Pimentel MGC, Baldochi JRLA, Cattelan RG (2007) Prototyping applications to document human experiences. IEEE Pervasive Computing:93–100

  34. Pinelle D, Wong N (2018) Heuristic evaluation for games: usability principles for video game design. IL, Chicago

    Google Scholar 

  35. Johanna P, Mathias P, Holzinger A, Christian G (2017) Gesture-Based Interactions in Video Games with the Leap Motion Controller. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), pp 620–633. https://doi.org/10.1007/978-3-319-58071-5_47

  36. Reiten JE (2014) 3D modeling using leap motion: focusing on homogeneous transforms. Norwegian University of Science and Technology, Department of Computer and Information Science

  37. Sartzetaki Maria, Psaromiligkos Yannis, Retalis Symeon, Avgeriou Paris (2004) An approach for usability evaluation of E-commerce sites based on design patterns and heuristics criteria

  38. Seçer I, Satyen L (2014) Video game training and reaction time skills among older adults. Act Adapt Aging 38(3):220–236. https://doi.org/10.1080/01924788.2014.935908

    Article  Google Scholar 

  39. Semwal VB, Gaud N, Nandi GC (2017) Human gait state prediction using cellular automata and classification using ELM. MISP

  40. Semwal VB, Mondal K, Nandi GC (2015) Robust and accurate feature selection for humanoid push recovery and classification: deep learning approach, neural computing and application, Springer. Accepted on 3rd November

  41. Shuntaro O, Yoshihiro M, Risa S (2017) Validity and reliability of leap motion controller for assessing grasping and releasing finger movements. Journal of Ergonomic Technology. 17(1):2017

    Google Scholar 

  42. Simor FW, Brum MR, Schmidt JDE, Rieder R, De Marchi ACB (2016) Usability evaluation methods for gesture-based games: a systematic review. Eysenbach G, ed. JMIR Serious Games 4(2):e17. https://doi.org/10.2196/games.5860

  43. Smith C (2017) Xbox One gaming is about to become even more PC-like, viewed 10 February 2019, <https://ksassets.timeincuk.net/wp/uploads/sites/54/2017/08/Xbox-One-Lovely-High-Quality-Wallpaper-320x180.jpg>

  44. Sullivan GM, Artino AR (2013) Analyzing and interpreting data from likert-type scales. J Grad Med Educ 5(4):541–542. https://doi.org/10.4300/JGME-5-4-18

    Article  Google Scholar 

  45. The Esports Observer, Esports to go: How touch devices are claiming their spot in esports, viewed 12 January 2019. <https://y4j7y8s9.ssl.hwcdn.net/wp-content/uploads/2015/09/Mobile.jpg>

  46. Rina W, Elisa M, Mike S, Edward L, Lennart N (2017) Testing incremental difficulty design in platformer games. CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp 5109–5113. https://doi.org/10.1145/3025453.3025697

Download references

Acknowledgements

Thanks to CAPES and MackPesquisa for enabling this research through financial aid and access to the literature, the research’s supervisor, GameArtPartners for the 2D art sprites used in the experiment’s game and all participants involved.

Data Availability statement

The game’s metrics, used to support this study’s results, are currently under embargo while the findings are being used commercially. Requests for the data made at least 12 months after publication will be considered by the authors.

Author information

Authors and Affiliations

  1. Programa de Pós-Graduação em Engenharia Elétrica, Universidade Presbiteriana Mackenzie, São Paulo, Brazil

    Rafael Martins & Pollyana Notargiacomo

Authors
  1. Rafael Martins
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pollyana Notargiacomo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rafael Martins.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Martins, R., Notargiacomo, P. Evaluation of leap motion controller effectiveness on 2D game environments using usability heuristics. Multimed Tools Appl 80, 5539–5557 (2021). https://doi.org/10.1007/s11042-020-09696-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09696-7

Keywords

Search

Navigation