ABSTRACT
Virtual Reality (VR) is increasingly being adopted in fitness, gaming, and workplace productivity applications for its natural interaction with body movement. A widely accepted method for quantifying the physical fatigue caused by VR interactions is through metrics such as Consumed Endurance (CE). Proposed in 2014, CE calculates the shoulder torque to infer endurance time (ET)—i.e. the maximum amount of time a pose can be maintained—during mid-air interactions. This model remains widely cited but has not been closely examined beyond its initial evaluation, leaving untested assumptions about exertion from low-intensity interactions and its basis on torque. In this paper, we present two VR studies where we (1) collect a baseline dataset that replicates the foundation of CE and (2) extend the initial evaluation in a pointing task from a two-dimensional (2D) screen to a three-dimensional (3D) immersive environment. Our baseline dataset collected from a high-precision tracking system found that the CE model overestimates ET for low-exertion interactions. Further, our studies reveal that a biomechanical model based on only torque cannot account for additional exertion measured when the shoulder angle exceeds 90° elevation. Based on these findings, we propose a revised formulation of CE to highlight the need for a hybrid approach in future fatigue modelling.
Supplemental Material
Available for Download
- [n. d.]. Four apps to try if you’re new to VR fitness. Washington Post ([n. d.]). https://www.washingtonpost.com/lifestyle/2021/11/11/vr-fitness-apps-to-try/Google Scholar
- Maximilian Aurbach, Jan Spicka, Franz Süß, and Sebastian Dendorfer. 2020. Evaluation of musculoskeletal modelling parameters of the shoulder complex during humeral abduction above 90. Journal of biomechanics 106 (2020), 109817.Google ScholarCross Ref
- Myroslav Bachynskyi, Antti Oulasvirta, Gregorio Palmas, and Tino Weinkauf. 2014. Is motion capture-based biomechanical simulation valid for hci studies? study and implications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3215–3224.Google ScholarDigital Library
- Myroslav Bachynskyi, Gregorio Palmas, Antti Oulasvirta, and Tino Weinkauf. 2015. Informing the design of novel input methods with muscle coactivation clustering. ACM Transactions on Computer-Human Interaction (TOCHI) 21, 6 (2015), 1–25.Google ScholarDigital Library
- Kayne Barclay, Danny Wei, Christof Lutteroth, and Robert Sheehan. 2011. A quantitative quality model for gesture based user interfaces. In Proceedings of the 23rd Australian Computer-Human Interaction Conference. 31–39.Google ScholarDigital Library
- Gunnar Borg. 1998. Borg’s perceived exertion and pain scales.Human kinetics.Google Scholar
- Doug A. Bowman, Ryan P. McMahan, and Eric D. Ragan. 2012. Questioning Naturalism in 3D User Interfaces. Commun. ACM 55, 9 (sep 2012), 78–88. https://doi.org/10.1145/2330667.2330687Google ScholarDigital Library
- F Buchthal and H Schmalbruch. 1980. Motor unit of mammalian muscle.Physiological reviews 60, 1 (1980), 90–142.Google Scholar
- Gavin Buckingham. 2021. Hand tracking for immersive virtual reality: opportunities and challenges. Frontiers in Virtual Reality (2021), 140.Google Scholar
- Jack Crosbie, Sharon L Kilbreath, Luise Hollmann, and Sarah York. 2008. Scapulohumeral rhythm and associated spinal motion. Clinical biomechanics 23, 2 (2008), 184–192.Google Scholar
- João Marcelo Evangelista Belo, Anna Maria Feit, Tiare Feuchtner, and Kaj Grønbæk. 2021. XRgonomics: Facilitating the Creation of Ergonomic 3D Interfaces. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 290, 11 pages. https://doi.org/10.1145/3411764.3445349Google ScholarDigital Library
- Sue A Ferguson, W Gary Allread, Peter Le, Joseph D Rose, and William S Marras. 2011. Shoulder muscle oxygenation during repetitive tasks. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 55. SAGE Publications Sage CA: Los Angeles, CA, 1039–1041.Google ScholarCross Ref
- Andris Freivalds. 2011. Biomechanics of the upper limbs: mechanics, modeling and musculoskeletal injuries. CRC press.Google Scholar
- Laura A Frey Law and Keith G Avin. 2010. Endurance time is joint-specific: a modelling and meta-analysis investigation. Ergonomics 53, 1 (2010), 109–129.Google ScholarCross Ref
- A Garg, KT Hegmann, BJ Schwoerer, and JM Kapellusch. 2002. The effect of maximum voluntary contraction on endurance times for the shoulder girdle. International journal of industrial ergonomics 30, 2 (2002), 103–113.Google ScholarCross Ref
- M Hagberg. 1981. Muscular endurance and surface electromyogram in isometric and dynamic exercise. Journal of Applied Physiology 51, 1 (1981), 1–7.Google ScholarCross Ref
- Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139–183.Google Scholar
- Kimberley Hayes, Judie R Walton, Zoltan L Szomor, and George AC Murrell. 2002. Reliability of 3 methods for assessing shoulder strength. Journal of Shoulder and Elbow surgery 11, 1 (2002), 33–39.Google ScholarCross Ref
- Juan David Hincapié-Ramos, Xiang Guo, and Pourang Irani. 2014. The Consumed Endurance Workbench: A Tool to Assess Arm Fatigue during Mid-Air Interactions. In Proceedings of the 2014 Companion Publication on Designing Interactive Systems (Vancouver, BC, Canada) (DIS Companion ’14). Association for Computing Machinery, New York, NY, USA, 109–112. https://doi.org/10.1145/2598784.2602795Google ScholarDigital Library
- Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-Air Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 1063–1072. https://doi.org/10.1145/2556288.2557130Google ScholarDigital Library
- R Hugh Morton. 1996. A 3-parameter critical power model. Ergonomics 39, 4 (1996), 611–619.Google ScholarCross Ref
- Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, and Karthik Ramani. 2017. Modeling cumulative arm fatigue in mid-air interaction based on perceived exertion and kinetics of arm motion. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 3328–3339.Google ScholarDigital Library
- Thomas Kosch, Jakob Karolus, Johannes Zagermann, Harald Reiterer, Albrecht Schmidt, and Paweł W. Woźniak. 2023. A Survey on Measuring Cognitive Workload in Human-Computer Interaction. Comput. Surveys (1 2023). https://doi.org/10.1145/3582272Google ScholarDigital Library
- Zhe Liu, Daniel Vogel, and James R Wallace. 2018. Applying the cumulative fatigue model to interaction on large, multi-touch displays. In Proceedings of the 7th ACM International Symposium on Pervasive Displays. 1–9.Google ScholarDigital Library
- Svend Erik Mathiassen. 1999. Prediction of shoulder exerion endurance from personal factors. International Journal of Industrial Ergonomics (1999).Google Scholar
- MATLAB. 2010. version 7.10.0 (R2010a). The MathWorks Inc., Natick, Massachusetts.Google Scholar
- Lynn McAtamney and E Nigel Corlett. 1993. RULA: a survey method for the investigation of work-related upper limb disorders. Applied ergonomics 24, 2 (1993), 91–99.Google Scholar
- COLEEN McCLURE and Damian Schofield. 2019. Running virtual: The effect of virtual reality on exercise. (2019).Google Scholar
- J Matt McCrary, Bronwen J Ackermann, and Mark Halaki. 2018. EMG amplitude, fatigue threshold, and time to task failure: A meta-analysis. Journal of science and medicine in sport 21, 7 (2018), 736–741.Google ScholarCross Ref
- Brian Merchant. 2021. The Metaverse Has Always Been a Dystopian Idea. https://www.vice.com/en/article/v7eqbb/the-metaverse-has-always-been-a-dystopiaGoogle Scholar
- H Monod and J Scherrer. 1965. The work capacity of a synergic muscular group. Ergonomics 8, 3 (1965), 329–338.Google ScholarCross Ref
- Toshio Moritani, Akira Nagata, HERRFRT A DEVRIES, and MASUO MURO. 1981. Critical power as a measure of physical work capacity and anaerobic threshold. Ergonomics 24, 5 (1981), 339–350.Google ScholarCross Ref
- Surena Namdari, Gautam Yagnik, D David Ebaugh, Sameer Nagda, Matthew L Ramsey, Gerald R Williams Jr, and Samir Mehta. 2012. Defining functional shoulder range of motion for activities of daily living. Journal of shoulder and elbow surgery 21, 9 (2012), 1177–1183.Google ScholarCross Ref
- Pierre Plantard, Edouard Auvinet, Anne-Sophie Le Pierres, and Franck Multon. 2015. Pose estimation with a kinect for ergonomic studies: Evaluation of the accuracy using a virtual mannequin. Sensors 15, 1 (2015), 1785–1803.Google ScholarCross Ref
- Walter Rohmert. 1960. Ermittlung von Erholungspausen für statische Arbeit des Menschen. Internationale Zeitschrift für angewandte Physiologie einschließlich Arbeitsphysiologie 18, 2 (1960), 123–164.Google Scholar
- David Vidal-Tomás. 2022. The new crypto niche: NFTs, play-to-earn, and metaverse tokens. Finance Research Letters 47 (2022), 102742. https://doi.org/10.1016/j.frl.2022.102742Google ScholarCross Ref
- Ana Villanueva, Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, and Karthik Ramani. 2023. Advanced modeling method for quantifying cumulative subjective fatigue in mid-air interaction. International Journal of Human-Computer Studies 169 (2023), 102931.Google ScholarDigital Library
- Jan Wöbbeking. 2022. Beat Saber generated more revenue in 2021 than the next five biggest apps combined. https://mixed-news.com/en/beat-saber-generated-more-revenue-in-2021-than-the-next-five-biggest-apps-combined/Google Scholar
- Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 143–146. https://doi.org/10.1145/1978942.1978963Google ScholarDigital Library
- Haijun Xia, Michael Glueck, Michelle Annett, Michael Wang, and Daniel Wigdor. 2022. Iteratively Designing Gesture Vocabularies: A Survey and Analysis of Best Practices in the HCI Literature. ACM Transactions on Computer-Human Interaction (TOCHI) 29, 4 (2022), 1–54.Google ScholarDigital Library
Index Terms
- Revisiting Consumed Endurance: A NICE Way to Quantify Shoulder Fatigue in Virtual Reality
Recommendations
Consumed endurance: a metric to quantify arm fatigue of mid-air interactions
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsMid-air interactions are prone to fatigue and lead to a feeling of heaviness in the upper limbs, a condition casually termed as the gorilla-arm effect. Designers have often associated limitations of their mid-air interactions with arm fatigue, but do ...
The consumed endurance workbench: a tool to assess arm fatigue during mid-air interactions
DIS Companion '14: Proceedings of the 2014 companion publication on Designing interactive systemsConsumed Endurance (CE) [8] is a metric that captures the degree of arm fatigue during mid-air interactions. Research has shown that CE can assist with the design of new and minimally fatiguing gestural interfaces. We introduce the Consumed Endurance ...
Overcoming touchscreen user fatigue by workplace design
CHI '92: Posters and Short Talks of the 1992 SIGCHI Conference on Human Factors in Computing SystemsThe effect of touchscreen inclination and elbow support on arm fatigue was studied in a factorial design. Inclinations were 0°, 22.5°, 30° 45°, 60° and 90° from horizontal. The subjects could or could not rest the elbow on the desk. Results indicated ...
Comments