skip to main content
research-article

Digital Human Models in Human Factors and Ergonomics Evaluation of Gesture Interfaces

Published: 19 June 2018 Publication History

Abstract

Gesture-based interfaces are becoming a widely used interaction modality in many industrial applications. Therefore, it is important to guarantee usable and ergonomic interfaces for workers. The purpose of this study was to investigate whether the use of digital human models (DHMs) by human factors/ergonomics (HFE) experts can complement the user evaluation of gesture interface prototypes. Two case studies were conducted, in which gesture-based systems for remote robot control were evaluated. The results indicate that the use of DHMs supports the findings from self-reported HFE evaluations. However, digital human modeling still has some limitations. For example, in this study, it was not possible to evaluate small muscle groups (e.g. fingers). We argue that adaptation of the DHMs could be a rapid and simple alternative for supporting the HFE design of gestures.

References

[1]
Iina Aaltonen, Susanna Aromaa, Kaj Helin, and Ali Muhammad. 2017. Multimodality Evaluation Metrics for Human-Robot Interaction Needed?: A Case Study in Immersive Telerobotics. Proceedings of the 8th International Conference on Applied Human Factors and Ergonomics (AHFE 2017), 335--347.
[2]
Norman Badler. 1997. Virtual humans for animation, ergonomics, and simulation. Proceedings IEEE Nonrigid and Articulated Motion Workshop: 28--36.
[3]
Norman I. Badler, Cary B. Phillips, and Bonnie L. Webber. 1993. Simulating Humans: Computer Graphics, Animation, and Control. .
[4]
Thomas Baudel and Michel Beaudouin-Lafon. 1993. Remote control of objects using free-hand gestures. Communications of the ACM 36, 7: 28--35.
[5]
Gunnar A. Borg. 1982. Psychophysical bases of perceived exertion. Med sci sports exerc 14, 5: 377--381.
[6]
Marcio C. Cabral, Carlos H. Morimoto, and Marcelo K. Zuffo. 2005. On the usability of gesture interfaces in virtual reality environments. Proceedings of the Latin American conference on Human-computer interaction (CLIHC '05), 100--108.
[7]
Db Chaffin. 2007. Human motion simulation for vehicle and workplace design. Human Factors and Ergonomics in Manufacturing 17, 5: 475--484.
[8]
Shao-Wen Chang and Mao-Jiun J. Wang. 2007. Human motion simulation for vehicle and workplace design. Human Factors and Ergonomics in Manufacturing 17, 5: 475--484.
[9]
Ken Tin-kai Chen. 2009. An Investigation Into Alternative Human-Computer Interaction in Relation To Ergonomics for Gesture Interface Design. Dissertation.
[10]
Ngip Khean Chuan, Ashok Sivaji, and Wan Fatimah Wan Ahmad. 2014. Proposed Usability Heuristics for Testing Gestural Interaction. In Proceedings of the International Conference on Artificial Intelligence and Applications in Engineering and Technology, 233--238.
[11]
Herbert A. Colle and Gary B. Reid. 2005. Estimating a Mental Workload Redline in a Simulated Air-to-Ground Combat Mission. The International Journal of Aviation Psychology 15, 4: 303--319.
[12]
G C David. 2005. Ergonomic methods for assessing exposure to risk factors for work-related musculoskeletal disorders. Occupational medicine (Oxford, England) 55, 3: 190--199.
[13]
William Delamare, Céline Coutrix, and Laurence Nigay. 2015. Designing guiding systems for gesture-based interaction. Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems - EICS '15, ACM, 44--53.
[14]
H.O. Demirel and V.G. Duffy. 2007. Application of digital human modeling in industry. Digital Human Modeling: 824--832.
[15]
European Agency for Safety and Health at Work. 2007. Work-related musculoskeletal disorders (MSDs): an introduction.
[16]
European Commission. 2014. Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions on a EU Strategic Framework on Health and Safety at Work 2014--2020. 15. Retrieved March 24, 2016 from http://scholar.google.com/scholar?hl=en&btnG=Search&q=intitle:No+Title#0.
[17]
Scott S. Fisher, Michael McGreevy, Jeffrey Humphries, and Warren Robinett. 1987. Virtual environment display system. In Proceedings of the 1986 workshop on Interactive 3D graphics, 77--87.
[18]
Paul M. Fitts. 1954. The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement. Journal of Experimental Biology 47, 6: 381--391.
[19]
Lars Fritzsche. 2010. Ergonomics risk assessment with digital human models in car assembly: simulation versus real life. Human Factors and Ergonomics in Manufacturing & Service Industries 20, 4: 287--299.
[20]
Lars Hanson, Mikael Blomé, Tania Dukic, and Dan Högberg. 2006. Guide and documentation system to support digital human modeling applications. International Journal of Industrial Ergonomics 36, 1: 17--24.
[21]
Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology 52: 139--183.
[22]
Sue Hignett and Lynn Mcatamney. 2000. Rapid entire body assessment (REBA). Applied Ergonomics 31: 201--205.
[23]
Eve Hoggan, Miguel Nacenta, Per Ola Kristensson, John Williamson, Antti Oulasvirta, and Anu Lehtiö. 2013. Multi-Touch Pinch Gestures: Performance and Ergonomics. In Proceedings of the ACM international conference on Interactive tabletops and surfaces, 219--222.
[24]
Eve Hoggan, John Williamson, Antti Oulasvirta, Miguel Nacenta, Per Ola Kristensson, and Anu Lehtiö. 2013. Multi-Touch Rotation Gestures: Performance and Ergonomics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 3047--3050.
[25]
IEA. 2000. Definition and domains of ergonomics. Retrieved January 15, 2016 from http://www.iea.cc/whats/.
[26]
Osmo Karhu, Pekka Kansi, and Ilkka Kuorinka. 1977. Correcting working postures in industry: a practical method for analysis. Applied Ergonomics 8, 4: 199--201.
[27]
Waldemar Karwowski. 2006. The Discipline of Ergonomics and Human Factors. In G. Salvendy, ed., Handbook of Human Factors & Ergonomics. John Wiley, New York, 1--25.
[28]
I. Kuorinka, B. Jonsson, A. Kilbom, et al. 1987. Standardised Nordic questionnaires for the analysis of musculoskeletal symptoms. Applied Ergonomics 18, 3: 233--237.
[29]
Luis Leite, Feup Esmad, Verónica Orvalho, and I T Fcup. 2017. Mani-Pull-Action: Hand-based Digital Puppetry. Proceedings of the ACM on Human-Computer Interaction - EICS, ACM, 1--16.
[30]
Dan Lämkull, Lars Hanson, and Roland Örtengren. 2007. The influence of virtual human model appearance on visual ergonomics posture evaluation. Applied Ergonomics 38, 6: 713--722.
[31]
Liang Ma, Damien Chablat, Fouad Bennis, and Wei Zhang. 2009. A new simple dynamic muscle fatigue model and its validation. International Journal of Industrial Ergonomics 39, 1: 211--220.
[32]
Liang Ma, Damien Chablat, Fouad Bennis, Wei Zhang, and François Guillaume. 2010. A new muscle fatigue and recovery model and its ergonomics application in human simulation. Virtual and Physical Prototyping 5, 3: 123--137.
[33]
Liang Ma, Damien Chablat, Fouad Bennis, Wei Zhang, Bo Hu, and Franqois Guillaume. 2011. Fatigue evaluation in maintenance and assembly operations by digital human simulation in virtual environment. Virtual Reality 15, 1: 55--68.
[34]
I. Scott MacKenzie. 1995. Input Devices and Interaction Techniques for Advanced Computing. In W. Barfield and T.A. Furness, eds., Virtual environments and advanced interface design. Oxford University Press, Oxford, UK, 437--470.
[35]
Giovanni De Magistris, Alain Micaelli, Paul Evrard, et al. 2013. Dynamic control of DHM for ergonomic assessments. International Journal of Industrial Ergonomics 43, 2: 170--180.
[36]
Giovanni De Magistris, Alain Micaelli, Jonathan Savin, Clarisse Gaudez, and Jacques Marsot. 2015. Dynamic digital human models for ergonomic analysis based on humanoid robotics techniques. International Journal of the Digital Human 1, 1: 81--109.
[37]
N. J. Mansfield and J. M. Marshall. 2001. Symptoms of musculoskeletal disorders in stage rally drivers and co-drivers. British journal of sports medicine 35, 5: 314--320.
[38]
L. M. Mazur, P. R. Mosaly, L. M. Hoyle, E. L. Jones, and L. B. Marks. 2013. Subjective and objective quantification of physician's workload and performance during radiation therapy planning tasks. Practical radiation oncology 3, 4: e171--e177.
[39]
Lucas M. Mazur, Prithima R. Mosaly, Lesley M. Hoyle, Ellen L. Jones, Bhishamjit S. Chera, and Lawrence B. Marks. 2014. Relating physician's workload with errors during radiation therapy planning. Practical radiation oncology 4, 2: 71--75.
[40]
Lynn McAtamney and E. Nigel Corlett. 1993. RULA: A survey method for the investigation of work-related upper limb disorders. Applied Ergonomics 24, 2: 91--99.
[41]
Ville Mäkelä, Tomi Heimonen, Matti Luhtala, and Markku Turunen. 2014. Information wall: evaluation of a gesture-controlled public display. Proceedings of the 13th International Conference on Mobile and Ubiquitous Multimedia, 228--231.
[42]
Jakob Nielsen. 2012. Usability 101: Introduction to usability. 1--13. Retrieved August 20, 2016 from http://www.nngroup.com/articles/usability-101-introduction-to-usability/.
[43]
Michael Nielsen, Moritz Störring, Thomas B. Moeslund, and Erik Granum. 2003. A procedure for developing intuitive and ergonomic gesture interfaces for man-machine interaction. In Proceedings of the 5th International Gesture Workshop, 1--12.
[44]
Michael Nielsen, Moritz Störring, Thomas B. Moeslund, and Erik Granum. 2004. A procedure for developing intuitive and ergonomic gesture interfaces for HCI. Gesture-Based Communication in Human-Computer Interaction: 409--420.
[45]
Donald A. Norman. 2010. Natural user interfaces are not natural. Interactions 17, 6--10.
[46]
Donald A. Norman and Jakob Nielsen. 2010. Gestural interfaces: A step backward in usability. Interactions 17, 46--49. Retrieved from http://dl.acm.org/ft_gateway.cfm?id=1836228&type=html.
[47]
Jorge Perez and W. Patrick Neumann. 2015. Ergonomicsts' and engineers' views on the utility of virtual human factors tools. Human Factors and Ergonomics in Manufacturing & Service Industries 25, 3: 279--293.
[48]
Charles Pontonnier, Georges Dumont, Asfhin Samani, Pascal Madeleine, and Marwan Badawi. 2013. Designing and evaluating a workstation in real and virtual environment: toward virtual reality based ergonomic design sessions. Journal on Multimodal User Interfaces: 1--10.
[49]
Roland Örtengren, Dan Lämkull, and Lars Hanson. 2009. A comparative study of digital human modelling simulation results and their outcomes in reality: A case study within manual assembly of automobiles. International Journal of Industrial Ergonomics 39, 2: 428--441.
[50]
Jaime Ruiz, Yang Li, and Edward Lank. 2011. User-defined motion gestures for mobile interaction. Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11, 197--206.
[51]
J Sanjog, Sougata Karmakar, Thaneswer Patel, and Anirban Chowdhury. 2015. Towards virtual ergonomics: aviation and aerospace. Aircraft Engineering and Aerospace Technology 87, 3: 266--273.
[52]
Siemens. Jack and Process Simulate Human. Retrieved September 10, 2017 from https://www.plm.automation.siemens.com/en/products/tecnomatix/manufacturing-simulation/human-ergonomics/jack.shtml.
[53]
Minseok Son, Haeseok Jung, Hyunkyung Yang, and Woojin Park. 2015. Evaluating physical discomfort associated with prolonged, repetitive use of gesture?: a comparison of subjective rating protocols. In Proceedings 19th Triennial Congress of the IEA, 9--11.
[54]
R. William Soukoreff and I. Scott MacKenzie. 2004. Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI. International Journal of Human Computer Studies 61, 6: 751--789.
[55]
Helman I. Stern, Juan Wachs, and Yael Edan. 2006. Human Factors for Design of Hand Gesture Human - Machine Interaction. In Proceedings of the IEEE International Conference on Systems Man and Cybernetics, 4052--4056.
[56]
Anders Sundin and Roland Örtengren. 2006. Digital human modeling for CAE applications. In G. Salvendy, ed., Handbook of Human Factors and Ergonomics. John Wiley & Sons, New Jersey, 1053--1078.
[57]
Jochen Triesch and Christoph Von Der Malsburg. 1998. A gesture interface for human-robot-interaction. Proceedings of third IEEE International Conference on Automatic Face and Gesture Recognition, 546--551.
[58]
Christian Vogt, Christian Mergl, and Heiner Bubb. 2005. Interior layout design of passenger vehicles with RAMSIS. Human Factors and Ergonomics In Manufacturing 15, 2: 197--212.
[59]
Kaisa Väänänen-Vainio-Mattila, Thomas Olsson, and Jari Laaksonen. 2012. An exploratory study of user-generated spatial gestures with social mobile devices. Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia - MUM '12, ACM.
[60]
Kaisa Väänänen and Klaus Böhm. 1993. Gesture driven interaction as a human factor in virtual environments-An approach with neural networks. In Virtual reality systems. Academic Press, Ltd., London, UK, 93--106.
[61]
Juan Pablo Wachs, Mathias Kölsch, Helman Stern, and Yael Edan. 2011. Vision-based Hand-gesture Applications. Commun. ACM 54, 2.
[62]
Stefan Waldherr, Roseli Romero, and Sebastian Thrun. 2000. A Gesture Based Interface for Human-Robot Interaction. Autonomous Robots 9, 2: 151--173.
[63]
Robert Walter, Gilles Bailly, and Jörg Müller. 2013. StrikeAPose: revealing mid-air gestures on public displays. SIGCHI Conference on Human Factors in Computing Systems (CHI'13), 841--850.
[64]
G. Gary Wang. 2002. Definition and Review of Virtual Prototyping. Journal of Computing and Information Science in Engineering 2, 3: 232--236.
[65]
Thomas R. Waters, Vern Putz-Anderson, Arun Garg, and Lawrence J. Fine. 1993. Revised NIOSH equation for the design and evaluation of manual lifting tasks. Ergonomics 36, 7: 749--776.
[66]
Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined gestures for surface computing. In Proceedings of the international conference on Human factors in computing systems (CHI'09), 1083--1092.
[67]
Tinghao Wu, Renran Tian, and Vincent G. Duffy. 2012. Performing Ergonomics Analyses through Virtual Interactive Design: Validity and Reliability Assessment. Human Factors and Ergonomics in Manufacturing & Service Industries 22, 3: 256--268.
[68]
Denny Yu, A. M. Abdelrahman, E. H. Buckarma, et al. 2015. Mental and physical workloads in a competitive laparoscopic skills training environment: a pilot study. Proceedings of the human factors and ergonomics society annual meeting, SAGE Publications, 508--512.

Cited By

View all
  • (2024)TTool: A Supervised Artificial Intelligence-Assisted Visual Pose Detector for Tool Heads in Augmented Reality WoodworkingApplied Sciences10.3390/app1407301114:7(3011)Online publication date: 3-Apr-2024
  • (2024)A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative StudyProceedings of the 12th International Conference on Human-Agent Interaction10.1145/3687272.3688304(176-184)Online publication date: 24-Nov-2024
  • (2023)Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across DomainsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581420(1-24)Online publication date: 19-Apr-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction
Proceedings of the ACM on Human-Computer Interaction  Volume 2, Issue EICS
June 2018
293 pages
EISSN:2573-0142
DOI:10.1145/3233739
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 June 2018
Published in PACMHCI Volume 2, Issue EICS

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. digital human model
  2. gesture interfaces
  3. human factors and ergonomics
  4. virtual prototyping

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)52
  • Downloads (Last 6 weeks)11
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)TTool: A Supervised Artificial Intelligence-Assisted Visual Pose Detector for Tool Heads in Augmented Reality WoodworkingApplied Sciences10.3390/app1407301114:7(3011)Online publication date: 3-Apr-2024
  • (2024)A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative StudyProceedings of the 12th International Conference on Human-Agent Interaction10.1145/3687272.3688304(176-184)Online publication date: 24-Nov-2024
  • (2023)Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across DomainsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581420(1-24)Online publication date: 19-Apr-2023
  • (2023)Exploring Mid-Air Hand Interaction in Data VisualizationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.333264730:9(6347-6364)Online publication date: 14-Nov-2023
  • (2023)Evaluation of User Experience in Human–Robot Interaction: A Systematic Literature ReviewInternational Journal of Social Robotics10.1007/s12369-022-00957-z15:2(187-210)Online publication date: 6-Jan-2023
  • (2020)Understanding the Long-Term Evolution of Electric Taxi NetworksACM Transactions on Intelligent Systems and Technology10.1145/339367111:4(1-27)Online publication date: 28-May-2020
  • (2020)DeepKeyACM Transactions on Intelligent Systems and Technology10.1145/339361911:4(1-24)Online publication date: 31-May-2020
  • (2020)Domain-attention Conditional Wasserstein Distance for Multi-source Domain AdaptationACM Transactions on Intelligent Systems and Technology10.1145/339122911:4(1-19)Online publication date: 31-May-2020
  • (2020)CNN-based Multiple Manipulation Detector Using Frequency Domain Features of Image ResidualsACM Transactions on Intelligent Systems and Technology10.1145/338863411:4(1-26)Online publication date: 31-May-2020
  • (2020)Towards Effective Interface Designs for Collaborative HRI in ManufacturingACM Transactions on Human-Robot Interaction10.1145/33850099:4(1-55)Online publication date: 31-May-2020
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media