Skip to main content

I Perform My Work with My Body Too: Integrating Body Representations in and with Task Models

  • Conference paper
  • First Online:
Human-Computer Interaction – INTERACT 2023 (INTERACT 2023)

Abstract

Complete and unambiguous descriptions of user tasks is a cornerstone of user centered design approaches as they provide a unique way of describing precisely and entirely users’ actions that have to be performed in order for them to reach their goals and perform their work. Three key challenges in describing these user tasks lay in the quantity and type of information to embed, the level of details of the type of actions and the level of refinement in the hierarchy of tasks. For “standard” interactions, such as performing work using desktop-like interactive applications, several notations have been proposed and make explicit how to address these challenges. Interactions on the move raise additional issues as physical movement of the operator have to be accounted for and described. Currently no task notation is able to describe adequately users’ movements making it impossible to reason about quantity of movement to perform a task and about the issues for performing incorrect movements. This paper extends current knowledge and practice in tasks modelling taking into account in a systematic manner users’ movements and more precisely body parts, body size, range of motion, articulations and position of body parts relatively to objects in the environment. Through two different case studies we show the importance of adding those elements to describe and analyze users’ work and tasks when users perform physical interactions. We also demonstrate that such models are of prime importance to reason about quantity of movements, muscular fatigue and safety.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. ARP4754, Aerospace Recommended Practice (ARP) ARP4754A (Guidelines for Development of Civil Aircraft and Systems) (2010). https://www.sae.org/standards/content/arp4754a/

  2. AAIB, Accident report AAIB AAR 4/1990. Kegworth accident, report available here. https://reports.aviation-safety.net/1989/19890108-0_B734_G-OBME.pdf

  3. Andrews A.W., Bohannon, R.W.: Decreased shoulder range of motion on paretic side after stroke. Phys. Ther. 69(9), 768–772 (1989). https://doi.org/10.1093/ptj/69.9.768

  4. Anett, J.: Hierarchical task analysis. In: Dan, D., Neville, S. (eds.) The Handbook of Task Analysis for Human-Computer Interaction, pp. 67–82. Lawrence Erlbaum Associates (2004)

    Google Scholar 

  5. Ahlberg, A., Moussa, M., Al-Nahdi, M.: On geographical variations in the normal range of joint motion. Clin. Orthop. Relat. Res. 234, 229–231 (1988)

    Article  Google Scholar 

  6. Aristidou, A., Lasenby, J., Chrysanthou, Y., Shamir, A.: Inverse kinematics techniques in computer graphics: a survey. Comput. Graph. Forum 37(6), 35–58 (2017).https://doi.org/10.1111/cgf.13310

  7. Berretti, S., Daoudi, M., Turaga, P., Basu, A:. Representation, analysis, and recognition of 3D humans. ACM Trans. Multimedia Comput. Commun. Appl. 14(1), 1–36 (2018). https://doi.org/10.1145/3182179

  8. Goguey, A., Nancel, M., Casiez, G., Vogel, D.: The performance and preference of different fingers and chords for pointing, dragging, and object transformation. In: Proceedings of CHI 2016, 34th Conference on Human Factors in Computing Systems, May 2016, San Jose, United States, pp. 4250–4261 (2016). https://doi.org/10.1145/2858036.2858194

  9. Cheng, L.-P., Marwecki, S., Baudisch, P.: Mutual human actuation. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST 2017), pp. 797–805. ACM (2017). https://doi.org/10.1145/3126594.3126667

  10. Airbus. Flight Crew Operating Manual A318/A319/A320/A321 FMGS Pilot’s Guide Vol 4 (2005). https://www.avialogs.com/aircraft-a/airbus/item/1004-flight-crew-operating-manual-a318-a319-a320-a321-fmgs-pilot-s-guide-vol-4

  11. Barbé, J., Chatrenet, N., Mollard, R., Wolff, M., Bérard, P.: Physical ergonomics approach for touch screen interaction in an aircraft cockpit. In: Proceedings of the 2012 Conference on Ergonomie et Interaction Homme-Machine (Ergo'IHM 201212), pp. 9–16. Association for Computing Machinery, New York (2012)

    Google Scholar 

  12. Caffiau, S., Scapin, D., Girard, P., Baron, M., Jambon, F.: Increasing the expressive power of task analysis: systematic comparison and empirical assessment of tool-supported task models. Interact. Comput. 22(6), 569–593 (2010)

    Article  Google Scholar 

  13. Diaper, D.: Understanding task analysis for human-computer interaction. In: The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates (2004)

    Google Scholar 

  14. Eardley, R., Roudaut, A., Gill, S., Thompson, S.J.: Designing for multiple hand grips and body postures within the UX of a moving smartphone. In: Proceedings of the 2018 Designing Interactive Systems Conference (DIS 2018), pp. 611–621. Association for Computing Machinery, New York (2018)

    Google Scholar 

  15. Fahssi, R., Martinie, C., Palanque, P.: Embedding explicit representation of cyber-physical elements in task models. In: 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE (2016)

    Google Scholar 

  16. Lee, B., Jin, T., Lee, S.H., Saakes, D.: SmartManikin: virtual humans with agency for design tools. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI 2019, pp. 1–13. Association for Computing Machinery, New York (2019)

    Google Scholar 

  17. Grainger, K., Dodson, Z., Korff, T.: Predicting bicycle setup for children based on anthropometrics and comfort. Appl. Ergon. 59, 449–459 (2017)

    Article  Google Scholar 

  18. Gurses, A.P., et al.: Human factors–based risk analysis to improve the safety of doffing enhanced personal protective equipment. Infect. Control Hosp. Epidemiol. 40(2), 178–186 (2019)

    Google Scholar 

  19. HAMSTERS-XLE, ICS Tools. https://www.irit.fr/ICS/tools/. Accessed January 2023

  20. Jacobsen, N.E., Hertzum, M., John, B.E.: The evaluator effect in usability studies: problem detection and severity judgments. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 42(19), 1336–1340 (1998)

    Article  Google Scholar 

  21. Intolo, P., Milosavljevic, S., Baxter, D.G., Carman, A.B., Pal, P., Munn, J.: The effect of age on lumbar range of motion: a systematic review. Man. Ther. 14(6), 596–604 (2009). https://doi.org/10.1016/j.math.2009.08.006

  22. Johnson, P., Johnson, H., Hamilton, F.: Getting the knowledge into HCI: theoretical and practical aspects of task knowledge structures. In: Schraagen, J., Chipman, S., Shalin, V. (eds.) Cognitive Task Analysis. LEA (2000)

    Google Scholar 

  23. König, J.L., Hinze, A., Bowen, J.: Workload categorization for hazardous industries: the semantic modelling of multi-modal physiological data. Future Gener. Comput. Syst. 141, 369–381 (2023)

    Article  Google Scholar 

  24. Karhu, O., Kansi, P., Kuorinka, I.: Correcting working postures in industry: a practical method for analysis. Appl. Ergon. 8, 199–201 (1977). https://doi.org/10.1016/0003-6870(77)90164-8

    Article  Google Scholar 

  25. Martinie, C., Palanque, P., Barboni, E.: Principles of task analysis and modeling: understanding activity, modeling tasks, and analyzing models. In: Vanderdonckt, J., Palanque, P., Winckler, M. (eds.) Handbook of Human Computer Interaction. Springer, Cham (2022). https://doi.org/10.1007/978-3-319-27648-9_57-1

  26. Martinie, C., Palanque, P., Bouzekri, E., Cockburn, A., Canny, A., Barboni, E.: Analysing and demonstrating tool-supported customizable task notations. PACM Hum. Comput. Interact. 3(EICS), 26 (2019). Article no. 12

    Google Scholar 

  27. Martinie, C., Palanque, P., Ragosta, M., Fahssi, R.: Extending procedural task models by systematic explicit integration of objects, knowledge and information. In: Proceedings of the 31st European Conference on Cognitive Ergonomics (ECCE 2013), pp. 1–10. ACM (2013). Article no. 23. https://doi.org/10.1145/2501907.2501954

  28. McAtamney, L., Nigel Corlett, E.: RULA: a survey method for the investigation of work-related upper limb disorders. Appl. Ergon. 24, 91–99 (1993). https://doi.org/10.1016/0003-6870(93)90080-s

    Article  Google Scholar 

  29. Norkin, C.C., White, D.J.: Measurement of Joint Motion: A Guide to Goniometry, 5th edn. FA Davis Co, Philadelphia (2016)

    Google Scholar 

  30. Parkinson, M., Reed, M.: Virtual fit multivariate anthropometric tool. Hum. Factors Ergon. Soc. https://www.hfes.org/Publications/Technical-Standards#VFM. Accessed Jan 2023

  31. Paternò, F.: Task models in interactive software systems. In: Handbook of Software Engineering and Knowledge Engineering, vol. 1, pp. 1–19. World Scientific (2002)

    Google Scholar 

  32. Pheasant, S., Haslegrave, C.M.: Bodyspace, Anthropometry, Ergonomics and the Design of Work, 3rd edn. (2018). https://doi.org/10.1201/9781315375212

  33. Reese, C.D.: Accident/Incident Prevention Techniques, 2nd edn. CRC Press, Boca Raton (2011). https://doi.org/10.1201/b11390

  34. Reinhardt, J., Kurzweg, M., Wolf, K.: Virtual physical task training: comparing shared body, shared view and verbal task explanation. In: Augmented Humans Conference 2021 (Ahs 2021), pp. 157–168. Association for Computing Machinery, New York (2021)

    Google Scholar 

  35. Rohmert, W., Wangenheim, M., Mainzer, J., Zipp, P., Lesser, W.: A study stressing the need for a static postural force model for work analysis. Ergonomics 10, 1235–1249 (1986)

    Article  Google Scholar 

  36. Valls, J.A.F., Garrido, J.E., Plata, A.M., Penichet, V.M.R., Lozano, M.D.: 3D editor to define generic rehabilitation therapies as a source to monitor and guide patients. In: Proceedings of the 4th Workshop on ICTs for improving Patients Rehabilitation Research Techniques (REHAB 2016), pp. 93–96. Association for Computing Machinery, New York (2016). https://doi.org/10.1145/3051488.3051506

  37. Van der Veer, G.C., Lenting, V.F., Bergevoet, B.A.: GTA: groupware task analysis - modeling complexity. Acta Physiol. 91, 297–322 (1996)

    Google Scholar 

  38. Fahssi, R., Martinie, C., Palanque, P.: Enhanced task modelling for systematic identification and explicit representation of human errors. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015. LNCS, vol. 9299, pp. 192–212. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22723-8_16

  39. ISO 9241-11:2018(en) Ergonomics of human-system interaction — Part 11: Usability: Definitions and concepts. https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-2:v1:en

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Célia Martinie .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Carayon, A., Martinie, C., Palanque, P. (2023). I Perform My Work with My Body Too: Integrating Body Representations in and with Task Models. In: Abdelnour Nocera, J., Kristín Lárusdóttir, M., Petrie, H., Piccinno, A., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2023. INTERACT 2023. Lecture Notes in Computer Science, vol 14143. Springer, Cham. https://doi.org/10.1007/978-3-031-42283-6_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-42283-6_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-42282-9

  • Online ISBN: 978-3-031-42283-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics