Abstract
Projection-based assistive systems have shown to be a promising technology to support workers during manual assembly processes in industrial manufacturing by projecting instructions into the working area. While existing studies have investigated various aspects of these systems, little research has been conducted regarding the way in which the user accesses the provided instructions. In this paper we analyze the eye movements of users during the repeated execution of an assembly task at a projection-based assistive system in order to gain insights into the utilization of the presented instructions. For this purpose, we analyzed eye tracking recordings from a user study with 15 participants to investigate the sequences in which the respective instructions are observed by the users. The results show a significantly lower number of nonlinear gaze sequences as well as a significantly higher number of steps without observing the instructions during the repeated use of the assistive system. In addition, there was a significantly lower task completion time during repeated use of the assistive system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bannat, A., et al.: Towards optimal worker assistance: a framework for adaptive selection and presentation of assembly instructions. In: Proceedings of the 1st International Workshop On Cognition for Technical Systems, Cotesys (2008)
Büttner, S., Funk, M., Sand, O., Röcker, C.: Using head-mounted displays and in-situ projection for assistive systems: a comparison. In: Proceedings of the 9th ACM International Conference on Pervasive Technologies Related to Assistive Environments, p. 44. ACM (2016)
Büttner, S., Mucha, H., Robert, S., Hellweg, F., Röcker, C.: HCI in der SmartFactoryOWL-Angewandte Forschung & Entwicklung. Mensch und Computer 2017-Workshopband (2017)
Büttner, S., Prilla, M., Röcker, C.: Augmented reality training for industrial assembly work - are projection-based AR assistive systems an appropriate tool for assembly training? In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (forthcoming) CHI 2020. ACM, New York (2020)
Büttner, S., et al.: The design space of augmented and virtual reality applications for assistive environments in manufacturing: a visual approach. 06 2017. https://doi.org/10.1145/3056540.3076193
Duchowski, A.T.: A breadth-first survey of eye-tracking applications. Behav. Res. Methods Instrum. Comput. 34(4), 455–470 (2002). https://doi.org/10.3758/BF03195475
Fellmann, M., Robert, S., Büttner, S., Mucha, H., Röcker, C.: Towards a framework for assistance systems to support work processes in smart factories. In: Holzinger, A., Kieseberg, P., Tjoa, A.M., Weippl, E. (eds.) CD-MAKE 2017. LNCS, vol. 10410, pp. 59–68. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66808-6_5
Funk, M., Bächler, A., Bächler, L., Kosch, T., Heidenreich, T., Schmidt, A.: Working with augmented reality?: a long-term analysis of in-situ instructions at the assembly workplace. In: Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments, pp. 222–229. ACM (2017)
Funk, M., Dingler, T., Cooper, J., Schmidt, A.: Stop helping me-i’m bored!: why assembly assistance needs to be adaptive. In: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers, pp. 1269–1273. ACM (2015)
Funk, M., Kosch, T., Kettner, R., Korn, O., Schmidt, A.: motioneap: An overview of 4 years of combining industrial assembly with augmented reality for industry 4.0. In: Proceedings of the 16th international conference on knowledge technologies and datadriven business, p. 4 (2016)
Funk, M., Kosch, T., Schmidt, A.: Interactive worker assistance: comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 934–939. ACM (2016)
Funk, M., Lischke, L., Mayer, S., Shirazi, A.S., Schmidt, A.: Teach me how! interactive assembly instructions using demonstration and in-situ projection. In: Huber, J., Shilkrot, R., Maes, P., Nanayakkara, S. (eds.) Assistive Augmentation. Cognitive Science and Technology, pp. 49–73. Springer, Singapore (2018). https://doi.org/10.1007/978-981-10-6404-3_4
Georgel, P.: Is there a reality in industrial augmented reality?, pp. 201–210, 10 2011. https://doi.org/10.1109/ISMAR.2011.6092387
Goldberg, J., Kotval, X.: Computer interface evaluation using eye movements: methods and constructs. Int. J. Ind. Ergon. 24, 631–645 (1999). https://doi.org/10.1016/S0169-8141(98)00068-7
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye tracking: a comprehensive guide to methods and measures. OUP Oxford (2011)
Huber, M., Knoll, A., Brandt, T., Glasauer, S.: When to assist?-modelling human behaviour for hybrid assembly systems. In: ISR 2010 41st International Symposium on Robotics and ROBOTIK 2010 6th German Conference on Robotics, pp. 1–6. VDE (2010)
Korn, O., Funk, M., Abele, S., Hörz, T., Schmidt, A.: Context-aware assistive systems at the workplace: analyzing the effects of projection and gamification. In: Proceedings of the 7th International Conference on Pervasive Technologies Related to Assistive Environments, p. 38. ACM (2014)
Korn, O., Schmidt, A., Hörz, T.: Augmented manufacturing: a study with impaired persons on assistive systems using in-situ projection. In: Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments, p. 21. ACM (2013)
Kosch, T., Abdelrahman, Y., Funk, M., Schmidt, A.: One size does not fit all: challenges of providing interactive worker assistance in industrial settings. In: Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers, pp. 1006–1011. ACM (2017)
Kosch, T., Kettner, R., Funk, M., Schmidt, A.: Comparing tactile, auditory, and visual assembly error-feedback for workers with cognitive impairments. In: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 53–60. ACM (2016)
Lušić, M., Fischer, C., Braz, K.S., Alam, M., Hornfeck, R., Franke, J.: Static versus dynamic provision of worker information in manual assembly: a comparative study using eye tracking to investigate the impact on productivity and added value based on industrial case examples. Procedia CIRP 57, 504–509 (2016)
Sand, O., Büttner, S., Paelke, V., Röcker, C.: smARt.assembly – projection-based augmented reality for supporting assembly workers. In: Lackey, S., Shumaker, R. (eds.) VAMR 2016. LNCS, vol. 9740, pp. 643–652. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-39907-2_61
Stoessel, C., Wiesbeck, M., Stork, S., Zaeh, M.F., Schuboe, A.: Towards optimal worker assistance: investigating cognitive processes in manual assembly. In: Mitsuishi, M., Ueda, K., Kimura, F. (eds.) Manufacturing Systems and Technologies for the New Frontier, pp. 245–250. Springer, London (2008). https://doi.org/10.1007/978-1-84800-267-8_50
Acknowledgement
This work was partly funded by the German Federal Ministry of Education and Research (BMBF) under grand number 13FH110PX6.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Heinz, M., Büttner, S., Röcker, C. (2020). Exploring Users’ Eye Movements When Using Projection-Based Assembly Assistive Systems. In: Streitz, N., Konomi, S. (eds) Distributed, Ambient and Pervasive Interactions. HCII 2020. Lecture Notes in Computer Science(), vol 12203. Springer, Cham. https://doi.org/10.1007/978-3-030-50344-4_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-50344-4_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-50343-7
Online ISBN: 978-3-030-50344-4
eBook Packages: Computer ScienceComputer Science (R0)