Abstract
The quality of pilot decision making remains a significant determinant of recent aviation incidents and accidents. With the development of haptic stick inputs pilots have additional sensory cues to aid in the decision making process. Limited experimental research has investigated the impact of directional haptic cues, delivered via side stick devices, on user performance and subjective workload. The current experiment examines the performance and workload benefits granted by augmenting a visual dual-task with haptic information in a sample of eleven participants. The current visual dual-task experiment consisted of 1) a primary manual error cancellation tracking task and 2) a secondary visuospatial memory N-back task. The haptic implementation in the current study involved the provision of corrective directional “nudges” on the tracking task, conditionally delivered when participants breached a prescribed error margin.
The primary finding was that haptic feedback on the tracking task improved visuospatial memory performance on the secondary N-back task. Importantly, no increase in workload was reported in tandem with the observed visuospatial memory enhancement offered by the haptic cues. Future research should review the impacts of randomizing the signal speed as seen in turbulence situations and changes to peripheral ranges with performance of eye time on task.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alaimo, S.M.C., Pollini, L., Bresciani, J.P., Bülthoff, H.H.: A comparison of direct and indirect haptic aiding for remotely piloted vehicles. Proc. - IEEE Int. Workshop Robot Hum. Interact. Commun. 506–512 (2010). https://doi.org/10.1109/ROMAN.2010.5598647
Blundell, J., et al.: Low-visibility commercial ground operations: an objective and subjective evaluation of a multimodal display. Aeronaut. J. 127(1310), 581–603 (2023). https://doi.org/10.1017/aer.2022.81
Brainard, D.H.: The Psychophysics Toolbox. Spatial Vision 10 (1997)
de Stigter, S., Mulder, M., van Paassen, M.M.: Design and evaluation of a haptic flight director. J. Guid. Control. Dyn. 30(1), 35–46 (2007). https://doi.org/10.2514/1.20593
Drop, F.M., de Vries, R., Mulder, M., Bülthoff, H.H.: The predictability of a target signal affects manual feedforward control. IFAC-PapersOnLine 49(19), 177–182 (2016). https://doi.org/10.1016/J.IFACOL.2016.10.482
Ellerbroek, J., Martin, M.J.M.R., Lombaerts, T., van Paassen, M.M., Mulder, M.: Design and evaluation of a flight envelope protection haptic feedback system. IFAC-PapersOnLine 49(19), 171–176 (2016). https://doi.org/10.1016/j.ifacol.2016.10.481
Graziotin, D., Wang, X., Abrahamsson, P.: Do feelings matter? on the correlation of affects and the self-assessed productivity in software engineering. J. Softw.: Evol. Process 27(7), 467–487 (2015). https://doi.org/10.1002/smr.1673
Gueorguieva, R., Krystal, J.H.: Move over ANOVA: progress in analyzing repeated-measures data and its reflection in papers published in the archives of general psychiatry. Arch. Gen. Psych. 61(3), 310–317 (2004). https://doi.org/10.1001/archpsyc.61.3.310
Hart, S.G.: NASA-TASK LOAD INDEX ( NASA-TLX ). Years Later. 20, 904–908 (2006)
Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research sandra. Adv. Psychol. 52(Human Mental Workload), 139–183 (1988)
Ho, C., Tan, H.Z., Spence, C.: Using spatial vibrotactile cues to direct visual attention in driving scenes. Transp. Res. F: Traffic Psychol. Behav. 8(6), 397–412 (2005). https://doi.org/10.1016/j.trf.2005.05.002
Kane, M.J., Conway, A.R.A., Miura, T.K., Colflesh, G.J.H.: Working memory, attention control, and the N-back task: a question of construct validity. J. Exp. Psychol. Learn. Mem. Cogn. 33(3), 615–622 (2007). https://doi.org/10.1037/0278-7393.33.3.615
Laird, N.M., Ware, J.H.: Random-effects models for longitudinal data. Biometrics 38(4), 963–974 (1982). https://doi.org/10.2307/2529876
Lam, T.M., Boschloo, H.W., Mulder, M., van Paassen, M.M., van der Helm, F.C.T.: Effect of haptic feedback in a trajectory following task with an unmanned aerial vehicle. Conf. Proc. - IEEE Int. Conf. Syst. Man Cybern. 3, 2500–2506 (2004). https://doi.org/10.1109/ICSMC.2004.1400705
Olivari, M., Nieuwenhuizen, F.M., Venrooij, J., Bülthoff, H. H., Pollini, L.: Multi-loop pilot behaviour identification in response to simultaneous visual and haptic stimuli. In: AIAA Modeling and Simulation Technologies Conference 2012, August, 1–23 (2012). https://doi.org/10.2514/6.2012-4795
Orasanu, J.M.: Decision-making in the Cockpit. In: Harris, D., Harris, D., Li, W.-C. (eds.) Decision Making in Aviation, pp. 103–138. Routledge (2017). https://doi.org/10.4324/9781315095080-6
Repperger, D.W., Haas, M.W., Brickman, B.J., Hettinger, L.J., Lu, L., Roe, M.M.: Design of a haptic interface as a pilot’s assistant in a high turbulance task environment. Perceptual Motor Skills 85, 1139–1154 (1997)
Schutte, P., Goodrich, K., Williams, R.: Towards an Improved Pilot-Vehicle Interface for Highly Automated Aircraft : Evaluation of the Haptic Flight Control System. In: Advances in Human Aspects of Aviation (Advances in Human Factors and Ergonomics Series), pp. 2524–2533 (2012)
Sklar, A.E., Sarter, N.B.: Good vibrations: tactile feedback in support of attention allocation and human-automation coordination in event-driven domains. Hum. Factors 41(4), 543–552 (1999). https://doi.org/10.1518/001872099779656716
The MathWorks Inc. (2021). MATLAB (MATLAB 2021b)
van Baelen, D., Ellerbroek, J., van Paassen, M.M.R., Mulder, M.: Evaluation of a haptic feedback system for flight envelope protection. In: AIAA Scitech 2019 Forum (2019). https://doi.org/10.2514/6.2019-0367
van Baelen, D., van Paassen, M.M., Ellerbroek, J., Abbink, D.A., Mulder, M.: Flying by feeling: communicating flight envelope protection through haptic feedback. Int. J. Human-Comput. Interact. 00(00), 1–11 (2021). https://doi.org/10.1080/10447318.2021.1890489
Wickens, C.D.: Multiple resources and performance prediction. Theor. Issues Ergon. Sci. 3(2), 159–177 (2002). https://doi.org/10.1080/14639220210123806
Wickens, C.D.: Multiple resources and mental workload. Hum. Factors 50(3), 449–455 (2008). https://doi.org/10.1518/001872008X288394
Winter, B., Grawunder, S.: The phonetic profile of Korean formal and informal speech registers. J. Phon. 40, 808–815 (2012). https://doi.org/10.1016/j.wocn.2010.11.010
Acknowledgements
This paper is based on work performed in the Open Flight Deck project, which has received funding from the ATI Programme, a joint government and industry investment to maintain and grow the UK’s competitive position in civil aerospace design and manufacture. The programme, delivered through a partnership between the Aerospace Technology Institute (ATI), Department for Business, Energy & Industrial Strategy (BEIS) and Innovate UK, addresses technology, capability and supply chain challenges.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Collins, C., Blundell, J., Huddlestone, J., Harris, D. (2023). A Helping Hand: Benefits of Primary Task Haptic Augmentation on Secondary Visuospatial Task Performance. In: Kurosu, M., et al. HCI International 2023 – Late Breaking Papers. HCII 2023. Lecture Notes in Computer Science, vol 14054. Springer, Cham. https://doi.org/10.1007/978-3-031-48038-6_22
Download citation
DOI: https://doi.org/10.1007/978-3-031-48038-6_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-48037-9
Online ISBN: 978-3-031-48038-6
eBook Packages: Computer ScienceComputer Science (R0)