Abstract
Previous studies have compared different multimodal warning types, however, few researchers studied the effects of different multimodal warning types on drivers’ task performance, physiological data, and user experience. In our research, we designed a simulated driving experiment to investigate these effects. In the experiment, a small projector, two Bluetooth speakers and two vibration generators were used as signal generators to simulate 6 multimodal warning types, and Mean Deviation, braking reaction time (BRT), normalized GSR, normalized HR, trust, annoyance, satisfaction were used as dependent variables to reflect effects of multimodal warning types on driver’s task performance, physiological data and user experience. The main conclusions are drawn in this paper as following: (1) In terms of task performance, there was no significant difference in the effect of different multimodal warning types on driving tasks, but compared with unimodal warning types, both bimodal warning types and trimodal warning type can reduce BRT. (2) In terms of physiological data, normalized GSR and normalized HR were increased by increasing numbers of modalities of warning types. (3) In terms of user experience, trust and satisfaction of multimodal warning types were significantly higher than the other two unimodal warning types. Moreover, the annoyance of warning types which included tactile modality were significantly higher than the warning types which did not included. We speculated that adding tactile signals may increase annoyance of participants, nevertheless, tactile signals still has great potential to increase the trust and satisfaction of multimodal warning types.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kaizuka, T., Nakano, K.: Effects of urgency of audiovisual collision warnings on response time and accuracy of steering. Int. J. Intell. Transp. Syst. Res. 18(1), 90–97 (2018). https://doi.org/10.1007/s13177-018-0174-6
Meng, F., Spence, C.: Tactile warning signals for in-vehicle systems. Accid. Anal. Prev. 75, 333–346 (2015)
Lundqvist, L.M., Eriksson, L.: Age, cognitive load, and multimodal effects on driver response to directional warning. Appl. Ergon. 76, 147–154 (2019)
Politis, I., Brewster, S., Pollick, F.: Evaluating multimodal driver displays of varying urgency. In: Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 92–99 (2013)
Villalobos-Zúñiga, G., Kujala, T., Oulasvirta, A.: T9+ HUD: physical keypad and HUD can improve driving performance while typing and driving. In: Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 177–184 (2016)
Mcgee-Lennon, M.R., Wolters, M., Mcbryan, T.: Audio reminders in the home environment. In: 13th International Conference on Auditory Display on Proceedings, Montreal, Canada, pp. 437–444 (2007)
Watson, T., Cech, L., Eßers, S.: A driving simulator HMI study comparing a steering wheel mounted display to HUD, Instrument Panel and Center Stack Displays for Advanced Driver Assistance Systems and Warnings. SAE Technical Paper (2010)
Liu, Y.C.: Comparative Study of the effects of auditory, visual and multimodality displays on drivers’ performance in advanced traveller information systems. Ergonomics 44(4), 425–442 (2001)
Green, P., Wei, H.L.: The rapid development of user interfaces: experience with the wizard of OZ method. In: Human Factors & Ergonomics Society Annual Meeting Proceedings, vol. 29, no. 5, pp. 470–474 (1985)
Häuslschmid, R., Menrad, B., Butz, A.: Freehand vs. micro gestures in the car: driving performance and user experience. In: 2015 IEEE Symposium on 3D User Interfaces (3DUI), pp. 159–160. IEEE (2015)
Merenda, C., Kim, H., Gabbard, J.L., et al.: Did you see me? Assessing perceptual vs. real driving gains across multi-modal pedestrian alert systems. In: Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 40–49 (2017)
Mehler, B., Reimer, B., Coughlin, J.F., et al.: Impact of incremental increases in cognitive workload on physiological arousal and performance in young adult drivers. Transp. Res. Rec. 2138(1), 6–12 (2009)
Forne, M.: Physiology as a tool for UX and usability testing. School of Computer Science and Communication, Master. Royal Institute of Technology, Stockholm (2012)
Yao, L., Liu, Y., Li, W., Zhou, L., Ge, Y., Chai, J., Sun, X.: Using physiological measures to evaluate user experience of mobile applications. In: Harris, D. (ed.) EPCE 2014. LNCS (LNAI), vol. 8532, pp. 301–310. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07515-0_31
Lohani, M., Payne, B.R., Strayer, D.L.: A review of psychophysiological measures to assess cognitive states in real-world driving. Front. Human Neurosci. 13, 57 (2019)
Ward, R.D., Marsden, P.H.: Physiological responses to different WEB page designs. Int. J. Human-Comput. Stud. 59(1–2), 199–212 (2003)
Acknowledgement
This work was funded by Hunan innovative province construction project: R & D and application demonstration of key technologies of intelligent minitype fire emergency station 2020SK2094.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, Y., Tan, H. (2021). Effects of Multimodal Warning Types on Driver’s Task Performance, Physiological Data and User Experience. In: Rau, PL.P. (eds) Cross-Cultural Design. Applications in Cultural Heritage, Tourism, Autonomous Vehicles, and Intelligent Agents. HCII 2021. Lecture Notes in Computer Science(), vol 12773. Springer, Cham. https://doi.org/10.1007/978-3-030-77080-8_25
Download citation
DOI: https://doi.org/10.1007/978-3-030-77080-8_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-77079-2
Online ISBN: 978-3-030-77080-8
eBook Packages: Computer ScienceComputer Science (R0)