Skip to main content

Vocal Guidance of Visual Gaze During an Automated Vehicle Handover Task

  • Conference paper
  • First Online:
Advances in Human Factors of Transportation (AHFE 2019)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 964))

Included in the following conference series:

Abstract

Our technological world is developing rapidly, and with it, the roles of automation are becoming increasingly safety critical. Automated vehicles that require human input when a design, geographical or capability boundary has been met require effective communication between driver and vehicle to ensure system safety. This paper explores the role of vocal communication in guiding visual gaze during the task of handing over control to a driver after being ‘out-of-the-loop’ for a set amount of time. This is with the intention of increasing driver awareness of the environment, and explore whether this method is effective in guiding this process. This study found that vocal guidance is highly correlated with visual gaze towards the visual information streams that display information relevant to a vocal cue, indicating that designers could consider the vocal approach alongside head-up interface aides as a means of raising situation awareness during transitions of control.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Statista: Revenues from the artificial intelligence (AI) market worldwide from 2016 to 2025 (in million U.S. dollars) (2019). https://www.statista.com/statistics/607716/worldwide-artificial-intelligence-market-revenues/

  2. Klein, G., Feltovich, P.J., Bradshaw, J.M., Woods, D.D.: Common ground and coordination in joint activity. Organ. Simul. 53, 139–184 (2005)

    Article  Google Scholar 

  3. Klien, G., Woods, D.D., Bradshaw, J.M., Hoffman, R.R., Feltovich, P.J.: Ten challenges for making automation a “team player” in joint human-agent activity. IEEE Intell. Syst. 19(6), 91–95 (2004)

    Article  Google Scholar 

  4. Cunningham, M., Regan, M.A.: Autonomous vehicles: human factors issues and future research. In: Proceedings of the 2015 Australasian Road Safety Conference, Australasian College of Road Safety, Gold Coast, Australia, October 2015

    Google Scholar 

  5. Lee, J.D., See, K.A.: Trust in automation: designing for appropriate reliance. Hum. Factors 46(1), 50–80 (2004)

    Article  Google Scholar 

  6. Park, J.H., McKilligan, S.: A systematic literature review for human-computer interaction and design thinking process integration. In: Design, User Experience, and Usability: Theory and Practice, pp. 725–740. Springer, New York (2018)

    Chapter  Google Scholar 

  7. Stevens, B.L., Lewis, F.L.: Aircraft Control and Simulation. Wiley, Hoboken (2003)

    Google Scholar 

  8. Endsley, M.R., Kiris, E.O.: The out-of-the-loop performance problem and level of control in automation. Hum. Factors 37(2), 381–394 (1995)

    Article  Google Scholar 

  9. Audi: Audi AI traffic jam pilot (2018). https://www.audi-technology-portal.de/en/electrics-electronics/driver-assistant-systems/audi-a8-audi-ai-traffic-jam-pilot. Accessed 19 Jan 2019

  10. SAE On-road Automated Vehicles Standards Committee: Taxonomy and definitions for terms related to on-road motor vehicle automated driving systems (2016). http://standards.sae.org/j3016_201401/. Accessed 19 Jan 2019

  11. De Winter, J.C., Happee, R., Martens, M.H., Stanton, N.A.: Effects of adaptive cruise control and highly automated driving on workload and situation awareness: a review of the empirical evidence. Transp. Res. Part F Traffic Psychol. Behav. 27, 196–217 (2014)

    Article  Google Scholar 

  12. McCall, R., McGee, F., Meschtscherjakov, A., Louveton, N., Engel, T.: Towards a taxonomy of autonomous vehicle handover situations. In: Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 193–200. ACM, October 2016

    Google Scholar 

  13. Clark, J.R., Stanton, N.A., Revell, K.M.A.: Conditionally and highly automated vehicle handover: a study exploring vocal communication between two drivers. Transp. Res. Part F Psychol. Behav. (2018, in press). https://doi.org/10.1016/j.trf.2018.06.008

  14. Eriksson, A., Stanton, N.A.: Driving performance after self-regulated control transitions in highly automated vehicles. Hum. Factors 59(8), 1233–1248 (2017)

    Article  Google Scholar 

  15. Stanton, N.A., Stewart, R., Harris, D., Houghton, R.J., Baber, C., McMaster, R., Linsell, M.: Distributed situation awareness in dynamic systems: theoretical development and application of an ergonomics methodology. Ergonomics 49(12–13), 1288–1311 (2006). https://doi.org/10.1080/00140130600612762

    Article  Google Scholar 

  16. Sorensen, L.J., Stanton, N.A.: Keeping it together: the role of transactional situation awareness in team performance. Int. J. Ind. Ergon. 53, 267–273 (2016). https://doi.org/10.1016/j.ergon.2016.02.007

    Article  Google Scholar 

  17. Cohen, M.D., Hilligoss, B., Amaral, A.C.K.-B.: A handoff is not a telegram: an understanding of the patient is co-constructed. Crit. Care 16(1), 303 (2012). https://doi.org/10.1186/cc10536

    Article  Google Scholar 

  18. Patterson, E.S., Roth, E.M., Woods, D.D., Chow, R., Gomes, J.O.: Handoff strategies in settings with high consequences for failure: lessons for health care operations. Int. J. Qual. Health Care 16(2), 125–132 (2004). https://doi.org/10.1093/intqhc/mzh026

    Article  Google Scholar 

  19. Walch, M., Mühl, K., Kraus, J., Stoll, T., Baumann, M., Weber, M.: From car-driver-handovers to cooperative interfaces: visions for driver–vehicle interaction in automated driving. In: Automotive User Interfaces, pp. 273–294. Springer, Berlin (2017). https://doi.org/10.1007/978-3-319-49448-7_10

    Chapter  Google Scholar 

  20. Petermeijer, S., Bazilinskyy, P., Bengler, K., de Winter, J.: Take-over again: investigating multimodal and directional TORs to get the driver back into the loop. Appl. Ergon. 62, 204–215 (2017). https://doi.org/10.1016/j.apergo.2017.02.023

    Article  Google Scholar 

  21. Clark, J., Stanton, N., Revell, K.: Handover assist trials in highly automated vehicles: participant recommendations for future design. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting. SAGE Publications, Thousand Oaks (2018)

    Google Scholar 

  22. Morgan, P., Alford, C., Parkhurst, G.: Handover issues in autonomous driving: a literature review. Project Report. University of the West of England, Bristol (2016). http://eprints.uwe.ac.uk/29167

  23. Young, M.S., Stanton, N.A., Harris, D.: Driving automation: learning from aviation about design philosophies. Int. J. Veh. Des. 45(3), 323–338 (2007)

    Article  Google Scholar 

  24. Owsley, C., McGwin Jr., G.: Vision and driving. Vision Res. 50(23), 2348–2361 (2010)

    Article  Google Scholar 

  25. De Winter, J.C.F., Eisma, Y.B., Cabrall, C.D.D., Hancock, P.A., Stanton, N.A.: Situation awareness based on eye movements in relation to the task environment. Cogn. Technol. Work 1–13 (2018)

    Google Scholar 

  26. Brennan, S.E., Clark, H.H.: Conceptual pacts and lexical choice in conversation. J. Exp. Psychol. Learn. Memory Cogn. 22(6), 1482–1493 (1996)

    Article  Google Scholar 

  27. Coco, M.I., Dale, R., Keller, F.: Performance in a collaborative search task: the role of feed-back and alignment. Top. Cogn. Sci. 10, 55–79 (2017)

    Article  Google Scholar 

  28. Garrod, S., Anderson, A.: Saying what you mean in dialogue: a study in conceptual and semantic co-ordination. Cognition 27(2), 181–218 (1987)

    Article  Google Scholar 

  29. Garrod, S., Pickering, M.J.: Joint action, interactive alignment, and dialog. Top. Cogn. Sci. 1(2), 1233–1248 (2009)

    Article  Google Scholar 

  30. Clark, J., Stanton, N., Revell, K.: Handover assist in highly automated vehicles: how vocal communication guides visual attention. In: International Conference on Applied Human Factors and Ergonomics, pp. 295–306. Springer, Cham (2018)

    Google Scholar 

  31. Stanton, N.A.: Response to: automated vehicles in Ingenia, article 62 (2015). https://www.ingenia.org.uk/Ingenia/Articles/44463494-cfd0-416a-b4a4-9e9e7b67df94. Accessed 10 Jan 2019

Download references

Acknowledgements

This work was supported by Jaguar Land Rover and the UK-EPSRC grant EP/N011899/1 as part of the jointly funded Towards Autonomy: Smart and Connected Control (TASCC) Programme.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jediah R. Clark .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Clark, J.R., Stanton, N.A., Revell, K.M.A. (2020). Vocal Guidance of Visual Gaze During an Automated Vehicle Handover Task. In: Stanton, N. (eds) Advances in Human Factors of Transportation. AHFE 2019. Advances in Intelligent Systems and Computing, vol 964. Springer, Cham. https://doi.org/10.1007/978-3-030-20503-4_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-20503-4_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-20502-7

  • Online ISBN: 978-3-030-20503-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics