Skip to main content
SpringerLink
Log in
Book cover

International Conference on Human-Computer Interaction

HCII 2021: HCI in Mobility, Transport, and Automotive Systems pp 351–364Cite as

Interactive Framework of Cooperative Interface for Collaborative Driving

  • Conference paper
  • First Online:

  • 1957 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12791))

Abstract

Automobile intelligence improves the perception and decision-making capabilities of cars. This change of technology makes human and machine a joint cognitive and decision-making system, consequently changing the paradigm of human-machine interaction. The machine is no longer a mere tool but a team partner. Both academia and industry are actively investigating human-machine cooperative driving, such as take over, shared control and cooperative driving. However, currently, there is no cooperative driving framework that considers the cognitive characteristics of the interaction between humans and agents. We propose a cooperative interface interaction framework based on human-machine team cognitive information elements that need to be exchanged by both parties in cooperative driving, such as intention, situation awareness, prediction, and their impact on driving tasks. The proposed framework can provide a cognitive dimension for cooperative driving research, which can be used as a reference for the design of interaction in highly automated vehicles.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Kyriakidis, M., Weijer, C.V.D., Arem, B.V., Happee, R.: The deployment of advanced driver assistance systems in Europe. In: ITS World Congress 2015 Proceedings. SSRN, Bordeaux, France (2015). https://doi.org/10.2139/ssrn.2559034

  2. Norman, D.A.: Cognitive artifacts. In: Carroll, J.M. (ed.) Designing Interaction: Psychology at the Human–Computer Interface, pp. 17–38. Cambridge University Press, Cambridge (1992)

    Google Scholar 

  3. Saffarian, M., de Winter, J.C., Happee, R.: Automated driving: human-factors issues and design solutions. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 56, no. 1, pp. 2296–2300. Sage, Los Angeles (2012)

    Google Scholar 

  4. Strand, N., Nilsson, J., Karlsson, I.M., Nilsson, L.: Semi-automated versus highly automated driving in critical situations caused by automation failures. Transp. Res. Part F Traffic Psychol. Behav. 27, 218–228 (2014)

    Article  Google Scholar 

  5. SAE: Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles. Standard J3016_201609. SAE International (2016)

    Google Scholar 

  6. Walch, M., Sieber, T., Hock, P., Baumann, M., Weber, M.: Towards cooperative driving: involving the driver in an autonomous vehicle’s decision making (2016). https://doi.org/10.1145/3003715.3005458

  7. Walch, M., Colley, M., Weber, M.: Driving-task-related human-machine interaction in automated driving: towards a bigger picture. In: The 11th International Conference (2019)

    Google Scholar 

  8. Aramrattana, M., Larsson, T., Jansson, J., Englund, C.: Dimensions of cooperative driving, ITS and automation. In: 2015 IEEE Intelligent Vehicles Symposium (IV), pp. 144–149 (2015)

    Google Scholar 

  9. Hoc, J.-M.: Towards a cognitive approach to human-machine cooperation in dynamic situations. Int. J. Hum. Comput. Stud. 54(4), 509–540 (2001). https://doi.org/10.1006/ijhc.2000.0454

    Article  Google Scholar 

  10. Hoc, J.-M., Young, M.S., Blosseville, J.-M.: Cooperation between drivers and automation: implications for safety. Theor. Issues Ergon. Sci. 10(2), 135–160 (2009). https://doi.org/10.1080/14639220802368856

    Article  Google Scholar 

  11. Mcneese, N.J., Demir, M., Cooke, N.J., Myers, C.: Teaming with a synthetic teammate: insights into human-autonomy teaming. Hum. Factors 60(2), 262–273 (2018)

    Article  Google Scholar 

  12. Boy, G.A.: The Handbook of Human-Machine Interaction A Human-Centered Design Approach (2011)

    Google Scholar 

  13. Verberne, F.M.F., Ham, J., Midden, C.J.H.: Trusting a virtual driver that looks, acts, and thinks like you. Hum. Factors J. Hum. Factors Ergon. Soc. 57(5), 1–15 (2015)

    Article  Google Scholar 

  14. Woods, D.D., Hollnagel, E.: Joint Cognitive Systems: Patterns in Cognitive Systems Engineering. CRC Press, Boca Raton (2006). ISBN 9780849339332

    Book  Google Scholar 

  15. Jones, A.T., Romero, D., Wuest, T.: Modeling agents as joint cognitive systems in smart manufacturing systems. Manuf. Lett. (2018). https://doi.org/10.1016/j.mfglet.2018.06.002

    Article  Google Scholar 

  16. Hollnagel, E., Woods, D.D.: Cognitive systems engineering: new wine in new bottles. Int. J. Man-Mach. 18(6), 583–600 (1983)

    Article  Google Scholar 

  17. Hutchins, E.: How a cockpit remembers its speeds. Cogn. Sci. 19(3), 265–288 (1995). https://doi.org/10.1016/0364-0213(95)90020-9

  18. Billings, C.E.: Aviation Automation: The Search for a Human-Centered Approach. Erlbaum, Hillsdale (1996)

    Google Scholar 

  19. Flemisch, F.O., Bengler, K., Bubb, H., Winner, H., Bruder, R.: Towards cooperative guidance and control of highly automated vehicles: H-Mode and conduct-by-wire. Ergonomics 57(3), 343–360 (2014)

    Article  Google Scholar 

  20. Wang, C.: A framework of the non-critical spontaneous intervention in highly automated driving scenarios. In: 11th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM (2019)

    Google Scholar 

  21. Salas, E., Prince, C., Baker, D.P., Shrestha, L.: Situation awareness in team performance: implications for measurement and training. Hum. Factors 37, 1123–1136 (1995)

    Article  Google Scholar 

  22. Fiebich, A., Nguyen, N., Schwarzkopf, S.: Cooperation with robots? A two-dimensional approach. In: Misselhorn, C. (ed.) Collective Agency and Cooperation in Natural and Artificial Systems. PSS, vol. 122, pp. 25–43. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-15515-9_2

    Chapter  Google Scholar 

  23. Salas, E., Dickinson, T.L., Converse, S.A., Tannenbaum, S.I.: Toward an understanding of team performance and training. In: Swezey, R.W., Salas, E. (eds.) Teams: Their Training and Performance, pp. 3–29. Ablex, Norwood (1992)

    Google Scholar 

  24. Zimmermann, M., Bengler, K.: A multimodal interaction concept for cooperative driving. In: 2013 IEEE Intelligent Vehicles Symposium (IV), pp. 1285–1290 (2013). https://doi.org/10.1109/IVS.2013.6629643

  25. Cooke, N.J., Gorman, J.C., Myers, C.W., Duran, J.L.: Interactive team cognition. Cogn. Sci. 37(2), 255–285 (2013). https://doi.org/10.1111/cogs.12009

    Article  Google Scholar 

  26. Walch, M., Mühl, K., Kraus, J., Stoll, T., Baumann, M., Weber, M.: From car-driver-handovers to cooperative interfaces: visions for driver–vehicle interaction in automated driving. In: Meixner, G., Müller, C. (eds.) Automotive User Interfaces. HIS, pp. 273–294. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-49448-7_10

    Chapter  Google Scholar 

  27. Christoffersen, K., Woods, D.D.: 1. How to make automated systems team players. In: Advances in Human Performance and Cognitive Engineering Research, vol. 2, pp. 1–13 (2002). https://doi.org/10.1016/S1479-3601(02)02003-9

  28. Hoc, J.M.: Towards a cognitive approach to human-machine cooperation in dynamic situations. Int. J. Hum. Comput. Stud. 54, 509–540 (2001)

    Article  Google Scholar 

  29. Bengler, K., Zimmermann, M., Bortot, D., Kienle, M., Damböck, D.: Interaction principles for cooperative human-machine systems. IT—Inf. Technol. 54(4), 157–164 (2012). https://doi.org/10.1524/itit.2012.0680

  30. Endsley, M.R., Kiris, E.O.: The out-of-the-loop performance problem and level of control in automation. Hum. Factors J. Hum. Factors Ergon. Soc. 37(2), 381–394 (1995). https://doi.org/10.1518/001872095779064555

    Article  Google Scholar 

  31. McAree, O., Chen, W.H.: Artificial situation awareness for increased autonomy of unmanned aerial systems in the terminal area. J. Intell. Rob. Syst. 70(1–4), 545–555 (2013). https://doi.org/10.1007/s10846-012-9738-x

    Article  Google Scholar 

  32. Shu, Y., Furuta, K.: An inference method of teams situation awareness based on mutual awareness. Cogn. Technol. Work 7(4), 272–287 (2005)

    Article  Google Scholar 

  33. Stanton, N.A.: Distributed situation awareness. Theor. Issues Ergon. Sci. 17(1), 1–7 (2016)

    Article  MathSciNet  Google Scholar 

  34. Salas, E., Sims, D.E., Burke, C.S.: Is there a “big five” in teams work? Small Group Res. 36(5), 555–599 (2005)

    Article  Google Scholar 

  35. Endsley, M.R., Robertson, M.M.: Situation awareness in aircraft maintenance teams. Int. J. Ind. Ergon. 26(2), 301–325 (2000). https://doi.org/10.1016/S0169-8141(99)00073-6

    Article  Google Scholar 

  36. Walch, M., Woide, M., Muehl, K., Baumann, M., Weber, M.: Cooperative overtaking: overcoming automated vehicles’ obstructed sensor range via driver help, pp. 144–155 (2019). https://doi.org/10.1145/3342197.3344531

  37. Wang, C., Krüger, M., Wiebel-Herboth, C.: “Watch out!”: prediction-level intervention for automated driving (2020). https://doi.org/10.1145/3409120.3410652

  38. Kridalukmana, R., Hai Yan, L., Naderpour, M.: A supportive situation awareness model for human-autonomy teaming in collaborative driving. Theor. Issues Ergon. Sci. (2020). https://doi.org/10.1080/1463922X.2020.1729443

    Article  Google Scholar 

  39. Parasuraman, R., Bahri, T., Deaton, J., Morrison, J.G., Barnes, M.: Theory and design of adaptive automation in aviation systems. Naval Air Warfare Center, Warminster, PA, Technical report NAWCADWAR-92 033–60 (1992)

    Google Scholar 

  40. Wickens, C.D., Gordon, S.E., Liu, Y.: An Introduction to Human Factors Engineering. Addison-Wesley Educational Publishers Inc, New York (1997)

    Google Scholar 

  41. Bitan, Y., Meyer, J.: Self-initiated and respondent actions in a simulated control task. Ergonomics 50(5), 763–788 (2007). https://doi.org/10.1080/00140130701217149

  42. Stanton, N.A., Young, M.S., Walker, G.H.: The psychology of driving automation: a discussion with professor Don Norman. Int. J. Veh. Des. 45(3), 289–306 (2007). https://doi.org/10.1504/IJVD.2007.014906

    Article  Google Scholar 

  43. Endsley, M.R.: From here to autonomy: lessons learned from human-automation research. Hum. Factors J. Hum. Factors Soc. 59(1), 5–27 (2017)

    Article  Google Scholar 

  44. Chen, J.Y.C., Procci, K., Boyce, M., Wright, J., Garcia, A., Barnes, M.: Situation awareness based agent transparency. Aberdeen Proving Ground, MD: U.S. Army Research Laboratory. Report No. ARL-TR-6905 (2014)

    Google Scholar 

  45. Norman, D.A.: The ‘problem’ with automation: inappropriate feedback and interaction, not ‘over-automation’. Philos. Trans. R. Soc. B Biol. Sci. 327(1241), 585–593 (1990). https://doi.org/10.1098/rstb.1990.0101

    Article  Google Scholar 

  46. Li, X., Vaezipour, A., Rakotonirainy, A., Demmel, S., Oviedo-Trespalacios, O.: Exploring drivers’ mental workload and visual demand while using an in-vehicle hmi for eco-safe driving. Accid. Anal. Prev. 146, 105756 (2020)

    Article  Google Scholar 

  47. Kraus, J.M., Nothdurft, F., Hock, P., Scholz, D., Baumann, M.: Human after all: effects of mere presence and social interaction of a humanoid robot as a co-driver in automated driving. In: Automotive’UI 2016 (2016)

    Google Scholar 

  48. Allen, T.M., Lunenfeld, H., Alexander, G.J.: Driver information needs. Highway Res. Rec. 366, 102–115 (1971)

    Google Scholar 

  49. Hollnagel, E., Woods, D.D.: Joint Cognitive Systems: Foundations of Cognitive Systems Engineering. Taylor and Francis, Boca Raton (1995)

    Google Scholar 

Download references

Acknowledgements

This work was supported by The National Key Research and Development Program of China (No. 2018YFB1004903), National Social Science Fund (No. 19FYSB040), Shanghai Automotive Industry Science and Technology Development Foundation (No. 1717). Excellent Experimental Teaching Project of Tongji University and Graduate Education Research and Reform Project of Tongji University (No. 2020JC35).

Author information

Authors and Affiliations

  1. College of Design and Innovation, Tongji University, Shanghai, 201804, China

    Jun Zhang & Yujia Liu

  2. Car Interaction Design Lab, College of Art and Media, Tongji University, Shanghai, China

    Jun Zhang, Yujia Liu, Jianmin Wang & Fang You

  3. The Department of Computer and Systems Sciences, Stockholm University, Stockholm, Sweden

    Preben Hansen

Authors
  1. Jun Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yujia Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Preben Hansen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jianmin Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Fang You
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fang You .

Editor information

Editors and Affiliations

  1. Technische Universität Ilmenau, Ilmenau, Germany

    Heidi Krömker

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhang, J., Liu, Y., Hansen, P., Wang, J., You, F. (2021). Interactive Framework of Cooperative Interface for Collaborative Driving. In: Krömker, H. (eds) HCI in Mobility, Transport, and Automotive Systems. HCII 2021. Lecture Notes in Computer Science(), vol 12791. Springer, Cham. https://doi.org/10.1007/978-3-030-78358-7_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78358-7_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78357-0

  • Online ISBN: 978-3-030-78358-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation