Abstract
Current technological achievements and trends show that in a not too far future vehicles will become able to drive with highest levels of automation in different environments all over the world. Until then still many questions need to be solved. Such questions are how to get the driver back into the loop when problematic situations happen that the automation is unable to solve. Others ask the question how to involve drivers in the driving tasks if they want to drive partially automated. Such questions require answers in how cooperation between a machine in terms of a highly automated technical system and a human works and how tasks can be shared. This paper presents an approach how to improve the cooperation between two actors in different domains using interaction patterns. Interaction patterns can be applied for several use cases of cooperative movement, e.g. parent–child, teammates in sports and in highly automated driving. This paper presents an approach how interaction problems sourced in different use cases can be solved with interaction patterns. Inspired by linguistics and psychology, image schemas are used for technical design to structure and improve intuitiveness of these interaction patterns. The concept combines the approaches of design patterns and image schemas to create interactions that are grounded in our bodily experiences and can be applied to target-specific meaning necessary for human machine cooperation, e.g. in cooperative guidance and control of highly automated vehicles.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alexander C, Ishikawa S, Silverstein M, Jacobson M, Fiksdahl-King I, Angel S (1977) A pattern language: towns, buildings, construction. Oxford University Press, Oxford
Altendorf E, Baltzer M, Heesen M, Kienle M, Weissgerber T, Flemisch F (2016) H-mode—a haptic–multimodal interaction concept for cooperative guidance and control of partially and highly automated vehicles. In: Winner H, Hakuli S, Lotz F, Singer C (eds) Handbook of driver assistance systems. Springer, Berlin
Altendorf E, Schreck C, Weßel G, Canpolat Y, Flemisch F (2018) Utility assessment in automated driving for cooperative human-machine systems. Cogn Technol Work (Accepted)
Baltzer MC, Lopez, D, Kienle M, Flemisch F (2015) Dynamic distribution of control via grip force sensitive devices in cooperative guidance and control. 11. Berliner Werkstatt Mensch-Maschine-Systeme, BWMMS, Berlin, pp 89–95
Baltzer MC, Rudolph C, López D, Flemisch F (2017a) Cooperative guidance and control in highly automated convoys—StrAsRob. In: Stanton NA, Landry S, Bucchianico GD, Vallicelli A (eds) Advances in human aspects of transportation. Springer, Berlin, pp 547–559
Baltzer MC, Weßel G, López D, Flemisch F (2017b) Interaction patterns for cooperative guidance and control—automation mode transition in highly automated truck convoys. In: International conference on systems, man, and cybernetics (SMC)
Baltzer MCA, Lassen C, López D, Flemisch F (2018) Behaviour adaptation using interaction patterns with augmented reality elements. In: Schmorrow D, Fidopiastis C (eds) Augmented cognition: intelligent technologies, vol 10915. Springer, Cham, pp 9–23. https://doi.org/10.1007/978-3-319-91470-1_2
Blanquart C, Clausen U, Jacobs B (2016) Towards innovative freight and logistics. Wiley, Hoboken
Borchers JO (2001) A pattern approach to interaction design. AI Soc 15(4):359–376. https://doi.org/10.1007/bf01206115
Clausner TC, Croft W (1999) Domains and image schemas. Cogn Linguist 10(1):1–31
Croft W, Cruse DA (2004) Cognitive linguistics. Cambridge University Press, Cambridge
Fillmore CJ (1975) An alternative to checklist theories of meaning. In: Proceedings of the first annual meeting of the Berkeley Linguistics Society, Berkeley Linguistics Society, pp 123–131
Flemisch FO (2000) Pointillistische Analyse der visuellen und nicht-visuellen Interaktionsressourcen am Beispiel Pilot-Assistenzsystem. Diss, Universität der Bundeswehr München, Neubiberg
Flemisch F, Onken R (2002) Open a window to the cognitive work process! Pointillist analysis of man-machine interaction. Cognit Technol Work 4:160–170
Flemisch F, Heesen M, Hesse T, Kelsch J, Schieben A, Beller J (2011) Towards a dynamic balance between humans and automation: authority, ability, responsibility and control in shared and cooperative control situations. Cogn Technol Work 14(1):3–18
Flemisch F, Winner H, Bruder R, Bengler K (2016) Cooperative guidance, control, and automation. In: Winner H, Hakuli S, Lotz F, Singer C (eds) Handbook of driver assistance systems. Springer, Berlin
Gallagher S (1986) Body image and body schema: a conceptual clarification. J Mind Behav 7(4):541–554
Gallagher S (2006) How the body shapes the mind. Clarendon Press, Oxford
Gamma E, Helm R, Johnson R, Vlissides J (1995) Design patterns: elements of reusable object-oriented software. Addison-Wesley, Boston
Graham I (2002) A pattern language for web usability. Addison-Wesley Longman Publishing Co., Inc, Boston
Harcourt AH, de Waal FB (1992) Coalitions and alliances in humans and other animals. Oxford University Press, Oxford
Hurtienne J (2011) Image schemas and design for intuitive use—exploring new guidance for user interface design. Diss., Technische Universität Berlin, Berlin
Hurtienne J (2016) How cognitive linguistics inspires HCI: image schemas and image-schematic metaphors. Int J Hum Comput Interact 33:1–20
Hurtienne J (2017) ISCAT—image schema database. http://zope.psyergo.uni-wuerzburg.de/iscat. Accessed 21 Feb 2017
Hurtienne J, Langdon P, Clarkson PJ (2009a) Towards an account of sensorimotor knowledge in inclusive product design. In: Stephanidis C (ed) Universal access in human–computer interaction, Addressing diversity. Springer, Berlin, Heidelberg, pp 251–260. https://doi.org/10.1007/978-3-642-02707-9_28
Hurtienne J, Stößel C, Weber K (2009b) Sad is heavy and happy is light. In: Proceedings of the 3rd international conference on tangible and embedded interaction—TEI ‘09, ACM Press, Boston
Hurtienne J, Stößel C, Sturm C, Maus A, Rötting M, Langdon P, Clarkson J (2010) Physical gestures for abstract concepts: inclusive design with primary metaphors. Interact Comput 22(6):475–484
Hurtienne J, Klockner K, Diefenbach S, Nass C, Maier A (2015) Designing with image schemas: resolving the tension between innovation, inclusion and intuitive use. Interact Comput 27:235–255
Johnson M (1987) The body in the mind: the bodily basis of meaning, imagination, and reason. University of Chicago Press, Chicago
Kunert T (2009) User-centered interaction design patterns for interactive digital television applications. Springer, London
Lakoff G (1987) Women, fire and dangerous things. University of Chicago Press, Chicago
Lakoff G (1989) Some empirical results about the nature of concepts. Mind Lang 4(1–2):103–129
Lakoff G, Johnson M (1980) Metaphors we live by. University of Chicago Press, Chicago
Lakoff G, Turner M (1989) More than cool reason. A field guide to poetic metaphor. University of Chicago Press, Chicago
Langacker RW (2008) Cognitive grammar—a basic introduction. Oxford University Press, New York
Macaranas, A., Antle, A. N., & Riecke, B. E. (2012). bridging the gap: attribute and spatial metaphors for tangible interface design. In: Proceedings of the sixth international conference on tangible, embedded and embodied interaction—TEI ‘2, ACM Press, Boston
Martin D, Sommerville I (2004) Patterns of cooperative interaction: linking ethnomethodology and design. ACM Trans Comput Hum Interact (TOCHI) 11:59–89
Montello DR, Fabrikant SI, Ruocco M, Middleton RS (2003) Testing the first law of cognitive geography on point-display spatializations. In: Walter Kuhn MF (ed) Spatial information theory. Foundations of geographic information science. Springer, Berlin, pp 316–331
SAEJ3016 (2016) Taxonomy and definitions for terms related to on-road motor vehicle automated driving systems. Society of Automotive Engineers, Warrendale
Suied C, Susini P, McAdams S (2008) Evaluating warning sound urgency with reaction times. J Exp Psychol Appl 14(3):201
Tomasello M (2014) A natural history of human thinking. Harvard University Press, Boston
Van Duyne DK, Landay J, Hong JI (2002) The design of sites: patterns, principles, and processes for crafting a customer-centered web experience. Addison-Wesley Longman Publishing Co., Inc, Boston
van Welie M (2017) Patterns in interaction design. http://www.welie.com/patterns/index.php. Accessed 21 Feb 2017
van Welie M, van der Veer GC (2003) Pattern languages in interaction design: structure and organization. In: Proceedings of interact ‘03. Amsterdam, The Netherlands
Weßel G, Altendorf E, Schwalm M, Canpolat Y, Burghardt C, Flemisch F (2018) Nudge me please: self-determined decisions in human-machine interaction. Cognit Technol Work (Accepted)
Wickens CD (1984) Processing resources in attention. In: Parasuraman R, Davies DR (eds) Varieties of attention. Academic Press, Cambridge
Wimmershoff M, Benimoun A (2009) User needs for intersection safety systems. In: Meyer G, Valldorf J, Gessner W (eds) Advanced microsystems for automotive applications. Springer, Berlin, pp 173–183
Funding
Contents of this work were gained from studies funded by the German Federal Ministry of Defence and the Deutsche Forschungsgesellschaft DFG.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Baltzer, M.C.A., López, D. & Flemisch, F. Towards an interaction pattern language for human machine cooperation and cooperative movement. Cogn Tech Work 21, 593–606 (2019). https://doi.org/10.1007/s10111-019-00561-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10111-019-00561-8