Abstract
This paper presents a review of fundamental concepts behind the shared mental model and its processes. Shared mental model has two properties which are similarity and accuracy where both of these properties have different emphasis. Types of shared mental model refers to four (4) different ways on what type of cognitive process is being shared in team, which includes task-specific knowledge, task-related knowledge, knowledge of teammates and attitude or beliefs. These four (4) types of shared mental model are grouped into two (2) major content domains, i.e. task-work and team-work. It further describe the aspects of shared mental model on how cognitive process is being shared, includes shared vs. overlapping, similar vs. identical, compatible vs. complimentary and distributed. Shared mental model has to be evaluated using three (3) aspects of characteristics in order to show its operationalization: elicitation method, structure representation, and representation of emergence. A specific evaluation technique called cognitive task analysis that focuses on the analysis of difficulties in cognitive structures is introduced in evaluating shared mental model. This paper also discusses Collaborative Visualisation as technological approach in shared mental model, which includes the benefit of user participation in the aspects of joining or leaving, floor control, privacy and global view. Specific areas on big data, visual analytics, multimedia interface, mobility, disability, awareness and learning analytics that can benefit from the shared mental model approach is discussed.
You have full access to this open access chapter, Download conference paper PDF
Similar content being viewed by others
Keywords
1 Introduction
One (1) type of cognitive architecture in domain of team work and collaboration that has received substantial research attention in Human-computer Interaction is Shared Mental Model (SMM). SMM is derived from the root of mental model construct from the discipline of cognitive psychology (DeChurch and Mesmer-Magnus 2010). Shared mental model (SMM) refers to “knowledge structure held by members of a team that enables them to form accurate explanations and expectations for the task, and in turn, to coordinate their actions and adapt their behavior to demands of the task and other team members” (Cannon-Bowers et al. 1993, p. 228). According to Payne (2003), even though the research interest in SMM has become overwhelming in HCI, more emphasis on theoretical, empirical and conceptual work pertaining to the team cognition and computer interaction are still required.
Earlier in 1993, mental model has been discussed by Staggers and Norcio (1993), concerning the mental model formation, characteristics and models. Other reviews have been conducted by Isenberg et al. (2011), which it provides a detailed review on five (5) scenarios on how SMM being applied in collaborative visualisation tools. Other study conducted by Grimstead et al. (2005) provide a review of how SMM are being used in forty two (42) collaborative visualisation systems across four application areas: collaborative problem-solving environments, virtual reality environments, multi-player online games and multi-user enabling of single user applications. Most recently study is a review and analysis of shared visual representation for building a shared mental model (Nor’ain and Siti Salwah 2015). These studies only described how important is the SMM application in particular interactive systems, however, none of them provide a thorough understanding on the theoretical concepts behind the SMM processing such as properties, aspects and types of SMM, as well as techniques being used in evaluating SMM in visualization technologies.
The aim of this paper is to provide a theoretical review about this concept and guide to future research. The search for this review studies was performed through popular electronic databases i.e. Science Direct, ACM Digital Library, IEEE Explore Digital Library, ISI Web of Knowledge, Scopus Online, Taylor and Francis Online and Springer Link. The search strategy was limited to English articles only. The initial keywords search include: (‘shared mental model’ OR ‘shared cognition’ OR ‘visualisation technology’). The final step was to narrow down the search to the most relevant researched area in Human-Computer Interaction studies.
2 Shared Mental Model in Human-Computer Interaction
In HCI, team cognitive research is characterized as the study of a team as an information-processing unit (Salas et al. 2008). In order to understand the cognitive processes of the team that they want to study, HCI researchers learn from cognitive models that describe the fundamental concept.
Yusoff and Salim (2014) reported two (2) types of approaches in studying team cognition; socially shared cognitive approach (SSC) and shared situation awareness approach (SSA). SSC is a shared cognitive approach views “how dyads, groups and larger collectives create and utilize interpersonal understanding” (Thompson and Fine 1999, p. 3). On the other hand, SSA refers to “degree that team members possess the same awareness of shared situation awareness requirements, within a volume of time and space, as well as the comprehension of their meaning and projection of their status in the near future” (Endsley et al. 2003, p. 13).
SMM is a type of information-processing model which is developed underlying the SSC approach (Yusoff and Salim 2014). This model views that group members have a separate and independent memory structures. It suggests that group member who is able to access to other member’s memory stores can effectively expand their storage and retrieval, thus leading to development of group interaction. Conversely, SMM has also seen to support awareness situation. For example, works by Haig et al. (2006) shows a SMM development to support situation awareness among clinicians as well as work by Entin and Entin (2000) who found team situation awareness in SMM using simulated military missions. Hence, the SMM can be used to support both SSC as well as SSA.
Using an underlying input-process-output (IPO) framework, the greatest focus of concern on team cognitive research in HCI has been on enhancing communication and collaboration among team members as well as optimizing the performance of the team as a whole. The theoretical concept of SMM is discussed further in next section.
3 Theoretical Concept of Shared Mental Model
SMM refers to “knowledge structure held by members of a team that enables them to form accurate explanations and expectations for the task, and in turn, to coordinate their actions and adapt their behavior to demands of the task and other team members” (Cannon-Bowers et al. 1993, p. 228). SMM develops when team members interact and that converge the individual team member’s mental model, resulting in similar to, or sharing with, that of their team member’s mental model. The terminology SMM has also been introduced in many ways, for example, team mental models and compatible mental model (McComb 2008). Throughout this paper, the two (2) terms SMM and shared cognition are being used interchangeably to describe essentially the same concept.
3.1 Properties of Shared Mental Model
SMM consists of two (2) properties; similarity and accuracy (Mohammed et al. 2010). Similarity in SMM refers to “sharedness” or the “degree to which members’ mental models are consistent or converge with one another and does not signify identical mental models” (Mohammed et al. 2010, p. 880). Examples of SMM studies focusing on similarity are the study on similarity of knowledge structures between two (2) members (Mathieu et al. 2000), the effect of cross-training for the similarity of teammates’ team-interaction model (Marks et al. 2002) and the effect of similar mental models for high-performance team (Zou and Lee 2010). On the other hand, accuracy in SMM refers to the “true score” or “similarity of knowledge ratings about other members and one’s own corresponding self-ratings” (Espinosa 2001, p. 2103).
The studies in sharedness or similarity have given more emphasis than the accuracy in the literature even though some studies attempted to study both properties are also found (Mohammed et al. 2010). For examples; Burtscher et al. (2011) investigate how the similarity and accuracy and two (2) forms of monitoring behavior i.e. team versus systems interacted to predict team performance in anesthesia, and Resick et al. (2010) examined the relationships between team cognitive ability and personality composition in relation to the similarity and accuracy of team task-focused mental models.
3.2 Importance of Shared Mental Model
According to Cannon-Bowers and Salas (2001), constructing SMM is important due to following three (3) reasons:
-
Firstly, SMM provides an explanatory mechanism that helps to understand team performance. It explains the effectiveness of teams’ interaction with one another without the need to communicate.
-
Secondly, SMM construction can be valuable to predict variable in teams such as identifying potential performance problems and providing insight into how the problems can be fixed.
-
Thirdly, SMM can diagnose problems such as identifying poor communication that may derive from lack shared of knowledge.
Due to the importance of SMM, the application of SMM can lead to three (3) outcomes (Cannon-Bowers and Salas 2001) as below:
-
First, SMM could lead to better task performance, such as in terms of the accuracy, efficiency, quality of output, volume, timeliness. This outcome is defined as task-specific.
-
Second, SMM leads to better team processes, which in turn lead to better task performance such as more efficient communication, more accurate expectations and predictions, consensus, similar interpretations, and better coordination. This outcome is defined as task-related.
-
Another expected outcome from SMM is referred to motivational outcomes. This includes cohesion, trust, morale, collective efficacy and satisfaction with the team. However, (Cannon-Bowers and Salas 2001) stresses that the motivational outcomes have a looser association with task performance than the previous two.
Cannon-Bowers and Salas (2001) argued that there is a need to clarify which kind of outcomes that is expected from the SMM so that the types and aspects of shared cognition can be determined. The types and aspects of shared cognition are explained in the next sections.
3.3 Types of Shared Mental Model
Types of SMM refer to what cognitive processes are shared. There are four (4) types of cognitive categories on what is shared in team (Cannon-Bowers and Salas 2001):
-
1.
Task-specific Knowledge - This type of shared cognition allows the team members to coordinate without the need to communicate overtly and act on knowledge without discussion. The nature of knowledge being shared is highly task-specific, which involves specific procedures, sequences, actions and strategies to perform a task.
-
2.
Task-related Knowledge - This type of shared cognition allows team members to have common knowledge about task-related processes such as what it is, how it operates and its importance, which contribute to the team’s ability to accomplish the task. In contrast to task-specific knowledge, it is not task-specific, but it can hold variety of similar tasks.
-
3.
Knowledge of Teammates - This type of shared cognition allows team members to understand each other in terms of their preferences, strengths, weaknesses, and tendencies in order to maximize performance. It views that team learns the distribution of expertise within the team over time. It is also a task-related knowledge but not necessarily task-specific.
-
4.
Attitude or Beliefs - This type of shared cognition allows team members to have similar attitudes and beliefs that lead to effective decisions. It involves the notions of shared beliefs and cognitive consensus. This shared cognition type covers a broad category of knowledge, where it does not related to task-specific or task-related.
These four (4) types of SMM are categorized into two (2) major content domains; task-work, and team-work (Mathieu et al. 2000). Task work domain refers to the work goals and performance requirements, while the team work domain refers to the interpersonal interaction requirements and skills of other team members (Mohammed et al. 2010). The integration between the two (2) major domains and four (4) types of SMMs are presented in Table 1.
3.4 Aspects of Shared Mental Model
Aspects of SMM refer to how cognitive processes are shared. There are four (4) different categories of ways of how cognition is shared in team (Cannon-Bowers and Salas 2001):
-
1.
Shared vs. Overlapping - This refers to situations where two (2) or more team members need to have some common knowledge but should not be redundant.
-
2.
Similar vs. Identical - This refers to the need to hold similar or identical knowledge. Team members need to hold similar attitudes and beliefs in order to draw common interpretations that can drive towards effective performance. For example, surgeon and nurse working together in an operation theater are not expected to have identical knowledge, but portions of their knowledge bases are needed to be shared (Undre et al. 2006). This category of shared cognition is associated with the task that must be common among members.
-
3.
Compatible vs. Complimentary - This refers to team which possess specialized roles and knowledge that is crucial to task performance. A multidisciplinary team where each member possesses specialized expertise to solve a problem may have dissimilar knowledge, however still can lead them to complementary behavior.
-
4.
Distributed - This refers to the knowledge that is distributed across members. This aspect of shared cognition is applied in many high performance teams, such as military combat teams, where the systems and tasks are complex and difficult. Therefore, if the team members’ knowledge is specialized and distributed, team members need to coordinate their knowledge effectively in order to achieve SMM.
4 Evaluation for Shared Mental Model
This section describes in detail approaches of evaluations in shared mental model.
4.1 Ways to Measure Shared Mental Model
Shared knowledge can be measured in two (2) ways (Cannon-Bowers and Salas 2001). Firstly is by assessing the structure of team member knowledge and secondly is to measure the content of team member knowledge. Mohammed et al. (2010, p. 884) refers the structure as “how concepts are organized in the minds of participants” whereas content is the “knowledge that comprises cognition”. It is stated that assessing the team knowledge structure is more straightforward; however in practical ways it is rather very difficult. On the other hand, measuring contents has been seen as more possible to conduct.
Steps to Measure Shared Mental Model
DeChurch and Mesmer-Magnus (2010) further have described steps to measure SMM, which involves three (3) aspects of characteristics: elicitation method, structure representation, and representation of emergence. These three (3) characteristics are needed as they can show the operationalization of SMM. They are as described as follows:
-
a.
Elicitation Method
It refers to the technique used to determine the components or content of a mental model. Techniques include:
-
Similarity ratings - Participants are presented with a grid and they will be requested to consider each pair of task nodes and report their perceptions of the relation between the two (2) nodes.
-
Concept maps – Participants are asked to elicit contents and place the actions into a meaningful organizational scheme.
-
Rating scales – Participants are asked to elicit the content of the model and respond to questions about the task on fixed-response formats such as strongly agree to strongly disagree.
-
Card sorting tasks – Participants are asked to sort numbers of cards and categorize or list them based on their understanding of the structure and relationship.
-
Interactively elicited cause mapping - Participants are asked to provide data through questionnaires and/or interviews using interactive ways.
-
Text-based cause mapping – Participants are asked to provide post hoc analyses of data such as systematic coding of documents or transcripts.
-
b.
Structure Representation
It refers to the organized knowledge structures corresponding between how the knowledge content is represented in the mind and how the knowledge representation can be modeled by the researcher (DeChurch and Mesmer-Magnus 2010). Techniques include:
-
Pathfinder – This technique is used to produce appropriate psychological scaling based on the underlying structure between concepts. It provides algorithm that can transform raw paired comparison ratings into a network structure where these concepts are represented as nodes, while the relatedness of the concepts are represented as links.
-
UCINET - This technique is developed by Borgatti et al. (2002) to support social network data analysis. It comes with a complete software package for data visualization.
-
Multidimensional scaling – This technique uses geometric models to represent proximity data spatially. It is used to identify unknown underlying dimensions in organizing cognitive stimuli.
-
Concept mapping/card sorting - as described.
-
c.
Representation of Emergence
It refers to representation technique used “to reveal the structure of data or determine the relationships between elements in an individual’s mind” (Mohammed et al. 2000, p. 129). Techniques include; concept mapping, path-finder, UCINET, interactively elicited cause mapping, text-based cause mapping and Euclidean distance.
Of all the techniques described in each steps for measuring SMM, Mohammed et al. (2000) recommended only four (4) techniques because they encompassed both elicitation and representation. These techniques are referred to as pathfinder, multidimensional scaling, interactive elicited mapping and text-based cause mapping.
Next section describes Cognitive Task Analysis as another approach of evaluation in SMM.
4.2 Cognitive Task Analysis Approach
Cognitive task analysis (CTA) focuses on the difficulties in cognitive structures such as knowledge-based and representational skills as well as processes such as attention, problem solving and decision making (Stanton et al. 2005). The aspects of cognitive structures and processes in the CTA can provide a description of the knowledge and thought processes that are required at the expertise level (Schraagen et al. 2008; Seamster et al. 1997). They can also lead to a process for designing, developing and evaluating a better human–computer interface intended to amplify and extend the human ability to make good decisions (Crandall et al. 2006).
Most studies in CTA are concerned with expertise (Klein and Militello 2001, p. 180). Cognitive study is designed to elicit the knowledge and wisdom acquired (Crandall et al. 2006, p. 134). For example, during CTA interviews, interviewers will appreciate the nature of expertise when responses and feedback received are probed in detail. Some related expertise studies that have been conducted using CTA include experienced air warfare coordinators unpacking their expertise and coaching skills for the development of shipboard-based on-the job training for the Navy (Pliske et al. 2000), certified cytotechnologists detecting questionable cells and making sense of the clinical picture for the process documentation of tissue biopsies and cell samples for pathology (McDermott and Crandall 2000) and army ranger squad or platoon leaders describing the required skills for clearing buildings in urban combat settings for the development of training software (Phillips et al. 1998).
Cooke (1994) found more than hundred (100) types of CTA methods and techniques. Due to the growing number of CTA methods, extensive CTA reviews by Stanton et al. (2005), Schraagen et al. (2000) as well as Wei and Salvendy (2004) offer a broad exploration of the difference among these methods and techniques in a number of ways. Stanton et al. (2005) present five (5) selected CTA methods based upon their popularity and the application used, while Schraagen et al. (2000) described a comprehensive review of reviews and classifications to guide researchers interested in exploring and applying the CTA techniques. On the other hand, Wei and Salvendy (2004) classify the CTAs into four (4) broad families, namely: 1) observation and interview 2) process tracing 3) conceptual techniques and 4) formal models. This CTA family classification is meant to guide researchers who are aiming for particular outputs, to select appropriate techniques.
5 Role of Shared Visualisation to Support Shared Mental Model
One way to externalize the individual mind is through the representation of visualization. Many studies have also demonstrated that visual representation that is shared among the users can lead to the development of SMM. Visualization is referred to as “a method of computing…offers a method for seeing the unseen, enriches the process and unexpected insights” (National Science Foundation’s Visualization 1987). According to McGrath et al. (2012), visualization is a graphical representation of data to aid human cognition. These two (2) definitions explain that visualization that is shared can enrich the process as well as the unexpected insights performed by many users.
The application and effect of visualization to shared cognition have been studied by many researchers in the domain of cognition and design studies. For example, the effectiveness of visual representation for the purpose of externalizing and communicating the design process has been demonstrated by Goldschmidt (2007). In this study, two (2) experiments are conducted to clarify how the visual representations have created a SMM of a new bicycle accessory meant to carry a backpack. The result shows that in order for all team members to arrive at a shared task model, it is necessary for them to see the design entity eye to eye in order to progress.
Other studies which had demonstrated the important of visual representation includes; collaborative knowledge construction via visual graphical representation (Suthers 2005), reducing the effort of explicit communication via shared white boards in emergency department (Xiao et al. 2007), and understanding different kinds of video representation and analysis via the use of video story (McNeese 2004).
Arias et al. (2000) opined that SMM can be visualized through the use of external artifacts. External representation can be used to make the knowledge available to all members explicitly as well as able to transcend the cognitive limitation across individual minds. This externalization is important as it creates what is vaguely resides in one’s mental efforts. In other word, artifact represents an externalization which can be communicated visually to the users.
Next section describes the significant role of using cognitive artifact to externalize visualisation.
5.1 Cognitive Artifacts
Artifact that is used as a tool for cognitive activities is called as the “cognitive artifacts”. According to Visser (2006), cognitive artifact comes in two (2) forms:
-
Internal cognitive artifacts or mental cognitive artifacts (i.e. mental representation) – Examples; such as rules of thumb, mnemonics, shopping lists, and other kinds of procedures.
-
External cognitive artifacts – There are two(2) types; physical being such as buildings, cars or garments or any results from mental representations and symbolic such as software, route plan, drawings, mock-ups or any results that symbolize the mental representation.
Visser (2006) explains that due to the nature of the mental cognitive artifacts that are less vague in terms of ideas or images that designers have “in their heads”, the use of external cognitive artifact to visually externalize the emergence of mental cognitive artifacts are therefore required. A research example of using external cognitive artifact is conducted by Nemeth et al. (2004) to study communication and information sharing among healthcare providers. In this study, external cognitive artifacts which are related to operating room or scheduling are used such as the availabilities sheet, master schedule, graph and board. This study finds that better computer-supported cognitive artifacts should benefit patient safety by making teamwork processes, planning, communications and resource management more resilient. Figure 1 shows the emergence process of external artifact to represent the visual externalization of internal cognitive artifact.
5.2 The Technological Approach Using Collaborative Visualisation
Salas et al. (2008) suggested that SMM can be improved using technological development and implementation. One (1) way to support SMM is by using technological visualization approach called as collaborative visualization (CoVis). In CoVis, a shared use of any forms of visual representations is required to enable any cognitive activities collaboration.
CoVis is referred to as “the shared use of computer-supported, interactive, visual representations of data by more than one (1) person with the common goal of contribution to joint information processing activities” (Isenberg et al. 2011, p. 312). CoVis is an approach that emphasis the shared use of interactive visual representations, which could be in a form of joint viewing, interacting with, discussing, or interpreting the presentation.
According to Isenberg et al. (2011), one (1) of the important aspects in CoVis is the focus on cognition and results. It emphasizes that CoVis is not concern about the creation of a “product” i.e. the shared representation, but the focus should involve unique cognitive activities i.e. shared cognition. Besides, Isenberg et al. (2011) also emphasizes the need to support social interaction process around the data. It concerns on the ability for a team to build each other’s insights, which in turn could reach a common understanding of the datasets. Examples of social interaction include arriving at a common understanding of the data as well as enhance knowledge construction by making use of interaction of data.
CoVis also includes distributed design environment which can be directed to the division or spread of resources such as design artifacts, design knowledge or design team. Distributed design can be operated in either synchronous or asynchronous mode. Synchronous mode in distributed design enables real-time communication and collaboration in a “same time-different space” environment; whereas, asynchronous mode enables the communication and collaboration in distributed design to be operated over a period of time through a “different time-different space” mode.
In order to understand the analogy of cognitive process in SMM and CoVis, we present the major processes of input, processing and output as shown in Table 2. As seen in CoVis process, data within the mind of users is acquired, represented and emerged using a form of visual representation (Isenberg et al. 2011). Similarly, SMM process also show the data or knowledge from the mind of individual or group is elicitated, represented in a structure form and finally emerge to form SMM (DeChurch and Mesmer-Magnus 2010).
These processes however do not show how the role of artifact can be used for each process. As such, we come out with a cognitive data process of SMM using the role of artifact. Based on these two (2) processes, the role of artifact can be used to map with each of the major process in order to understand what cognitive data can be acquired as an input, how the cognitive data can be externalized as a process, and what form of visualization can display the emergence of that cognitive data. From the previous review, we have mentioned the focus on elements of knowledge and/or needs which can lead to the development of individual mental model derived from Badke-Schaub et al. (2007)’s framework. The cognitive data process of SMM using the role of artifact is as follows:
-
Cognitive Data Acquisition - is the input process to identify internal cognitive artifact that represents the data from knowledge and needs of users.
-
Cognitive Data Process - refers to how that internal cognitive artifacts being processed.
-
Cognitive Data Emergence - is the output process which displays the emergence of that cognitive data in a form of visualization. It can be referred as the Visser (2006)’s symbolic form of external cognitive artifact.
Looking the importance of shared visualization for SMM, a systematic review study of shared visualizations focusing on SMM has been conducted by Nor’ain and Siti Salwah (2015). This paper is aimed to understand what strategy or techniques being applied in shared visualization to achieve SMM, which include how these strategies and techniques are being used in shared visualization.
Next section describes user interaction in shared visualization technology.
5.3 User Interaction in Shared Visualisation Technology
Brodlie et al. (2004) provide four (4) aspects that relate to how users interact when participating in visualization systems. The four aspects are:
-
Joining/leaving – shared visualization systems should have a facility to allow users to join and leave at any time.
-
Floor control – Shared visualization systems should offer different levels of access to a session for individual users such as allowing editing, or sharing or both editing and sharing authority.
-
Privacy – Shared visualization systems should allow users to work privately and at the same time, still remain in the conference. This is to protect some information and at the sometime can share other information.
-
Global view - Shared visualization systems should be able to allow users to view the network editor of other users in order to reassure that they understand what other user is doing.
6 Future Research Directions
This review discusses the fundamental understanding of SMM processing in visualization technologies. There are number of areas that can benefit from the SMM approach, which is briefly discuss in this section.
6.1 Shared Visualisation in Big Data and Visual Analytics
For big data processing, SMM can be explored on how it should work effectively and efficiently in both distributed and collaborative visualization. According to Brodlie et al. (2004), distributed visualization has some resource allocation problems such as location of processing close to data for minimizing data traffic. One example of an enabling technology is cloud computing and the link to web services could provide better enhancement for distributed visualization in the any visualization technology system, such as close coupling of simulations and visualizations in a real-time, interactive steering environment. A model of visual management system has been devised to support Lean Production in construction sites (Valente et al. 2018). Big data visualisation is needed to support intuitive tools as well as practices involved in very large and changing construction environments, teams and equipment that are often spread in large areas. This work shows that shared visualisation is needed to manage wide construction sites where there is a gap of visual languages, design, infrastructure, and mechanics of visual perception among the construction workers (Valente et al. 2016).
According to Alharthi (2016), a selected team can be visually transformed to enhance collaborative ideas for a specific purpose to enhance mental and overall capabilities as well as to maintain high performance of task and reduces likelihood of failure on a work mission. Mixed-initiative visual analytics system (MIVAS) is another work conducted by Makonin et al. (2016). The conceptual architecture of MIVAS consists of five (5) key components that support data wrangling, alternative discovery and comparison, parametric interaction, history tracking and exploration, system agency and adaptation to support human-human collaboration, multi-user collaboration as well as autonomous revisit system solution.
Work by Seipp et al. (2019) shows that combining information visualization in data mining techniques is an interactive decision-making process that can offer a visual guide to communicate uncertainty. This GeoVisual Analytics should assist the analysis of increasing availability and complexity of geographical information. A review by Chapeton et al. (2018) shows that GeoVisual analytics support visualisation sharing in hybrid collaborative scenarios, cross-device collaboration, time-critical and long-term analysis. Similar work in geographical domain is studied by Ruda (2015) about cartography visualisation to obtain precise results for spatial decision making.
6.2 Shared Visualisation in Multimedia Interface
Another area that requires great attention is involving the user interfaces design construction and development. For example, SMM processing can be increased using visualization and multimedia output capabilities through sophisticated multimodal interaction. According to Oviatt and Cohen (2000), multimodal input facility in a system could give more powerful interfaces for the user to access and manipulate information. Example of future work may include designing multimodal inputs such as speech and handwritten recognition from the user. These recognition techniques should be able to read, interpret and translate integrated data inputs in a form of visualization can provide better multimodal interaction facility in the visualization technology system. Redlich et al. (2017) found that creative virtual tools enhance SMM but still lack in perceived efficiency compared to physically present teamwork. It is suggested that to increase the quality, efficiency and satisfaction of virtual creative processes (such as in virtual agent, chatbot, live chat), further investigation on the usage of information communication technology (ICT), multimedia and virtual tools need to be conducted.
6.3 Shared Visualisation for Mobility
On the other hand, the support for SMM processing in the visualization technology system can be extended through the use of mobile-based application with particular interest to the shared visualization data. For example, the capability of the framework can be enhanced by allowing both desktop and mobile clients to simultaneously visualize the same data visualization in sharing a common view. A research contribution in this area has been done by Craig and Huang (2015). Interactive animated mobile information visualization in “Mobile Tree Browser” is developed to browse labelled hierarchies on mobile devices. The display is able to optimize readability and navigation on devices with limited space. This browser can be used to support multi-device co-located synchronous collaboration using animation to smooth the transition between views (Craig 2015; Craig et al. 2015).
6.4 Shared Visualisation for Disability, Awareness and Learning Analytics
In terms of multi-users participations, SMM can be further explored by incorporating different types of users such as those with certain kind of disabilities. Krishna et al. (2010) stated that social situational awareness is one of the important aspects for new technologies to enrich the social presence among remote disability users. For visually impaired users, portable and wearable interfaces can provide better access to non-verbal social cues through non-visualization medium. Specific research can be done to identify techniques that provide accessible SMM processing among different types of disabilities.
A shared route navigation that combines mobile devices with large display interfaces is designed to allow metro system navigation more convenient and at the same time, allowing a passenger to plan their route in the station using a large-display interface and follow the route using notifications on a smart-watch or similar wearable device (Craig and Liu 2019). This alternative view coordination methods that link smart-phone and large-display multi-device environments is a pervasive approach to facilitate different degrees of autonomous and collaborative working (Craig and Liu 2018). A Multi-Dimensional Visualization is an awareness visualisation system that reveals the level of perception of students towards learning of innovative skills in university (Muraina and Ibrahim 2016). This awareness system focuses on bringing the perception of students towards the learning of innovative skills into reality prior to the commencement of teaching.
Learning analytics is another specialized work in SMM to support education. Middleton (2020) examines the constructed visualization formats of small groups in a library learning commons. This study generates a hybrid and ubiquitous approach to integrating multiple visualization modalities within spatial settings in order to understand how visual and social affordances of group generated visualization formats. Liu and Nesbit (2020) study that visual dashboard facilitate group awareness, shared mental models and group cognition, and in turn fosters effective teaching and learning strategies.
As a conclusion, SMM provides a powerful predictive and explanatory for understanding the interaction in a common way. In order to interact with the world, people form unique share representations or shared mental models with which they can interact to perform better task and work performance.
References
Ruda, A.: Cartographic visualization of outputs for spatial decision-making in regional development. Geod. Cartogr. 41(4), 174–184 (2015). https://doi.org/10.3846/20296991.2015.1120431
Alharthi, S.Z.: Forming, measuring, optimizing, human capital with enhancement concerning dynamic capability: Update on theoretical framework (2016)
Badke-Schaub, P., Neumann, A., Lauche, K., Mohammed, S.: Mental models in design teams: a valid approach to performance in design collaboration? CoDesign 3(1), 5–20 (2007). https://doi.org/10.1080/15710880601170768
Borgatti, S., Everett, M., Freeman, L.: Ucinet for Windows: Software for Social Network Analysis. Analytic Technologies, Harvard (2002)
Brodlie, K.W., Duce, D.A., Gallop, J.R., Walton, J.P.R.B., Wood, J.D.: Distributed and collaborative visualization. Paper Presented at the Computer Graphics Forum (2004)
Burtscher, M.J., Kolbe, M., Wacker, J., Manser, T.: Interactions of team mental models and monitoring behaviors predict team performance in simulated anesthesia inductions. J. Exp. Psychol.: Appl. 17(3), 257–269 (2011). https://doi.org/10.1037/a0025148
Nemeth, C.P., Cook, R.I., O’Connor, M., Klock, P.A.: Using cognitive artifacts to understand distributed cognition. IEEE Trans. Syst. Man Cybern. - Part A: Syst. Hum. 34(6), 726–735 (2004). https://doi.org/10.1109/tsmca.2004.836798
Cannon-Bowers, J.A., Salas, E.: Reflections on shared cognition. J. Organ. Behav. 22(2), 195–202 (2001)
Cannon-Bowers, J.A., Salas, E., Converse, S.: Shared mental models in expert team decision making. Individual and group decision making: current issues. In: Jr. John Castellan, N. (ed.), Individual and Group Decision Making: Current Issues, pp. 221–246. Lawrence Erlbaum Associates, Inc., Hillsdale (1993)
Cooke, N.J.: Varieties of knowledge elicitation techniques. Int. J. Hum.-Comput. Stud. 41(6), 801–849 (1994). https://doi.org/10.1006/ijhc.1994.1083
Craig, P., Liu, Y.: Coordinating user selections in collaborative smart-phone large-display multi-device environments. In: Luo, Y. (ed.) CDVE 2018. LNCS, vol. 11151, pp. 24–32. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00560-3_4
Craig, P., Liu, Y.: A vision for pervasive information visualisation to support passenger navigation in public metro networks. In: 2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), pp. 202–207. IEEE (March 2019)
Crandall, B., Klein, G., Hoffman, R.R.: Working Minds: A Practitioner’s Guide to Cognitive Task Analysis. MIT Press, Cambridge (2006)
DeChurch, L.A., Mesmer-Magnus, J.R.: The cognitive underpinnings of effective teamwork: a meta-analysis. J. Appl. Psychol. 95(1), 32–53 (2010)
Salas, E., Cooke, N.J., Rosen, M.A.: On teams, teamwork, and team performance: discoveries and developments. Hum. Factors: J. Hum. Factors Ergon. Soc. 50(3), 540–547 (2008). https://doi.org/10.1518/001872008x288457
Endsley, M.R., Bolstad, C.A., Jones, D.G., Riley, J.M.: Situation awareness oriented design: from user’s cognitive requirements to creating effective supporting technologies. Proc. Hum. Factors Ergon. Soc. Ann. Meet. 47(3), 268–272 (2003). https://doi.org/10.1177/154193120304700304
Entin, E.B., Entin, E.E.: Assessing team situation awareness in simulated military missions. Proc. Hum. Factors Ergon. Soc. Ann. Meet. 44(1), 73–76 (2000). https://doi.org/10.1177/154193120004400120
Arias, E., Eden, H., Fischer, G., Gorman, A., Scharff, E.: Transcending the individual human mind—creating shared understanding through collaborative design. ACM Trans. Comput.-Hum. Interact. 7(1), 84–113 (2000). https://doi.org/10.1145/344949.345015
Espinosa, J.A.: Shared mental model: accuracy and visual representation. Paper Presented at the Seventh Americas Conference on Information Systems, Boston, Massachusetts, USA (2001)
García-Chapeton, G.A., Ostermann, F.O., de By, R.A., Kraak, M.J.: Enabling collaborative GeoVisual analytics: systems, techniques, and research challenges. Trans. GIS 22(3), 640–663 (2018)
Goldschmidt, G.: To see eye to eye: the role of visual representations in building shared mental models in design teams. CoDesign 3(1), 43–50 (2007). https://doi.org/10.1080/15710880601170826
Grimstead, I.J., Walker, D.W., Avis, N.J.: Collaborative visualization: a review and taxonomy. Paper Presented at the Ninth IEEE International Symposium on Distributed Simulation and Real-Time Applications, 2005 (10–12 October 2005)
Haig, K.M., Sutton, S., Whittington, J.: SBAR: a shared mental model for improving communication between clinicians. Joint Comm. J. Qual. Patient Saf. 32(3), 167–175 (2006). https://doi.org/10.1016/S1553-7250(06)32022-3
Isenberg, P., Elmqvist, N., Scholtz, J., Cernea, D., Ma, K.-L., Hagen, H.: Collaborative visualization: definition, challenges, and research agenda. Inf. Vis. 10(4), 310–326 (2011). https://doi.org/10.1177/1473871611412817
Seipp, K., Gutiérrez, F., Ochoa, X., Verbert, K.: Towards a visual guide for communicating uncertainty in visual analytics. J. Comput. Lang. 50, 1–18 (2019). https://doi.org/10.1016/j.jvlc.2018.11.004. ISSN:2590-1184
Klein, G., Militello, L.: 4. Some guidelines for conducting a cognitive task analysis. Advances in Human Performance and Cognitive Engineering Research, vol. 1, pp. 163–199. Emerald Group Publishing Limited (2001)
Krishna, S., Balasubramanian, V., Panchanathan, S.: Enriching social situational awareness in remote interactions: insights and inspirations from disability focused research. Paper Presented at the Proceedings of the 18th ACM International Conference on Multimedia, Firenze, Italy (2010)
Liu, A.L., Nesbit, J.C.: Dashboards for computer-supported collaborative learning. In: Virvou, M., Alepis, E., Tsihrintzis, G.A., Jain, L.C. (eds.) Machine Learning Paradigms. ISRL, vol. 158, pp. 157–182. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-13743-4_9
Makonin, S., McVeigh, D., Stuerzlinger, W., Tran, K., Popowich, F.: Mixed-initiative for big data: the intersection of human + visual analytics + prediction. In: 2016 49th Hawaii International Conference on System Sciences (HICSS) (2016). https://doi.org/10.1109/hicss.2016.181
Marks, M.A., Sabella, M.J., Burke, C.S., Zaccaro, S.J.: The impact of cross-training on team effectiveness. J. Appl. Psychol. 87(1), 3–13 (2002). https://doi.org/10.1037/0021-9010.87.1.3
Mathieu, J.E., Heffner, T.S., Goodwin, G.F., Salas, E., Cannon-Bowers, J.A.: The influence of shared mental models on team process and performance. J. Appl. Psychol. 85(2), 273–283 (2000). https://doi.org/10.1037/0021-9010.85.2.273
McComb, S.A.: Shared mental models and their convergance. In: Letsky, M.P., Warner, N.W., Fiore, S.M. (eds.) Macrocognition in Teams: Theories and Methodologies. Ashgate Publishing Group, Abingdon (2008)
McDermott, P.L., Crandall, B.: Uncovering expertise: how cytotechnologists screen pap smears. In: The Proceeding of 5th Conference on Naturalistic Decision Making, Tammsvik, Sweden, May 26–28, 2000 (2000)
McGrath, W., Bowman, B., McCallum, D., Ramos, J.D.H., Elmqvist, N., Irani, P.: Branch-explore-merge: facilitating real-time revision control in collaborative visual exploration. Paper Presented at the Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces. Cambridge, Massachusetts (2012)
McNeese, M.: How video informs cognitive systems engineering: making experience count. Cogn. Technol. Work 6(3), 186–196 (2004). https://doi.org/10.1007/s10111-004-0160-4
Middleton, D.A.: Seeking cognitive convergence: small group collaborative visualization in the library learning commons. In: Ahram, T., Taiar, R., Colson, S., Choplin, A. (eds.) IHIET 2019. AISC, vol. 1018, pp. 143–149. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-25629-6_23
Mohammed, S., Ferzandi, L., Hamilton, K.: Metaphor no more: a 15-year review of the team mental model construct. J. Manag. 36(4), 876–910 (2010). https://doi.org/10.1177/0149206309356804
Mohammed, S., Klimoski, R., Rentsch, J.R.: The measurement of team mental models: we have no shared schema. Organ. Res. Methods 3(2), 123–165 (2000). https://doi.org/10.1177/109442810032001
Muraina, I.D., Ibrahim, H.: Student’s perception to learning of innovative skills through multidimensional visualization system: reliability and validity tests of some measurements. In: Knowledge Management International Conference (KMICe), 29–30 August, 2016, Chiang Mai, Thailand, pp. 162–167 (2016)
National Science Foundation’s Visualization. Scientific Computing Workshop Report (1987)
Nor’ain, M.Y., Siti, S.S.: Social-based versus shared situation awareness-based approaches to the understanding of team cognitive research in HCI. In: The Proceedings of the 3rd International Conference on User Science and Engineering 2014 (i-USEr 2014), 2nd–5th September, 2014, Shah Alam, Malaysia, pp. 281–286 (2014)
Nor’ain, M.Y., Siti, S.S.: A systematic review of shared visualization to achieve common ground. J. Vis. Lang. Comput. 28, 83–99 (2015). https://doi.org/10.1016/j.jvlc.2014.12.003. Open Access. Elsevier Science
Oviatt, S., Cohen, P.: Perceptual user interfaces: multimodal interfaces that process what comes naturally. Commun. ACM 43(3), 45–53 (2000). https://doi.org/10.1145/330534.330538
Craig, P., Huang, X.: The mobile tree browser: a space filling information visualization for browsing labelled hierarchies on mobile devices. In: 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing, Liverpool, pp. 2240–2247 (2015). https://doi.org/10.1109/cit/iucc/dasc/picom.2015.33
Craig, P., Huang, X., Chen, H., Wang, X., Zhang, S.: Pervasive information visualization: toward an information visualization design methodology for multi-device co-located synchronous collaboration. In: 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing, Liverpool, pp. 2232–2239 (2015). https://doi.org/10.1109/cit/iucc/dasc/picom.2015.330g
Craig, P.: Interactive animated mobile information visualisation. In: SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications (SA 2015), 6p. ACM, New York (2015). https://doi.org/10.1145/2818427.2818458. Article no. 24
Payne, S.J.: Mental models in human-computer interaction. In: Andrew, S., Jacko, J.A. (eds.) The Human-Computer Interaction Handbook. Fundamentals, Evolving Technologies and Emerging Applications, Second edn., pp. 63–75. Lawrence Erlbaum Associates, Inc., Mahwah (2003)
Phillips, J., McDermott, P.L., Thordsen, M., McCloskey, M., Klein, G.: Cognitive requirements for small unit leaders in military operations in urban terrain. Research Report 1728: U.S. Army Research Institute for Behavioural and Social Science (1998)
Pliske, R.M., Green, S.L., Crandall, B.W., Zsambok, C.E.: The collaborative development of expertise (CDE): a training program for mentors. society for industrial and organizational psychology, New Orleans, LA (2000)
Redlich, B., Siemon, D., Lattemann, C., Robra-Bissantz, S.: Shared mental models in creative virtual teamwork. In: Proceedings of the 50th Hawaii International Conference on System Sciences (January 2017)
Resick, C.J., Dickson, M.W., Mitchelson, J.K., Allison, L.K., Clark, M.A.: Team composition, cognition, and effectiveness: examining mental model similarity and accuracy. Group Dyn.: Theory Res. Pract. 14(2), 174–191 (2010). https://doi.org/10.1037/a0018444
Schraagen, J.M.C., Militello, L., Ormerod, T.C., Lipshitz, R.: Macrocognition and naturalistic decision making (2008)
Schraagen, J.M., Chipman, S.F., Shute, V.J.: State-of-the-art review of cognitive task analysis techniques. In: Schraagen, J.M., Chipman, S.F., Shute, V.J. (eds.) cognitive Task Analysis, pp. 467–489. Erlbaum Associates, Mahwah (2000)
Seamster, D., Redding, R.E., Kaempf, D.: Cognitive Task Analysis, p. 386. Wright State University, Dayton (1997)
Staggers, N., Norcio, A.F.: Mental models: concepts for human-computer interaction research. Int. J. Man-Mach. Stud. 38(4), 587–605 (1993)
Stanton, N., Salmon, P., Walker, G.: Human Factors Methods: A Practical Guide for Engineering and Design. Ashgate Publishing Group, Abingdon (2005)
Suthers, D.D.: Collaborative knowledge construction through shared representations. Paper Presented at HICSS 2005, Proceedings of the 38th Annual Hawaii International Conference on the System Sciences (03–06 January 2005)
Thompson, L., Fine, G.A.: Socially shared cognition, affect, and behavior: a review and integration. Pers. Soc. Psychol. Rev. 3(4), 278–302 (1999)
Undre, S., Sevdalis, N., Healey, A.N., Darzi, S.A., Vincent, C.A.: Teamwork in the operating theatre: cohesion or confusion? J. Eval. Clin. Pract. 12(2), 182–189 (2006)
Valente, C.P., Pivatto, M.P., Formoso, C.T.: Visual management: preliminary results of a systematic literature review on core concepts and principles. In: Proceedings of 24th Annual Conference of the International Group for Lean Construction, Boston, MA, USA, sect. 1, pp. 123–132 (2016)
Valente, C.P., Brandalise, F.M., Formoso, C.T.: Model for devising visual management systems on construction sites. J. Constr. Eng. Manag. 145(2), 04018138 (2018)
Visser, W.: The Cognitive Artifacts of Designing. CRC Press, Boca Raton (2006)
Wei, J., Salvendy, G.: The cognitive task analysis methods for job and task design: review and reappraisal. Behav. Inf. Technol. 23(4), 273–299 (2004)
Xiao, Y., Schenkel, S., Faraj, S., Mackenzie, C.F., Moss, J.: What whiteboards in a trauma center operating suite can teach us about emergency department communication. Ann. Emerg. Med. 50(4), 387–395 (2007). https://doi.org/10.1016/j.annemergmed.2007.03.027
Zou, T., Lee, W.B.: A study of the similarity in mental models and team performance. In: Proceedings of the International Conference on Intellectual Capital, Knowledge Management & Organizational Learning, pp. 536–544 (2010)
Acknowledgments
This work is sponsored by the Ministry of Higher Education Malaysia under the Exploratory Research Funding Scheme EP20120612006 and from the Multimedia University Malaysia Research Funding IP20110707004 and IP20120511020.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Yusoff, N.M., Salim, S.S. (2020). Shared Mental Model Processing in Visualization Technologies: A Review of Fundamental Concepts and a Guide to Future Research in Human-Computer Interaction. In: Harris, D., Li, WC. (eds) Engineering Psychology and Cognitive Ergonomics. Mental Workload, Human Physiology, and Human Energy. HCII 2020. Lecture Notes in Computer Science(), vol 12186. Springer, Cham. https://doi.org/10.1007/978-3-030-49044-7_20
Download citation
DOI: https://doi.org/10.1007/978-3-030-49044-7_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49043-0
Online ISBN: 978-3-030-49044-7
eBook Packages: Computer ScienceComputer Science (R0)