The effects of mutual location-awareness on group coordination

https://doi.org/10.1016/j.ijhcs.2009.12.007Get rights and content

Abstract

The importance of space and place in collaborative practices has been strengthened with the ubiquitous computing paradigm, which aims at the integration of computation in physical objects and places. New location-based applications allow users to know where other individuals are in the physical world. New collaborative applications engage users in geographically dispersed and mobile activities. However, there is still a lack of information concerning how mutual location-awareness (i.e. knowing partners’ whereabouts) might influence socio-cognitive processes involved in coordination. To address this issue, we conducted field experiments with a mobile and collaborative game, running on Tablet PCs, and compared two interfaces. On the first interface, groups received automatic updates from teammates’ whereabouts, while this automatic MLA tool was not provided by the second interface. In addition, all users could use their Tablet PCs to communicate by annotating the map. We found no differences between the two conditions with regard to the task performance. However, contrary to our expectations, players without automatic MLA had a better representation of their partners’ paths, wrote more messages and provided more elaborate explanations of their strategies. Additionally, automatic location-awareness undermined the coordination process, leading participants to be less articulate about their strategy. The paper discusses these results and the implications of such results.

Introduction

For several decades, researchers and engineers proposed to use spatial metaphors in order to support human–computer interaction using concepts such as the “desktop” organization or web “sites” and “chatrooms”. The importance of space and place has been made more relevant with the ubiquitous computing paradigm, which aims at the integration of computation in physical objects and places (Weiser, 1991). Among other technologies in this domain, there is a surge of location-based services, which is to say mobile applications that take advantage of location information in various contexts like supporting group coordination, playing games or engaging users in learning activities (see Benford, 2005 for a review). The recent democratization of these services leads to a new feature called mutual location-awareness (MLA in the remainder of this paper): users can be informed of their own and/or their teammates’ locations. MLA raises interesting issues already studied within the CSCW community, such as how collaboration can benefit from interfaces that convey awareness of others. Dourish and Bellotti (1992) defined awareness as: “an understanding of the activities of others, which provides a context for your own activity” (p. 107). Drawing on this definition, location-awareness would be the understanding of the others’ position in the spatial environment. Gutwin and Greenberg (2002) stressed that awareness is knowledge about the state of the work environment in a limited portion of time and space. Since this information was not available in many collaborative applications, designers provided users with so-called “awareness tools.” These tools were expected to facilitate team collaboration by showing information about presence (is anyone in the workspace?), about their identity (who is that?), about their location (where is an individual?), about their actions (what is somebody doing?), and so forth. MLA is a specific category of awareness tools that provide the “where” information, i.e. the locations of each group member (Dyck and Gutwin, 2001). What is meant by “location” takes different forms; it can be a text message that indicates a person’s whereabouts or dots on a map. The adjective “mutual” covers knowing both one’s own location and the location of partners. It implies a notion of reciprocity: if person A may see her partners B and C’s location, then B and C also have access to A’s location (not necessarily in real time).

Different MLA interfaces have been developed: they differ in terms of methods for capturing the location (automatic versus self-disclosed), functions for posting a query (e.g. querying who is where and when) and how the information is rendered to the users. Most of the MLA interfaces use a visual output, often on a map, sometimes as textual description and in a few cases with more innovative visualizations. Past research about the role of MLA in collaborative virtual environments have shown that it supported implicit coordination and division of labor (Dillenbourg and Traum, 1997), as well as mutual understanding of each other’s intents (Nova et al., 2007).

MLA also relates to the communication practice of giving or asking geographical information in cell phone conversations. Various studies have shown that it helps people to mutually establish and share a spatio-temporal context (Laurier, 2001), allow group coordination for meetings (Weilenmann, 2003) or be an index of interactional availability (Arminen, 2006). Given the importance of this phenomenon, Arminen claims that a technical solution to indicate location-awareness would have a wide applicability for a majority of mobile users.

Although numerous mobile applications implemented and tested MLA interfaces, there have been few experiments to understand their effects on collaboration. Existing studies put more emphasis on the design than on the empirical investigation of how users’ behavior is influenced by knowing where the partners or the competitors are located. Therefore, we conducted an empirical study aimed at investigating the influence of MLA on group coordination in mobile settings. More specifically, we compared two interfaces that provide users with location-awareness: on the first interface, groups received automatic updates from teammates’ whereabouts, while this automatic MLA tool was not provided by the second interface. Using these two categories of interface, we investigated group cognitive processes such as communication and the representation each team member makes about one another, which allows groups to coordinate when performing a joint activity.

This paper first describes the related work about how socio-cognitive processes are impacted by MLA interfaces. The second section presents the theoretical framework we used to investigate this issue. After a brief description of our research scope, we detail the field experiment we conducted to understand the influence of MLA on collaboration. Finally, the last section discusses the outcomes and their consequences for practitioners.

Section snippets

Related work

Given that the core of our study concerns the comparison between automatic versus intentional location-awareness, it is necessary to state the role of MLA as well as the main drawbacks of automation in the context of collaborative applications.

A psycholinguistic framework to address MLA influence

As we have already mentioned, our field experiment will deal with the difference between automating location-awareness and letting users providing intentional messages about their whereabouts. It is therefore important to frame this study in a context that can account for the difference between these sorts of signals in the context of collaboration.

As we stated in the introduction, awareness refers to the perception and the understanding of others’ interactions in the environment. Awareness

Research questions

The previous sections reviewed examples of how and why MLA can enhance collaborative processes. Our framework leads us to assume that (1) shared models of each other’s course of action contribute to the coordination of joint activities and (2) a coordination device such as MLA, conveyed by technological tools, is expected to sustain shared models by supporting a more efficient mutual modeling process. As a consequence, MLA is expected to facilitate solving coordination problems and hence

Methodological choices

Balancing the needs to have an ecological validity and our aim for generalization led us to adopt a “field experiment” methodology (Goodman et al., 2004). It allowed us to involve real users in an activity that is set up in the real world as well as to control some variables and compare different experimental conditions.

We tested our hypotheses through quantitative measures, respectively group performance (H1) and mutual modeling accuracy (H2). We collected these data during an experiments in

Collaborative task performance (H1)

Our first hypothesis posited that the MLA tool would improve the task performance. Since it was a collaborative game, we analyzed the task performance at the group level, which corresponds to the group travel distance. As depicted in Fig. 3, groups in the 2 conditions had a very similar performance (Control: m=4859, sd=1670; MLA: m=5061, sd=1568); the only difference lay in the dispersion that is higher for players without the MLA. A one-way ANOVA test2

Use of coordination devices

As we described in our theoretical framework, the coordination process is achieved through mutual modeling acts that consist in making inferences based on coordination devices: where partners are or will be, if they are close to Bob or to the triangle, if the partners understood the strategy, etc. The coordination devices are the concrete items on which these inferences can be drawn. Message transcriptions and the replay interviews allowed us to better understand how players exchanged

Results summary

This field study has showed that MLA does not improve team performance in the whole game: the difference in task performance between groups is not significant. However, we found that automatic MLA could be more effective for tasks that would require finer grained coordination (such as the triangle formation). We also found that automatic MLA could lower the accuracy of mutual modeling. Groups without location information built a better mutual model: they made fewer errors when drawing the path

Conclusion

The field study of a pervasive game allowed us to deepen existing research about how mutual location-awareness influences coordination. Using a psycholinguistic framework, we examined in details the differences between automating MLA and the self-reporting of users’ whereabouts. Our results have highlighted the importance of intentionality and human agency, complementing the results of Benford et al. (2004). It did so through a quantitative study that can complement their qualitative analysis

Acknowledgments

This work was partly funded by a grant from the Swiss National Research Foundation (Grant no. 102511-106940). The CatchBob! project also benefited from all the players and the good inspiration of heavy dubstep tunes.

References (44)

  • I. Arminen

    The social functions of location in mobile telephony

    Personal and Ubiquitous Computing

    (2006)
  • Barkhuus, L., Chalmers, M., Tennent, P., Hall, M., Bell, M., Brown, B., 2005. Picking pockets on the lawn: the...
  • Benford, S., 2005. Future location-based experiences. JISC Technical Report...
  • S. Benford et al.

    Can you see me now?

    ACM Transactions on Computer–Human Interaction (TOCHI)

    (2006)
  • Benford, S., Rowland, D., Flintham, D., Drozd, A., Hull, R., Reid, J., Morrison, J., Facer, J., 2005. Life on the edge:...
  • Benford, S., Seager, W., Flintham, M., Anastasi, R., Rowland, D., Humble, J., Stanton, D., Bowers, J., Tandavanitj, N.,...
  • A.R. Beresford et al.

    Location privacy in pervasive computing

    IEEE Pervasive Computing

    (2002)
  • Brown, B., McColl, I., Chalmers, M., Galani, A., Randell, C. and Steed, A., 2003. Lessons from the lighthouse:...
  • Brown, B.A.T., Taylor, A.S., Izadi, S., Sellen, A., Kaye, J.J., Eardley, E., 2007. Locating family values: a field...
  • Chalmers, M., Juhlin, O., 2005. New uses for mobile pervasive games—lessons learned for CSCW systems to support...
  • H.H. Clark

    Using Language

    (1996)
  • J. Cohen

    Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit

    Psychological Bulletin

    (1968)
  • Consolvo, S., Smith, I., Matthews, T., LaMarca, A., Tabert, J., Powledge, P., 2005. Location disclosure to social...
  • J.W. Creswell

    Research Design: Qualitative and Quantitative Approaches

    (1994)
  • D. Dearman et al.

    Effect of location-awareness on rendezvous behaviour

    CHI Extended Abstracts

    (2005)
  • P. Dillenbourg

    What do you mean by “collaborative learning”?

  • Dillenbourg, P., Traum, D., 1997. The role of a whiteboard in a distributed cognitive system. Paper presented at the...
  • P. Dillenbourg et al.

    Sharing solutions: persistence and grounding in multimodal collaborative problem solving

    Journal of the Learning Sciences

    (2006)
  • Dourish, P., Bellotti, V., 1992. Awareness and coordination in shared workspaces. In: Turner, J., Kraut, R. (Eds.),...
  • Dyck, J., Gutwin, C., 2001. Where are you and what can you see? Maintaining location-awareness in collaborative 3D...
  • Espinosa, A.C., Rico-Gutierrez, J.J., Kraut, R.E., Scherlis, W., Lautenbacher, G., 2000. Coming to the wrong decision...
  • Goodman, J., Brewster, S., Gray, P., 2004. Using field experiments to evaluate mobile guides. In: Schmidt-Belz, B.,...
  • Cited by (4)

    • What signal is your inspection team sending to each other? Using a shared collaborative interface to improve shared cognition and implicit coordination in error-detection teams

      2013, International Journal of Human Computer Studies
      Citation Excerpt :

      Explicit coordination occurs when team members consciously employ purposeful and unambiguous mechanisms to help manage their tasks and communications (Malone and Crowston, 1994). Examples of such mechanisms include process structure and procedures (Dennis et al., 1996; Lowry et al., 2005), keeping track of the physical location of group members (Nova et al., 2010), task structure (Dennis et al., 1996; Lam, 1997), schedules, work plans, manuals, division of labor, direct communication, and frameworks such as the Capability Maturity Model (CMM). Despite the value of explicit coordination, researchers acknowledge that “good coordination is nearly invisible” (Malone and Crowston, 1994, p. 90).

    • Methods to observe and evaluate interactions with everyday context-aware objects

      2016, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    View full text