Phoebe O. Toups Dugas
Andruid Kerne
William A. Hamilton
Skip Abstract Section
Abstract
Crisis response engenders a high-stress environment in which teams gather, transform, and mutually share information. Prior educational approaches have not successfully addressed these critical skills. The assumption has been that the highest fidelity simulations result in the best learning. Deploying high-fidelity simulations is expensive and dangerous; they do not address team coordination. Low-fidelity approaches are ineffective because they are not stressful.
Zero-fidelity simulation develops and invokes the principle of abstraction, focusing on human-information and human-human transfers of meaning, to derive design from work practice. Our principal hypothesis is that crisis responders will experience zero-fidelity simulation as effective simulation of team coordination. We synthesize the sustained iterative design and evaluation of the Team Coordination Game. We develop and apply new experimental methods to show that participants learn to cooperate and communicate, applying what they learn in practice. Design implications address how to employ the abstraction principle to develop zero-fidelity simulations.
- Alexander, A. L., Brunyé, T., Sidman, J., and Weil, S. A. 2005. From gaming to training: A review of studies on fidelity, immersion, presence, and buy-in and their effects on transfer in PC-based simulations and games. White paper, DARWARS Training Impact Group.Google Scholar
- Allen, J. 1986. Maintenance training simulator fidelity and individual differences in transfer of training. Human Factors 28, 497--509. Google ScholarDigital Library
- Antonisse, J. and Johnson, D. 2008. Hush. http://interactive.usc.edu/members/jantonisse/2008/01/hush.html.Google Scholar
- Backlund, P., Engstrom, H., Hammar, C., Johannesson, M., and Lebram, M. 2007. Sidh—a game-based firefighter training simulation. In Proceedings of the 11th International Conference on Information Visualization. 899--907. Google ScholarDigital Library
- Beaubien, J. M. and Parker, D. P. 2004. The use of simulation for training teamwork skills in health care: How low can you go? Qual. Safety Health Care 13, 51--56.Google ScholarCross Ref
- C3FIRE. 2009. C3Fire—home. http://c3fire.org.Google Scholar
- Cannon-Bowers, J. A. and Salas, E. 1998. Team performance and training in complex environments: Recent findings from applied research. Current Directions Psychol. Sci. 7, 3, 83--89.Google ScholarCross Ref
- Cannon-Bowers, J. A., Salas, E., Blickensderfer, E., and Bowers, C. A. 1998. The impact of cross-training and workload on team functioning: A replication and extension of initial findings. Human Factors 40, 92--101.Google ScholarCross Ref
- Cannon-Bowers, J. A., Salas, E., and Converse, S. 1993. Shared mental models in expert team decision making. In Individual and Group Decision Making: Current Issues, N. John Castellan Jr, Ed., Earlbaum Associates, Hillsdale, NJ, 221--246.Google Scholar
- Carlson, G. P., Ed. 1983. Incident Command System 1st Ed., Fire Protection Publications.Google Scholar
- Charmaz, K. 2006. Constructing Grounded Theory 1st Ed. Sage Publications Ltd.Google Scholar
- Daryaee, T. 2005. Chess. In Medieval Islamic Civilization: An Encyclopedia, Vol. 1, J. W. Meri, Ed., Routledge, New York, NY, 148--149.Google Scholar
- Endsley, M. R. 2000. Theoretical underpinnings of situation awareness: A critical review. In Situation Awareness Analysis and Measurement, M. R. Endsley and D. J. Garland, Eds., Lawrence Erlbaum Associates, Mahwah, NJ, 3--6.Google Scholar
- Entertainment Technology Center. 2005. HazMat: Hotzone. http://www.etc.cmu.edu/projects/hazmat 2005/index.php.Google Scholar
- Entin, E. E. and Serfaty, D. 1999. Adaptive team coordination. Human Factors 41, 2, 312--325.Google ScholarCross Ref
- Ericsson, K. A. and Simon, H. A. 1992. Protocol Analysis: Verbal Reports as Data Revised Ed., MIT Press.Google Scholar
- Frechtling, J. and Sharp, L. 1997. User-Friendly Handbook for Mixed Method Evaluations. NSF Directorate for Education and Human Resources.Google Scholar
- Gagné, R. M. 1954. Training devices and simulators: Some research issues. Amer. Psychol. 9, 3, 95--107.Google ScholarCross Ref
- Gentner, D. and Stevens, A. L. 1983. Mental Models. Lawrence Earlbaum Associates, Hillsdale, NJ.Google Scholar
- Granlund, R., Johansson, B., and Persson, M. 2001. C3Fire a micro-world for collaboration training in the ROLF environment. In Proceedings of the 42nd Conference on Simulation and Modelling, Simulation Theory and Practice. Scandinavian Simulation Society.Google Scholar
- Gurtner, A., Tschan, F., Semmer, N. K., and Nägele, C. 2007. Getting groups to develop good strategies: Effects of reflexivity interventions on team process, team performance, and shared mental models. Org. Behav. Human Decision Proc. 102, 127--142.Google ScholarCross Ref
- Hamilton, W. A., Toups Dugas, P. O., and Kerne, A. 2009. Synchronized communication and coordinated views: Qualitative data discovery for team game user studies. In Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA). 4573--4578. Google ScholarDigital Library
- Hays, R. T. and Singer, M. J. 1989. A conceptual history of training fidelity. In Simulation Fidelity in Training System Design: Bridging the Gap Between Reality and Training. Recent Research in Psychology. Springer-Verlag, Berlin, 23--46.Google Scholar
- Heath, C. and Luff, P. 2000. Team work: Collaboration and control in London Underground line control rooms. In Technology in Action, R. Pea, J. S. Brown, and C. Heath, Eds., Learning in Doing: Social, Cognitive, and Computational Perspectives, Cambridge University Press, Cambridge, UK, 88--124.Google Scholar
- Hollan, J., Hutchins, E., and Kirsh, D. 2000. Distributed cognition: Toward a new foundation for human-computer interaction research. ACM Trans. Comput.-Hum. Interact. 7, 2, 174--196. Google ScholarDigital Library
- Hutchins, E. 1995a. Cognition in the Wild. MIT Press, Cambridge, MA.Google Scholar
- Hutchins, E. 1995b. How a cockpit remembers its speeds. Cognitive Sci. 19, 3, 265--288.Google ScholarCross Ref
- Jiang, X., Hong, J. I., Takayama, L. A., and Landay, J. A. 2004. Ubiquitous computing for firefighters: Field studies and prototypes of large displays for incident command. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM Press, 679--686. Google ScholarDigital Library
- Johansson, B. and Branlund, R. 2003. C3Fire in command and control research. Cognition, Technol. Work 5, 3, 191--196.Google ScholarCross Ref
- Jonassen, D. H. and Henning, P. 1996. Mental models: Knowledge in the head and knowledge in the world. In Proceedings of the International Conference on Learning Sciences (ICLS). International Society of the Learning Sciences, 433--438. Google ScholarDigital Library
- Kerne, A. 2005. Doing interface ecology: The practice of metadisciplinarity. In Electronic Art and Animation Catalog. SIGGRAPH, ACM Press, 181--185. Google ScholarDigital Library
- Kleinman, D. L. and Serfaty, D. 1989. Team performance assessment in distributed decision making. In Proceedings of Interactive Networked Simulation For Training, R. Gilson, J. P. Kincaid, and B. Goldiez, Eds., 22--27.Google Scholar
- Kozlowski, S. W. J. and Deshon, R. P. 2004. A psychological fidelity approach to simulation-based training: Theory, research and principles. In Scaled Worlds: Development, Validation, and Applications, S. G. Schiflett, L. R. Elliott, E. Salas, and M. D. Coovert, Eds., Ashgate Pub. Ltd., 75--99.Google Scholar
- Landgren, J. 2006. Making action visible in time-critical work. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM Press, 201--210. Google ScholarDigital Library
- Landgren, J. and Nulden, U. 2007. A study of emergency response work: Patterns of mobile phone interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM Press, 1323--1332. Google ScholarDigital Library
- Lave, J. and Wenger, E. 1991. Situated Learning: Legitimate Peripheral Participation. Learning in Doing: Social, Cognitive, and Computational Perspectives. Cambridge University Press, Cambridge, UK.Google ScholarCross Ref
- MacMillan, J., Entin, E. E., and Serfaty, D. 2004. Communication overhead: The hidden cost of team cognition. In Team Cognition: Understanding the Factors that Drive Process and Performance 1st Ed., E. Salas and S. M. Fiore, Eds., American Psychological Association, Washington, DC, 61--82.Google Scholar
- Marks, M. A., Sabella, M. J., Burke, C. S., and Zaccaro, S. J. 2002. The impact of cross-training on team Effectiveness. J. Applied Psychol. 87, 1, 3--13.Google ScholarCross Ref
- Mathieu, J. E., Goodwin, G. F., Heffner, T. S., Salas, E., and Cannon-Bowers, J. A. 2000. The influence of shared mental models on team process and performance. J. Applied Psychol. 85, 2, 273--283.Google ScholarCross Ref
- NFPA. 2001. NFPA 1710 Standard for the Organization and Deployment of Fire Suppression Operations, Emergency Medical Operations, and Special Operations to the Public by Career Fire Departments. National Fire Protection Association International.Google Scholar
- Norman, D. A. 2002. The psychopathology of everyday things. In The Design of Everyday Things 2002 Edition. Basic Books, New York, NY, 1--33. Google ScholarDigital Library
- Palen, L., Anderson, K. M., Mark, G., Martin, J., Sicker, D., Palmer, M., and Grunwald, D. 2010. A vision for technology-mediated support for public participation & assistance in mass emergencies & disasters. In Proceedings of the ACM-BCS Visions of Computer Science Conference (BCS). British Computer Society, Swinton, UK, 8:1--8:12. Google ScholarDigital Library
- Petersen, S., Romero, J., and Green, S. 1993. DOOM. {PC}. id Software.Google Scholar
- Reder, L. and Klatzky, R. L. 1994. Transfer: Training for performance. In Learning, Remembering, Believing: Enhancing Human Performance, D. Druckman and R. A. Bjork, Eds., National Academies Press, Washington, DC, 25--56.Google Scholar
- Rehmann, A. J., Mitman, R. D., and Reynolds, M. C. 1995. A handbook of flight simulation fidelity requirements for human factors research. Tech. rep. DOT/FAA/CT-TN95/46, Crew System Ergonomics Information Analysis Center, Wright-Patterson AFB, OH.Google Scholar
- Reynolds, C. W. 1987. Flocks, herds and schools: A distributed behavioral model. In Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH). ACM Press, 25--34. Google ScholarDigital Library
- Riddell, R. 1997. Doom goes to war. Wired Mag. 5.04.Google Scholar
- Salas, E., Dickinson, T. L., Converse, S. A., and Tannenbaum, S. I. 1992. Toward an understanding of team performance and training. In Teams: Their Training and Performance, R. W. Swezey and E. Salas, Eds., Ablex Publishing Corporation, Norwood, NJ, 3--29.Google Scholar
- Salen, K. and Zimmerman, E. 2004a. Games as the play of pleasure. In Rules of Play: Game Design Fundamentals. MIT Press, Cambridge, MA, 328--361. Google ScholarDigital Library
- Salen, K. and Zimmerman, E. 2004b. Meaningful play. In Rules of Play: Game Design Fundamentals. MIT Press, Cambridge, MA, 30--37. Google ScholarDigital Library
- Salen, K. and Zimmerman, E. 2004c. Rules of Play: Game Design Fundamentals. MIT Press, Cambridge, MA. Google ScholarDigital Library
- Schaafstal, A. M., Johnston, J. H., and Oser, R. L. 2001. Training teams for emergency management. Comput. Human Behav. 17, 615--625.Google ScholarCross Ref
- Schechner, R. 1985. Restoration of behavior. In Between Theater and Anthropology, University of Pennsylvania Press, Philadelphia, PA, 35--116.Google Scholar
- Schön, D. A. 1984. The Reflective Practitioner: How Professionals Think in Action. Basic Books, New York, NY.Google Scholar
- Serfaty, D. E., Entin, E. E., and Volpe, C. 1993. Adaptation to stress in team decision-making and coordination. In Proceedings of the Human Factors and Ergonomics Society 37th Annual Meeting. Vol. 37. Human Factors and Ergonomics Society, 1228--1233.Google Scholar
- Shapiro, M. J., Morey, J. C., Small, S. D., Langford, V., Kaylor, C. J., Jagminas, L., Suner, S., Salisbury, M. L., Simon, R., and Jay, G. D. 2004. Simulation based teamwork training for emergency department staff: Does it improve clinical team performance when added to an existing didactic teamwork curriculum? Qual. Safety Health Care 13, 417--421.Google ScholarCross Ref
- Sims, K. 1990. Particle animation and rendering using data parallel computation. In Proceedings of the 17th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH). ACM Press, 405--413. Google ScholarDigital Library
- Small, S. D., Wuerz, R. C., Simon, R., Shapiro, N., Conn, A., and Setnick, G. 1999. Demonstration of a high-fidelity simulation team training for emergency medicine. Simulation Train. 6, 4, 312--323.Google Scholar
- Smith, S. M. 1994. Getting into and out of mental ruts: A theory of fixation, incubation, and insight. In The Nature of Insight, R. J. Sternberg and J. Davidson, Eds., MIT Press, Cambridge, MA, 229--252.Google Scholar
- Song, A. A. and Kleinman, D. L. 1994. A distributed simulation system for team decision-making. In Proceedings of the 5th Annual Conference on AI, Simulation, and Planning in High Autonomy Systems, Distributed Interactive Environments. IEEE, 129--135.Google Scholar
- St. Julien, T. U. and Shaw, C. D. 2003. Firefighter command training virtual environment. In Proceedings of the Conference on Diversity in Computing (TAPIA). ACM Press, New York, NY, 30--33. Google ScholarDigital Library
- Strauss, A. and Corbin, J. 1998. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory 2nd Ed. Sage Publications, Inc.Google Scholar
- Tate, D. L., Sibert, L., and King, T. 1997. Using virtual environments to train firefighters. Comput. Graphics Appl. 17, 6, 23--29. Google ScholarDigital Library
- Texas Engineering Extension Service. 2000. A Legacy of Service: The Texas Fire School 1930--2000. Emergency Services Training Institute.Google Scholar
- Thiel, A., Stern, J., Kimball, J., and Hankin, N. 2003. Trends and hazards in firefighter training—special report. Tech. rep. USFA-TR-100, United States Fire Administration.Google Scholar
- Thorndike, E. L. and Woodworth, R. S. 1901. The influence of improvement in one mental function upon the efficiency of other functions (I). Psychol. Rev. 8, 247--261.Google ScholarCross Ref
- Toups Dugas, P. O. and Kerne, A. 2007. Implicit coordination in firefighting practice: Design implications for teaching fire emergency responders. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM Press, 707--716. Google ScholarDigital Library
- Toups Dugas, P. O., Kerne, A., and Hamilton, W. 2009a. Game design principles for engaging cooperative play: Core mechanics and interfaces for non-mimetic simulation of fire emergency response. In Proceedings of the ACM SIGGRAPH Symposium on Video Games (Sandbox). ACM Press, 71--78. Google ScholarDigital Library
- Toups Dugas, P. O., Kerne, A., and Hamilton, W. 2009b. Motivating play through score. In ACM Computer Human Interaction Workshop on Engagement by Design.Google Scholar
- Toups Dugas, P. O., Kerne, A., Hamilton, W., and Blevins, A. 2009. Emergent team coordination: From fire emergency response practice to a non-mimetic simulation game. In Proceedings of the ACM International Conference on Supporting Group Work (GROUP). ACM Press, 341--350. Google ScholarDigital Library
- Toups Dugas, P. O., Kerne, A., Hamilton, W. A., and Shahzad, N. 2011. Zero-fidelity simulation of fire emergency response: Improving team coordination learning. In Proceedings of the Annual Conference on Human Factors in Computing Systems. (CHI). ACM, New York, NY, 1959--1968. Google ScholarDigital Library
- U.S. Department Of Homeland Security. 2008. National Incident Management System. U.S. Department of Homeland Security, Washington, DC.Google Scholar
- Volpe, C. E., Cannon-Bowers, J. A., and Salas, E. 1996. The impact of cross-training on team functioning: An empirical investigation. Human Factors 38, 87--100.Google ScholarCross Ref
- Welch, B. L. 1947. The generalization of the “Student's” problem when several different population variances are involved. Biometrika 34, 1-2, 28--35.Google ScholarCross Ref
- Wieder, M. A., Smith, C. M., and Brakhage, C. S. 1993. Fire Service Orientation and Terminology 3rd Ed. Fire Protection Publications, Oklahoma State University, Stillwater, OK.Google Scholar
Index Terms
- The Team Coordination Game: Zero-fidelity simulation abstracted from fire emergency response practice
Recommendations
Implicit coordination in firefighting practice: design implications for teaching fire emergency responders
CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsFire emergency response requires rapidly processing and communicating information to coordinate teams that protect lives and property. Students studying to become fire emergency responders must learn to communicate, process, and integrate information ...
Zero-fidelity simulation of fire emergency response: improving team coordination learning
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsFire emergency responders rely on team coordination to survive and succeed in high-stress environments, but traditional education does not directly teach these essential skills. Prior simulations seek the highest possible fidelity, employing resources to ...
Emergent team coordination: from fire emergency response practice to a non-mimetic simulation game
GROUP '09: Proceedings of the 2009 ACM International Conference on Supporting Group WorkWe take the work practices of fire emergency responders as the basis for developing simulations to teach team coordination. We introduce non-mimetic simulation: economic operational environments that represent human-centered components of practice, such ...
Comments