Yuanyuan Jiang
Skip Abstract Section
Abstract
We investigated how two people jointly coordinate their decisions and actions in a co-occupied, large-screen virtual environment. The task for participants was to physically cross a virtual road with continuous traffic without getting hit by a car. Participants performed this task either alone or with another person (see Figure 1). Two separate streams of non-stereo images were generated based on the dynamic locations of the two viewers’ eye-points. Stereo shutter glasses were programmed to display a single image stream to each viewer so that they saw perspectively correct non-stereo images for their eyepoint. We found that participant pairs often crossed the same gap together and closely synchronized their movements when crossing. Pairs also chose larger gaps than individuals, presumably to accommodate the extra time needed to cross through gaps together. These results demonstrate how two people interact and coordinate their behaviors in performing whole-body, joint motions in a co-occupied virtual environment. This study also provides a foundation for future studies examining joint actions in shared VEs where participants are represented by graphic avatars.
- Sabarish V. Babu et al. 2011. An immersive virtual peer for studying social influences on child cyclists’ road-crossing behavior. IEEE Trans. Vis. Comput. Graph. 17, 1 (2011), 14--25. Google Scholar
Digital Library
- Jeremy N. Bailenson, Andrew C. Beall, and Jim Blascovich. 2002. Gaze and task performance in shared virtual environments. J. Vis. Comput. Animat. 13, 5 (2002), 313--320.Google ScholarCross Ref
- Randolph Blake and Maggie Shiffrar. 2007. Perception of human motion. Annu. Rev. Psychol. 58 (2007), 47--73.Google ScholarCross Ref
- Marcel Brass, Harold Bekkering, and Wolfgang Prinz. 2001. Movement observation affects movement execution in a simple response task. Acta Psychol. 106, 1--2 (2001), 3--22.Google ScholarCross Ref
- Chih-hui Chang, Michael G. Wad, and Thomas A. Stoffregen. 2009. Perceiving affordances for aperture passage in an environment -- person -- person system. J. Mot. Behav. 41, 6 (2009), 495--500.Google ScholarCross Ref
- Tanya L. Chartrand and Rick van Baaren. 2009. Chapter 5 human mimicry. Adv. Exp. Soc. Psychol. 41, 8 (2009), 219--274.Google Scholar
- Benjamin J. Chihak et al. 2010. Synchronizing self and object movement: How child and adult cyclists intercept moving gaps in a virtual environment. J. Exp. Psychol. Hum. Percept. Perform. 36, 6 (2010), 1535--1552.Google ScholarCross Ref
- Carolina Cruz-Neira, Daniel J. Sandin, Thomas A. DeFanti, Robert V. Kenyon, and John C. Hart. 1992. The CAVE: Audio visual experience automatic virtual environment. Commun. ACM 35, 6 (1992), 64--72. Google ScholarDigital Library
- James E. Cutting and Lynn T. Kozlowski. 1977. Recognizing friends by their walk: Gait perception without familiarity cues. Bull. Psychon. Soc. 9, 5 (1977), 353--356.Google ScholarCross Ref
- Jiyang Duan, Zhizhong Li, and Gavriel Salvendy. 2012. Automatic imitation of risky behavior: A study of simulated driving in China. Traffic Inj. Prev. 13, 5 (2012), 442--449.Google ScholarCross Ref
- Jolyon J. Faria, Stefan Krause, and Jens Krause. 2010. Collective behavior in road-crossing pedestrians: The role of social information. Behav. Ecol. 21, 6 (2010), 1236--1242.Google ScholarCross Ref
- Maia Garau, Mel Slater, Vinoba Vinayagamoorthy, Andrea Brogni, Anthony Steed, and M. Angela Sasse. 2003. The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtua l environment. New Dir. Video Conf. 5, 1 (2003), 529--536. Google ScholarDigital Library
- James J. Gibson. 1979. The ecological approach to visual perception. Hillsdale, NJ: Erlbaum.Google Scholar
- Timofey Y. Grechkin, Benjamin J. Chihak, James F. Cremer, Joseph K. Kearney, and Jodie M. Plumert. 2012. Perceiving and acting on complex affordances: How children and adults bicycle across two lanes of opposing traffic. J. Exp. Psychol. Hum. Percept. Perform. 39, 1 (2012), 23--36.Google ScholarCross Ref
- Chris GreenHalgn and Steven Benford. 1995. MASSIVE: A collaborative virtual environment for teleconferencing. ACM Trans. Comput. Interact. 2, 3 (1995), 239--261. Google ScholarDigital Library
- N. Guéguen and N. Pichot. 2001. The influence of status on pedestrians’ failure to observe a road-safety rule. J. Soc. Psychol. 141, 3 (2001), 413--415.Google ScholarCross Ref
- Cecilia Heyes. 2011. Automatic imitation. Psychol. Bull. 137, 3 (2011), 463--483.Google ScholarCross Ref
- Katherine Isbister et al. 2000. Helper agent: Designing an assistant for human-human interaction in a virtual meeting space. CHI 2, 1 (2000), 57--64. Google ScholarDigital Library
- Yuanyuan Jiang, Elizabeth E. O. Neal, Luke Franzen, Junghum Paul Yon, Jodie M. Plumert, and Joseph K. Kearney. 2017. The influence of stereoscopic image display on pedestrian road crossing in a large-screen virtual environment. In Proceedings of ACM Symposium on Applied Percetion. Google ScholarDigital Library
- Yuanyuan Jiang, Elizabeth O. Neal, Pooya Rahimian, Junghum Paul, Yon Jodie, and Joseph K. Kearney. 2016. Action coordination with agents: Crossing roads with a computer-generated character in a virtual environment. In Proceedings of the Symposium on Applied Perception. Google ScholarDigital Library
- James M. Kilner, Claudia Vargas, Sylvie Duval, Sarah-Jayne Blakemore, and Angela Sirigu. 2004. Motor activation prior to observation of a predicted movement. Nat. Neurosci. 7, 12 (2004), 1299--1301.Google ScholarCross Ref
- Jessica L. Lakin and Tanya L. Chartrand. 2003. Using nonconscious behavioral mimicry to create affiliation and rapport. Psychol. Sci. 14, 4 (2003), 334--339.Google ScholarCross Ref
- M. Lefkowitz, R. R. Blake, and J. S. Mouton. 1955. Status factors in pedestrain violation of traffic signals. J. Abnorm. Psychol. 51, 3 (1955), 704--706.Google ScholarCross Ref
- Erin A. Mcmanus and Stephan De Rosa. 2011. The influence of avatar (self and character) animations on distance estimation, object interaction and locomotion in immersive virtual environments. ACM SIGGRAPH Symp. Appl. Percept. Graph. Vis. 1, 212 (2011), 37--44. Google ScholarDigital Library
- Jean-Marie Normand, Bernhard Spanlang, Franco Tecchia, Marcello Carrozzino, David Swapp, and Mel Slater. 2012. Full body acting rehearsal in a networked virtual environment—A case study. Presence 21, 2 (2012), 229--243. Google ScholarDigital Library
- Giovanni Pezzulo, Francesco Donnarumma, and Haris Dindo. 2013. Human sensorimotor communication: A theory of signaling in online social interactions. PLoS One 8, 11 (2013).Google Scholar
- Andrew B. Raij et al. 2007. Comparing interpersonal interactions with a virtual human to those with a real human. IEEE Trans. Vis. Comput. Graph. 13, 3 (2007), 443--57. Google ScholarDigital Library
- Brian Ries, Victoria Interrante, Michael Kaeding, and Lane Phillips. 2009. Analyzing the effect of a virtual avatarʼs geometric and motion fidelity on egocentric spatial perception in immersive virtual environments. Proceedings of the 16th ACM Symp. Virtual Real. Softw. Technol. 1, 212 (2009), 59--66. Google ScholarDigital Library
- Giacomo Rizzolatti, Giacomo Rizzolatti, Luciano Fadiga, Vittorio Gallese, and Leonardo Fogassi. 1996. Premotor cortex and the recognition of motor actions. Cogn. Brain Res. 3, 2 (1996), 131--141.Google ScholarCross Ref
- Lucia Maria Sacheli, Emmanuele Tidoni, Enea Francesco Pavone, Salvatore Maria Aglioti, and Matteo Candidi. 2013. Kinematics fingerprints of leader and follower role-taking during cooperative joint actions. Exp. Brain Res. 226, 4 (2013), 473--486.Google ScholarCross Ref
- Natalie Sebanz, Harold Bekkering, and Günther Knoblich. 2006. Joint action: Bodies and minds moving together. Trends Cogn. Sci. 10, 2 (2006), 70--76.Google ScholarCross Ref
- M. Slater, A. Sadagic, M. Usoh, and R. Schroeder. 2000. Small-group behavior in a virtual and real environment: A comparative study. Presence 9, 1 (2000), 37--51. Google ScholarDigital Library
- Erin Stevens, Jodie M. Plumert, James F. Cremer, and Joseph K. Kearney. 2013. Preadolescent temperament and risky behavior: Bicycling across traffic-filled intersections in a virtual environment. J. Pediatr. Psychol. 38, 3 (2013), 285--295.Google ScholarCross Ref
- Nikolaus F. Troje, Nikolaus F. Troje, Cord Westhoff, Cord Westhoff, Mikhail Lavrov, and Mikhail Lavrov. 2005. Person identification from biological motion: Effects of structural and kinematic cues. Percept. Psychophys. 67, 4 (2005), 667--75.Google ScholarCross Ref
- Jan Vanrie and Karl Verfaillie. 2004. Perception of biological motion: A stimulus set of human point-light actions. Behav. Res. Methods. Instrum. Comput. 36, 4 (2004), 625--629.Google ScholarCross Ref
- David S. Young and David N. Lee. 1987. Training children in road-crossing skills using a roadside simulation. Accid. Anal. Prev. 19, 5 (1987), 327--341.Google ScholarCross Ref
Index Terms
- Acting Together: Joint Pedestrian Road Crossing in an Immersive Virtual Environment
Recommendations
Crossing Roads with a Computer-generated Agent: Persistent Effects on Perception–Action Tuning
This study investigated how people coordinate their decisions and actions with a risky or safe computer-generated agent in a humanoid or non-humanoid form and how this experience influences later behavior when acting alone. In Experiment 1, participants ...
Action coordination with agents: crossing roads with a computer-generated character in a virtual environment
SAP '16: Proceedings of the ACM Symposium on Applied PerceptionWe investigated how people jointly coordinate their decisions and actions with a computer-generated character (agent) in a large-screen virtual environment. The task for participants was to physically cross a steady stream of traffic on a virtual road ...
The influence of stereoscopic image display on pedestrian road crossing in a large-screen virtual environment
SAP '17: Proceedings of the ACM Symposium on Applied PerceptionThis paper investigates the influence of stereoscopic vs. non-stereoscopic display in large-screen virtual environments on an everyday perception-action task - crossing traffic-filled roadways as a pedestrian. The task for participants was to physically ...
Comments