Ann Huang
Pascal Knierim
Francesco Chiossi
Lewis L Chuang
Robin Welsch
ABSTRACT
Augmented Reality (AR) embeds virtual content in physical spaces, including virtual agents that are known to exert a social presence on users. Existing design guidelines for AR rarely consider the social implications of an agent’s personal space (PS) and that it can impact user behavior and arousal. We report an experiment (N=54) where participants interacted with agents in an AR art gallery scenario. When participants approached six virtual agents (i.e., two males, two females, a humanoid robot, and a pillar) to ask for directions, we found that participants respected the agents’ PS and modulated interpersonal distances according to the human-like agents’ perceived gender. When participants were instructed to walk through the agents, we observed heightened skin-conductance levels that indicate physiological arousal. These results are discussed in terms of proxemic theory that result in design recommendations for implementing pervasive AR experiences with virtual agents.
Supplemental Material
- Sean Andrist, Michael Gleicher, and Bilge Mutlu. 2017. Looking coordinated: Bidirectional gaze mechanisms for collaborative interaction with virtual characters. In Proceedings of the 2017 CHI conference on human factors in computing systems. 2571–2582.Google Scholar
Digital Library
- Ebrahim Babaei, Benjamin Tag, Tilman Dingler, and Eduardo Velloso. 2021. A Critique of Electrodermal Activity Practices at CHI. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.Google ScholarDigital Library
- Michael Bach 1996. The Freiburg Visual Acuity Test-automatic measurement of visual acuity. Optometry and vision science 73, 1 (1996), 49–53.Google Scholar
- Jeremy N Bailenson, Jim Blascovich, Andrew C Beall, and Jack M Loomis. 2001. Equilibrium theory revisited: Mutual gaze and personal space in virtual environments. Presence: Teleoperators & Virtual Environments 10, 6(2001), 583–598.Google ScholarDigital Library
- Jeremy N Bailenson, Jim Blascovich, Andrew C Beall, and Jack M Loomis. 2003. Interpersonal distance in immersive virtual environments. Personality and social psychology bulletin 29, 7 (2003), 819–833.Google Scholar
- Michela Balconi, Giulia Fronda, and Angela Bartolo. 2021. Affective, social, and informative gestures reproduction in human interaction: hyperscanning and brain connectivity. Journal of Motor Behavior 53, 3 (2021), 296–315.Google ScholarCross Ref
- Istvan Barakonyi and Dieter Schmalstieg. 2006. Ubiquitous animated agents for augmented reality. In 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE, 145–154.Google ScholarDigital Library
- Elisabetta Bevacqua, Romain Richard, and Pierre De Loor. 2017. Believability and co-presence in human-virtual character interaction. IEEE computer graphics and applications 37, 4 (2017), 17–29.Google ScholarDigital Library
- Andrea Bönsch, Sina Radke, Heiko Overath, Laura M Asché, Jonathan Wendt, Tom Vierjahn, Ute Habel, and Torsten W Kuhlen. 2018. Social VR: How personal space is affected by virtual agents’ emotions. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 199–206.Google ScholarCross Ref
- Jason J Braithwaite, Derrick G Watson, Robert Jones, and Mickey Rowe. 2013. A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRs) for psychological experiments. Psychophysiology 49, 1 (2013), 1017–1034.Google Scholar
- Nicola Bruno and Michela Muzzolini. 2013. Proxemics revisited: Similar effects of arms length on men’s and women’s personal distances. Journal of Psychology 1, 2 (2013), 46–52.Google Scholar
- Marc E Caplan and Morton Goldman. 1981. Personal space violations as a function of height. The Journal of Social Psychology 114, 2 (1981), 167–171.Google ScholarCross Ref
- Alice Cartaud, Gennaro Ruggiero, Laurent Ott, Tina Iachini, and Yann Coello. 2018. Physiological response to facial expressions in peripersonal space determines interpersonal distance in a social interaction context. Frontiers in psychology 9 (2018), 657.Google Scholar
- Justine Cassell, Timothy Bickmore, Mark Billinghurst, Lee Campbell, Kenny Chang, Hannes Vilhjálmsson, and Hao Yan. 1999. Embodiment in conversational interfaces: Rea. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. 520–527.Google ScholarDigital Library
- Microsoft Corporation.2021. Microsoft Mesh.https://www.microsoft.com/en-us/meshGoogle Scholar
- Friederike Eyssel, Laura De Ruiter, Dieta Kuchenbrandt, Simon Bobinger, and Frank Hegel. 2012. ‘If you sound like me, you must be more human’: On the interplay of robot and user features on human-robot acceptance and anthropomorphism. In 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 125–126.Google ScholarDigital Library
- Don C Fowles, Margaret J Christie, Robert Edelberg, William W Grings, David T Lykken, and Peter H Venables. 1981. Publication recommendations for electrodermal measurements. Psychophysiology 18, 3 (1981), 232–239.Google ScholarCross Ref
- Epic Games.2021. High-Fidelity Digital Humans.https://www.unrealengine.com/en-US/digital-humansGoogle Scholar
- Maia Garau, Mel Slater, Vinoba Vinayagamoorthy, Andrea Brogni, Anthony Steed, and M Angela Sasse. 2003. The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. In Proceedings of the SIGCHI conference on Human factors in computing systems. 529–536.Google ScholarDigital Library
- Mar Gonzalez-Franco, Eyal Ofek, Ye Pan, Angus Antley, Anthony Steed, Bernhard Spanlang, Antonella Maselli, Domna Banakou, Núria Pelechano Gómez, Sergio Orts-Escolano, 2020. The Rocketbox library and the utility of freely available rigged avatars. Frontiers in virtual reality 1, article 561558 (2020), 1–23.Google Scholar
- Jens Grubert, Tobias Langlotz, Stefanie Zollmann, and Holger Regenbrecht. 2016. Towards pervasive augmented reality: Context-awareness in augmented reality. IEEE transactions on visualization and computer graphics 23, 6(2016), 1706–1724.Google Scholar
- José Guerreiro, Raúl Martins, Hugo Silva, André Lourenço, and Ana LN Fred. 2013. BITalino-A multimodal platform for physiological computing.. In ICINCO (1). 500–506.Google Scholar
- Edward Twitchell Hall. 1966. The hidden dimension. Vol. 609. Garden City, NY: Doubleday.Google Scholar
- Edward T Hall, Ray L Birdwhistell, Bernhard Bock, Paul Bohannan, A Richard Diebold Jr, Marshall Durbin, Munro S Edmonson, JL Fischer, Dell Hymes, Solon T Kimball, 1968. Proxemics [and comments and replies]. Current anthropology 9, 2/3 (1968), 83–108.Google Scholar
- Chad Harms and Frank Biocca. 2004. Internal consistency and reliability of the networked minds measure of social presence. (2004).Google Scholar
- Leslie A Hayduk. 1978. Personal space: An evaluative and orienting overview.Psychological bulletin 85, 1 (1978), 117.Google Scholar
- Leslie A Hayduk. 1981. The permeability of personal space.Canadian Journal of Behavioural Science/Revue canadienne des sciences du comportement 13, 3 (1981), 274.Google Scholar
- Leslie A Hayduk. 1983. Personal space: where we now stand.Psychological bulletin 94, 2 (1983), 293.Google Scholar
- Leslie A Hayduk. 1985. Personal space: The conceptual and measurement implications of structural equation models.Canadian Journal of Behavioural Science/Revue canadienne des sciences du comportement 17, 2 (1985), 140.Google Scholar
- Heiko Hecht, Robin Welsch, Jana Viehoff, and Matthew R Longo. 2019. The shape of personal space. Acta psychologica 193(2019), 113–122.Google Scholar
- Ann Huang, Pascal Knierim, Francesco Chiossi, Lewis Chuang, and Robin Welsch. 2022. Proxemics for Human-Agent Interaction in Augmented Reality. https://doi.org/10.18419/darus-2525Google ScholarCross Ref
- Tina Iachini, Yann Coello, Francesca Frassinetti, and Gennaro Ruggiero. 2014. Body space in social interactions: a comparison of reaching and comfort distance in immersive virtual reality. PloS one 9, 11 (2014), e111511.Google ScholarCross Ref
- Tina Iachini, Yann Coello, Francesca Frassinetti, Vincenzo Paolo Senese, Francesco Galante, and Gennaro Ruggiero. 2016. Peripersonal and interpersonal space in virtual and real environments: Effects of gender and age. Journal of Environmental Psychology 45 (2016), 154–164.Google ScholarCross Ref
- Labiba Jahan, Geeticka Chauhan, and Mark A Finlayson. 2018. A new approach to animacy detection. In Proceedings of the 27th International Conference on Computational Linguistics.Google Scholar
- Matthew Kay and Jacob O Wobbrock. 2016. Package ‘ARTool’. CRAN Repository (2016), 1–13.Google Scholar
- Hanseob Kim, Myungho Lee, Gerard J Kim, and Jae-In Hwang. 2021. The Impacts of Visual Effects on User Perception With a Virtual Human in Augmented Reality Conflict Situations. IEEE Access 9(2021), 35300–35312.Google ScholarCross Ref
- Kangsoo Kim, Luke Boelling, Steffen Haesler, Jeremy Bailenson, Gerd Bruder, and Greg F Welch. 2018. Does a digital assistant need a body? The influence of visual embodiment and social behavior on the perception of intelligent virtual agents in AR. In 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 105–114.Google ScholarCross Ref
- Kangsoo Kim, Gerd Bruder, and Gregory F Welch. 2018. Blowing in the wind: Increasing copresence with a virtual human via airflow influence in augmented reality. In International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments.Google Scholar
- Marc Erich Latoschik, Florian Kern, Jan-Philipp Stauffert, Andrea Bartl, Mario Botsch, and Jean-Luc Lugrin. 2019. Not alone here?! scalability and user experience of embodied ambient crowds in distributed social virtual reality. IEEE transactions on visualization and computer graphics 25, 5(2019), 2134–2144.Google ScholarCross Ref
- Benny Liebold, Daniel Pietschmann, and Peter Ohler. 2015. Do We Differ in Our Dispositional Tendency to Perceive Virtual Agents as Animate Beings?. In International Conference on Human-Computer Interaction. Springer, 452–462.Google ScholarCross Ref
- Joan Llobera, Bernhard Spanlang, Giulio Ruffini, and Mel Slater. 2010. Proxemics with multiple dynamic characters in an immersive virtual environment. ACM Transactions on Applied Perception (TAP) 8, 1 (2010), 1–12.Google ScholarDigital Library
- Dominique Makowski, Tam Pham, Zen J Lau, Jan C Brammer, François Lespinasse, Hung Pham, Christopher Schölzel, and SH Annabel Chen. 2021. NeuroKit2: A Python toolbox for neurophysiological signal processing. Behavior Research Methods(2021), 1–8.Google Scholar
- Samah Mansour, Mostafa El-Said, Carolyn Rude-Parkins, and Jagadeesh Nandigam. 2006. The interactive effect of avatar visual fidelity and behavioral fidelity in the collaborative virtual reality environment on the perception of social interaction. WSEAS Transactions on Communications 5, 8 (2006), 1501–1509.Google Scholar
- Nicolai Marquardt. 2013. Proxemic interactions with and around digital surfaces. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces. 493–494.Google ScholarDigital Library
- Nicolai Marquardt and Saul Greenberg. 2012. Informing the design of proxemic interactions. IEEE Pervasive Computing 11, 2 (2012), 14–23.Google ScholarDigital Library
- Antonella Maselli and Mel Slater. 2013. The building blocks of the full body ownership illusion. Frontiers in human neuroscience 7 (2013), 83.Google Scholar
- Mark Roman Miller, Hanseul Jun, Fernanda Herrera, Jacob Yu Villa, Greg Welch, and Jeremy N Bailenson. 2019. Social interaction in augmented reality. PloS one 14, 5 (2019), e0216290.Google ScholarCross Ref
- MRTK.2020. Mixed Reality Tool Kit.https://github.com/microsoft/MixedRealityToolkit-UnityGoogle Scholar
- Clifford Nass, Jonathan Steuer, and Ellen R Tauber. 1994. Computers are social actors. In Proceedings of the SIGCHI conference on Human factors in computing systems. 72–78.Google ScholarDigital Library
- The Metropolitan Museum of Art.2022. The Met.https://www.metmuseum.org/Google Scholar
- Catherine S Oh, Jeremy N Bailenson, and Gregory F Welch. 2018. A systematic review of social presence: Definition, antecedents, and implications. Frontiers in Robotics and AI 5 (2018), 114.Google ScholarCross Ref
- Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L Davidson, Sameh Khamis, Mingsong Dou, 2016. Holoportation: Virtual 3d teleportation in real-time. In Proceedings of the 29th annual symposium on user interface software and technology. 741–754.Google ScholarDigital Library
- Xueni Pan, Marco Gillies, Chris Barker, David M Clark, and Mel Slater. 2012. Socially anxious and confident men interact with a forward virtual woman: an experimental study. PloS one 7, 4 (2012), e32931.Google ScholarCross Ref
- Farid Pazhoohi, Carlos Silva, João Lamas, Sandra Mouta, Jorge Santos, and Joana Arantes. 2019. The effect of height and shoulder-to-hip ratio on interpersonal space in virtual environment. Psychological research 83, 6 (2019), 1184–1193.Google Scholar
- Thammathip Piumsomboon, Gun A Lee, Jonathon D Hart, Barrett Ens, Robert W Lindeman, Bruce H Thomas, and Mark Billinghurst. 2018. Mini-me: An adaptive avatar for mixed reality remote collaboration. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–13.Google ScholarDigital Library
- PTC.2021. Vuforia Engine.https://developer.vuforia.com/Google Scholar
- Iulian Radu, Tugce Joy, Yiran Bowman, Ian Bott, and Bertrand Schneider. 2021. A Survey of Needs and Features for Augmented Reality Collaborations in Collocated Spaces. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1(2021), 1–21.Google ScholarDigital Library
- Jens Reinhardt, Marco Kurzweg, and Katrin Wolf. 2021. Placement of Teleported Co-users in AR. In IFIP Conference on Human-Computer Interaction. Springer, 590–610.Google Scholar
- Martin S Remland, Tricia S Jones, and Heidi Brinkman. 1995. Interpersonal distance, body orientation, and touch: Effects of culture, gender, and age. The Journal of social psychology 135, 3 (1995), 281–297.Google ScholarCross Ref
- G Ruggiero, M Rapuano, A Cartaud, Y Coello, and T Iachini. 2021. Defensive functions provoke similar psychophysiological reactions in reaching and comfort spaces. Scientific Reports 11, 1 (2021), 1–12.Google ScholarCross Ref
- Robert Sommer. 1962. The distance for comfortable conversation: A further study. Sociometry 25, 1 (1962), 111–116.Google ScholarCross Ref
- Christopher J Soto and Oliver P John. 2017. Short and extra-short forms of the Big Five Inventory–2: The BFI-2-S and BFI-2-XS. Journal of Research in Personality 68 (2017), 69–81.Google ScholarCross Ref
- J Edward Swan, Adam Jones, Eric Kolstad, Mark A Livingston, and Harvey S Smallman. 2007. Egocentric depth judgments in optical, see-through augmented reality. IEEE transactions on visualization and computer graphics 13, 3(2007), 429–442.Google ScholarDigital Library
- Adobe Systems.2015. Mixamo.https://www.mixamo.com/#/Google Scholar
- Akikazu Takeuchi and Taketo Naito. 1995. Situated facial displays: towards social interaction. In Proceedings of the SIGCHI conference on Human factors in computing systems. 450–455.Google ScholarDigital Library
- John W Tukey 1977. Exploratory data analysis. Vol. 2. Reading, Mass.Google Scholar
- Unity.2004. Unity Technologies.https://unity.com/Google Scholar
- Matias Volonte, Yu-Chun Hsu, Kuan-Yu Liu, Joe P Mazer, Sai-Keung Wong, and Sabarish V Babu. 2020. Effects of interacting with a crowd of emotional virtual humans on users’ affective and non-verbal behaviors. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 293–302.Google ScholarCross Ref
- Michael E Walker, Daniel Szafir, and Irene Rae. 2019. The influence of size in augmented reality telepresence avatars. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 538–546.Google ScholarCross Ref
- Isaac Wang, Jesse Smith, and Jaime Ruiz. 2019. Exploring virtual agents for augmented reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.Google ScholarDigital Library
- Robin Welsch, Christoph von Castell, and Heiko Hecht. 2019. The anisotropy of personal space. PloS one 14, 6 (2019), e0217587.Google ScholarCross Ref
- Robin Welsch, Christoph von Castell, Martin Rettenberger, Daniel Turner, Heiko Hecht, and Peter Fromberger. 2020. Sexual attraction modulates interpersonal distance and approach-avoidance movements towards virtual agents in males. PloS one 15, 4 (2020), e0231539.Google ScholarCross Ref
- Jonathan Wendt, Benjamin Weyers, Jonas Stienen, Andrea Bönsch, Michael Vorländer, and Torsten W Kuhlen. 2019. Influence of Directivity on the Perception of Embodied Conversational Agents’ Speech. In Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents. 130–132.Google ScholarDigital Library
Index Terms
- Proxemics for Human-Agent Interaction in Augmented Reality
Recommendations
Effects of Posture and Embodiment on Social Distance in Human-Agent Interaction in Mixed Reality
IVA '18: Proceedings of the 18th International Conference on Intelligent Virtual AgentsMixed reality offers new potentials for social interaction experiences with virtual agents. In addition, it can be used to experiment with the design of physical robots. However, while previous studies have investigated comfortable social distances ...
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented RealityAugmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
Multi-sensorial virtual reality and augmented human food interaction
MHFI '16: Proceedings of the 1st Workshop on Multi-sensorial Approaches to Human-Food InteractionIn the field of virtual reality (VR) research, media technologies to create a realistic feeling of being present in a real/virtual world by duplicating multi-sensory information have been studied over a long period. Recently, technologies for multi-...
Comments