ABSTRACT
An emerging form of telecollaboration utilizes situated or mobile displays at a physical destination to virtually represent remote visitors. An example is a personal telepresence robot, which acts as a physical proxy for a remote visitor, and uses cameras and microphones to capture its surroundings, which are transmitted back to the visitor. We propose the use of spherical displays to represent telepresent visitors at a destination. We suggest that the use of such 360 degree displays in a telepresence system has two key advantages: it is possible to understand the identity of the visitor from any viewpoint; and with suitable graphical representation, it is possible to tell where the visitor is looking from any viewpoint. In this paper, we investigate how to optimally represent a visitor as an avatar on a spherical display by evaluating how varying representations are able to accurately convey head gaze.
- Anstis, S., Mayhew, J., and Morley, T. The perception of where a face or television 'portrait' is looking. The American Journal of Psychology 82, 4 (1969), 474--489.Google ScholarCross Ref
- Barthel, C., and Rowe, S. Visitor interactions with 3-d visualizations on a spherical display at a science museum. In OCEANS 2008 (sept. 2008), 1.Google ScholarCross Ref
- Benford, S., Greenhalgh, C., Reynard, G., Brown, C., and Koleva, B. Understanding and constructing shared spaces with mixed-reality boundaries. ACM Transactions on computer-human interaction (TOCHI) 5, 3 (1998), 185--223. Google ScholarDigital Library
- Benko, H., Wilson, A., and Balakrishnan, R. Sphere: multi-touch interactions on a spherical display. In Proceedings of the 21st annual ACM symposium on User interface software and technology, ACM (2008), 77--86. Google ScholarDigital Library
- Benko, H., and Wilson, A. D. Design Challenges of Interactive Spherical User Interfaces. 2009, 1--4.Google Scholar
- Blinn, J., and Newell, M. Texture and reflection in computer generated images. Communications of the ACM 19, 10 (1976), 542--547. Google ScholarDigital Library
- Desai, M., Tsui, K., Yanco, H., and Uhlik, C. Essential features of telepresence robots. In Technologies for Practical Robot Applications (TePRA), 2011 IEEE Conference on, IEEE (2011), 15--20.Google ScholarCross Ref
- Gibson, J., and Pick, A. Perception of another person's looking behavior. The American Journal of Psychology 76, 3 (1963), 386--394.Google ScholarCross Ref
- Greene, N. Environment mapping and other applications of world projections. Computer Graphics and Applications, IEEE 6, 11 (nov. 1986), 21--29. Google ScholarDigital Library
- Grossman, T., Wigdor, D., and Balakrishnan, R. Multi-finger gestural interaction with 3d volumetric displays. In Proceedings of the 17th annual ACM symposium on User interface software and technology, ACM (2004), 61--70. Google ScholarDigital Library
- Hauber, J., Regenbrecht, H., Billinghurst, M., and Cockburn, A. Spatiality in videoconferencing: trade-offs between efficiency and social presence. In Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work, ACM (2006), 413--422. Google ScholarDigital Library
- Isaacs, E., and Tang, J. What video can and cannot do for collaboration: a case study. Multimedia Systems 2, 2 (1994), 63--73. Google ScholarDigital Library
- Ishiguro, H., Ono, T., Imai, M., Maeda, T., Kanda, T., and Nakatsu, R. Robovie: an interactive humanoid robot. Industrial robot: An international journal 28, 6 (2001), 498--504.Google Scholar
- Itoh, K., Miwa, H., Onishi, Y., Imanishi, K., Hayashi, K., and Takanishi, A. Development of face robot to express the individual face by optimizing the facial features. In Humanoid Robots, 2005 5th IEEE-RAS International Conference on, IEEE (2005), 412--417.Google ScholarCross Ref
- Jones, A., Lang, M., Fyffe, G., Yu, X., Busch, J., McDowall, I., Bolas, M., and Debevec, P. Achieving eye contact in a one-to-many 3d video teleconferencing system. In ACM Transactions on Graphics (TOG), vol. 28, ACM (2009), 64. Google ScholarDigital Library
- Jones, A., McDowall, I., Yamada, H., Bolas, M., and Debevec, P. Rendering for an interactive 360 light field display. ACM Transactions on Graphics (TOG) 26, 3 (2007), 40. Google ScholarDigital Library
- Kettner, S., Madden, C., and Ziegler, R. Direct rotational interaction with a spherical projection. In In Interaction: Systems, Practice and Theory Proceedings (2004).Google Scholar
- Knoblauch, D., Font, P. M., and Kuester, F. Virtualizeme: Real-time avatar creation for tele-immersion environments. In IEEE Virtual Reality 2010 Proceedings, IEEE (2010), 279--280. Google ScholarDigital Library
- Krum, D., Suma, E., and Bolas, M. Augmented reality using personal projection and retroreflection. Personal and Ubiquitous Computing, 1--10. 10.1007/s00779-011-0374-4. Google ScholarDigital Library
- Lee, M. K., and Takayama, L. "now, i have a body": uses and social norms for mobile remote presence in the workplace. In Proceedings of the 2011 annual conference on Human factors in computing systems, CHI '11, ACM (New York, NY, USA, 2011), 33--42. Google ScholarDigital Library
- Lincoln, P., Welch, G., Nashel, A., State, A., Ilie, A., and Fuchs, H. Animatronic shader lamps avatars. Virtual Reality (2009), 1--14. Google ScholarDigital Library
- Milgram, P., and Kishino, F. A taxonomy of mixed reality visual displays. IEICE Transactions on Information and Systems E series D 77 (1994), 1321--1321.Google Scholar
- Mori, M. The uncanny valley. Energy 7, 4 (1970), 33--35.Google Scholar
- Naimark, M. Elements of realspace imaging: A proposed taxonomy. In Proc. SPIE, vol. 1457 (1991).Google Scholar
- Prince, S., Cheok, A., Farbiz, F., Williamson, T., Johnson, N., Billinghurst, M., and Kato, H. 3d live: Real time captured content for mixed reality. In Mixed and Augmented Reality, 2002. ISMAR 2002. Proceedings. International Symposium on, IEEE (2002), 7--317. Google ScholarDigital Library
- Roberts, D., Wolff, R., Rae, J., Steed, A., Aspin, R., McIntyre, M., Pena, A., Oyekoya, O., and Steptoe, W. Communicating eye-gaze across a distance: Comparing an eye-gaze enabled immersive collaborative virtual environment, aligned video conferencing, and being together. In Virtual Reality Conference, 2009. VR 2009. IEEE, IEEE (2009), 135--142. Google ScholarDigital Library
- Rolland, J., and Fuchs, H. Optical versus video see-through head-mounted displays in medical visualization. Presence: Teleoperators & Virtual Environments 9, 3 (2000), 287--309. Google ScholarDigital Library
- Sakamoto, D., Kanda, T., Ono, T., Ishiguro, H., and Hagita, N. Android as a telecommunication medium with a human-like presence. In Proceedings of the ACM/IEEE international conference on Human-robot interaction, ACM (2007), 193--200. Google ScholarDigital Library
- Shami, N., Cheng, L., Rohall, S., Sempere, A., and Patterson, J. Avatars meet meetings: Design issues in integrating avatars in distributed corporate meetings. In Proceedings of the 16th ACM international conference on Supporting group work, ACM (2010), 35--44. Google ScholarDigital Library
- Steptoe, W., Normand, J. Oyekoya, O., Pece, F., Giannopoulos, E., Tecchia, F., Steed, A., and Slater, M. Acting in collaborative multimodal mixed reality environments. Presence: Teleoperators & Virtual Environments (In Press).Google Scholar
- Steptoe, W., Oyekoya, O., Murgia, A., Wolff, R., Rae, J., Guimaraes, E., Roberts, D., and Steed, A. Eye tracking for avatar eye gaze control during object-focused multiparty interaction in immersive collaborative virtual environments. In Virtual Reality Conference, 2009. VR 2009. IEEE, IEEE (2009), 83--90. Google ScholarDigital Library
- Stiefelhagen, R., and Zhu, J. Head orientation and gaze direction in meetings. In CHI'02 extended abstracts on Human factors in computing systems, ACM (2002), 858--859. Google ScholarDigital Library
- Toshima, I., and Aoki, S. The effect of head movement on sound localization in an acoustical telepresence robot: Telehead. In Intelligent Robots and Systems, 2006 IEEE/RSJ International Conference on, IEEE (2006), 872--877.Google ScholarCross Ref
- Troje, N., and Siebeck, U. Illumination-induced apparent shift in orientation of human heads. PERCEPTION-LONDON- 27 (1998), 671--680.Google ScholarCross Ref
- Tsui, K., Desai, M., Yanco, H., and Uhlik, C. Exploring use cases for telepresence robots. In Proceedings of the 6th international conference on Human-robot interaction, ACM (2011), 11--18. Google ScholarDigital Library
- Venolia, G., Tang, J., Cervantes, R., Bly, S., Robertson, G., Lee, B., and Inkpen, K. Embodied social proxy: mediating interpersonal connection in hub-and-satellite teams. In Proceedings of the 28th international conference on Human factors in computing systems, ACM (2010), 1049--1058. Google ScholarDigital Library
- Wilson, H., Wilkinson, F., Lin, L., and Castillo, M. Perception of head orientation. Vision research 40, 5 (2000), 459--472.Google Scholar
- Yee, N., and Bailenson, J. The proteus effect: The effect of transformed self-representation on behavior. Human communication research 33, 3 (2007), 271--290.Google Scholar
Index Terms
- SphereAvatar: a situated display to represent a remote collaborator
Recommendations
VROOM: Virtual Robot Overlay for Online Meetings
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing SystemsTelepresence robots allow users to freely explore a remote space and provide a physical embodiment in that space. However, they lack a compelling representation of the remote user in the local space. We present VROOM (Virtual Robot Overlay for Online ...
Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsWe present Mini-Me, an adaptive avatar for enhancing Mixed Reality (MR) remote collaboration between a local Augmented Reality (AR) user and a remote Virtual Reality (VR) user. The Mini-Me avatar represents the VR user's gaze direction and body gestures ...
Belonging There: VROOM-ing into the Uncanny Valley of XR Telepresence
CSCWThe world is entering a new normal of hybrid organisations, in which it will be common that some members are co-located and others are remote. Hybridity is rife with asymmetries that affect our sense of belonging in an organisational space. This paper ...
Comments