Jacob Young
Skip Abstract Section
Skip Supplemental Material SectionAbstract
The desire to stay connected to one another over large distances has guided decades of telepresence research. Most focuses on stationary solutions that can deliver high-fidelity telepresence experiences, but these are usually impractical for the wider population who cannot afford the necessary proprietary equipment or are unwilling to regress to non-mobile communication. In this paper we present Mobileportation, a nomadic telepresence prototype that takes advantage of recent developments in mobile technology to provide immersive experiences wherever the user desires by allowing for seamless transitions between ego- and exocentric views within a mutually shared three-dimensional environment. The results of a user study are also discussed that show Mobileportation's ability to induce a sense of presence within this environment and with the remote communication partner, as well as the potential of this platform for future telepresence research.
Supplemental Material
Available for Download
zip
young.zip (63.7 MB)
Supplemental movie, appendix, image and software files for, Mobileportation: Nomadic Telepresence for Mobile Devices
- Matt Adcock, Stuart Anderson, and Bruce Thomas. 2013. RemoteFusion: Real Time Depth Camera Fusion for Remote Collaboration on Physical Tasks. Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry - VRCAI '13 (2013), 235--242. https://doi.org/10.1145/2534329.2534331Google Scholar
Digital Library
- Ilkka Arminen and Alexandra Weilenmann. 2009. Mobile Presence and Intimacy - Reshaping Social Actions in Mobile Contextual Configuration. Journal of Pragmatics 41, 10 (oct 2009), 1905--1923. https://doi.org/10.1016/j.pragma.2008.09.016Google ScholarCross Ref
- Jeremy N. Bailenson, Kim Swinth, Crystal Hoyt, Susan Persky, Alex Dimov, and Jim Blascovich. 2005. The Independent and Interactive Effects of Embodied-Agent Appearance and Behavior on Self-Report, Cognitive, and Behavioral Markers of Copresence in Immersive Virtual Environments. Presence: Teleoperators and Virtual Environments 14, 4 (2005), 379--393. https://doi.org/10.1162/105474605774785235 arXiv:https://doi.org/10.1162/105474605774785235Google ScholarDigital Library
- Frank Biocca, Chad Harms, and Judee K. Burgoon. 2003. Toward a More Robust Theory and Measure of Social Presence: Review and Suggested Criteria. Presence: Teleoperators and Virtual Environments 12, 5 (2003), 456--480. https://doi.org/10.1162/105474603322761270Google ScholarDigital Library
- Celeste Campos-Castillo and Steven Hitlin. 2013. Copresence: Revisiting a Building Block for Social Interaction Theories. Sociological Theory 31, 2 (2013), 168--192. https://doi.org/10.1177/0735275113489811Google ScholarCross Ref
- Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2018. OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. In arXiv preprint arXiv:1812.08008.Google Scholar
- Zhe Cao, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2017. Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. In CVPR.Google Scholar
- Nick V. Flor. 1998. Side-by-side collaboration: a case study. International Journal of Human-Computer Studies 49, 3 (1998), 201--222. https://doi.org/10.1006/ijhc.1998.0203Google ScholarDigital Library
- Susan R Fussell, Robert E Kraut, and Jane Siegel. 2000. Coordination of Communication: Effects of Shared Visual Context on Collaborative Work. In Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work. 21--30. https://doi.org/10.1145/358916.358947Google ScholarDigital Library
- Lei Gao, Huidong Bai, Rob Lindeman, and Mark Billinghurst. 2017. Static Local Environment Capturing and Sharing for MR Remote Collaboration. SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications on - SA '17 (2017), 1--6. https://doi.org/10.1145/3132787.3139204Google Scholar
- Lei Gao, Huidong Bai, Thammathip Piumsomboon, Gun A Lee, Robert W Lindeman, and Mark Billinghurst. 2017. Real-time Visual Representations for Mixed Reality Remote Collaboration. (2017), 87--95. https://doi.org/10.2312/egve.20171344Google Scholar
- Jörg Hauber, Holger Regenbrecht, Mark Billinghurst, and Andy Cockburn. 2006. Spatiality in Videoconferencing: Trade-offs Between Efficiency and Social Presence. In Proceedings of the 2006 20th Anniversary Conference on Computer Supported Cooperative Work (CSCW '06). ACM, New York, NY, USA, 413--422. https://doi.org/10.1145/1180875.1180937Google ScholarDigital Library
- Shahram Izadi, David Kim, Otmar Hilliges, David Molyneaux, Richard Newcombe, Pushmeet Kohli, Jamie Shotton, Steve Hodges, Dustin Freeman, Andrew Davison, and et al. 2011. KinectFusion: Real-Time 3D Reconstruction and Interaction Using a Moving Depth Camera. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). Association for Computing Machinery, New York, NY, USA, 559--568. https://doi.org/10.1145/2047196.2047270Google Scholar
- Shunichi Kasahara and Jun Rekimoto. 2014. JackIn: Integrating First-Person View with Out-of-Body Vision Generation for Human-Human Augmentation. In Proceedings of the 5th Augmented Human International Conference. ACM, Kobe, Japan, 46:1--46:8. https://doi.org/10.1145/2582051.2582097Google ScholarDigital Library
- Ryohei Komiyama, Takashi Miyaki, and Jun Rekimoto. 2017. JackIn Space: Designing a Seamless Transition Between First and Third Person View for Effective Telepresence Collaborations. In Proceedings of the 8th Augmented Human International Conference (AH '17). ACM, New York, NY, USA, Article 14, 9 pages. https://doi.org/10.1145/3041164.3041183Google ScholarDigital Library
- Sven Kratz, Daniel Avrahami, Don Kimber, Jim Vaughan, Patrick Proppe, and Don Severns. 2015. Polly Wanna Show You: Examining Viewpoint-Conveyance Techniques for a Shoulder-Worn Telepresence System. In MobileHCI 2015 - Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. Toronto, Canada, 567--575. https://doi.org/10.1145/2786567.2787134Google ScholarDigital Library
- Tobias Langlotz, Holger Regenbrecht, Stefanie Zollmann, and Dieter Schmalstieg. 2013. Audio Stickies: Visually-guided Spatial Audio Annotations on a Mobile Augmented Reality Platform. In Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration (OzCHI '13). ACM, New York, NY, USA, 545--554. https://doi.org/10.1145/2541016.2541022Google ScholarDigital Library
- Matthew Lombard and Theresa Ditton. 1997. At the Heart of It All: The Concept of Presence. Journal of Computer-Mediated Communication 3, 2 (09 1997). https://doi.org/10.1111/j.1083-6101.1997.tb00072.x JCMC321.Google Scholar
- Andrew Maimone and Henry Fuchs. 2011. Encumbrance-Free Telepresence System with Real-Time 3D Capture and Display using Commodity Depth Cameras. 2011 10th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2011 (2011), 137--146. https://doi.org/10.1109/ISMAR.2011.6092379Google ScholarDigital Library
- Peter Mohr, Shohei Mori, Tobias Langlotz, Bruce Thomas, Dieter Schmalstieg, and Denis Kalkofen. 2020. Mixed Reality Light Fields for Interactive Remote Assistance. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). ACM, New York, NY, USA.Google ScholarDigital Library
- Jörg Müller, Tobias Langlotz, and Holger Regenbrecht. 2016. PanoVC: Pervasive Telepresence using Mobile Phones. In IEEE International Conference on Pervasive Computing and Communications (PerCom). 1--10. https://doi.org/10.1109/PERCOM.2016.7456508Google ScholarCross Ref
- Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L. Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A. Chou, Sarah Mennicken, Julien Valentin, Vivek Pradeep, Shenlong Wang, Sing Bing Kang, Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin, and Shahram Izadi. 2016. Holoportation: Virtual 3D Teleportation in Real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 741--754. https://doi.org/10.1145/2984511.2984517Google ScholarDigital Library
- Fabrizio Pece, William Steptoe, Fabian Wanner, Simon Julier, Tim Weyrich, Jan Kautz, and Anthony Steed. 2013. Panoinserts: Mobile Spatial Teleconferencing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems SE - CHI '13. 1319--1328. https://doi.org/10.1145/2470654.2466173Google ScholarDigital Library
- Thammathip Piumsomboon, Arindam Day, Barrett Ens, Youngho Lee, Gun Lee, and Mark Billinghurst. 2017. Exploring Enhancements for Remote Mixed Reality Collaboration. In SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications (SA '17). ACM, New York, NY, USA, Article 16, 5 pages. https://doi.org/10.1145/3132787.3139200Google Scholar
- Thomas Schubert, Frank Friedmann, and Holger Regenbrecht. 2001. The Experience of Presence: Factor Analytic Insights. Presence: Teleoperators and Virtual Environments 10, 3 (2001), 266--281. https://doi.org/10.1162/105474601300343603Google ScholarDigital Library
- Rajinder S Sodhi, Brett R Jones, David Forsyth, Brian P Bailey, and Giuliano Maciocci. 2013. BeThere: 3D Mobile Collaboration with Spatial Input. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13 (2013), 179--188. https://doi.org/10.1145/2470654.2470679Google ScholarDigital Library
- Patrick Stotko, Stefan Krumpen, Matthias B. Hullin, Michael Weinmann, and Reinhard Klein. 2019. SLAMCast: Large-Scale, Real-Time 3D Reconstruction and Streaming for Immersive Multi-Client Live Telepresence. IEEE Transactions on Visualization and Computer Graphics 25, 5 (May 2019), 2102--2112. https://doi.org/10.1109/TVCG.2019.2899231Google ScholarCross Ref
- Anthony Tang, Omid Fakourfar, Carman Neustaedter, and Scott Bateman. 2017. Collaboration in 360° Videochat: Challenges and Opportunities. In Proceedings of the 2017 Conference on Designing Interactive Systems. ACM, Edinburgh, United Kingdom, 1327--1339. https://doi.org/10.1145/3064663.3064707Google ScholarDigital Library
- Theophilus Teo, Louise Lawrence, Gun A. Lee, Mark Billinghurst, and Matt Adcock. 2019. Mixed Reality Remote Collaboration Combining 360 Video and 3D Reconstruction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 201, 14 pages. https://doi.org/10.1145/3290605.3300431Google ScholarDigital Library
- W. Xu, A. Chatterjee, M. Zollhöfer, H. Rhodin, P. Fua, H. Seidel, and C. Theobalt. 2019. Mo2Cap2: Real-time Mobile 3D Motion Capture with a Cap-mounted Fisheye Camera. IEEE Transactions on Visualization and Computer Graphics 25, 5 (May 2019), 2093--2101. https://doi.org/10.1109/TVCG.2019.2898650Google ScholarCross Ref
- Jacob Young, Tobias Langlotz, Matthew Cook, Steven Mills, and Holger Regenbrecht. 2019. Immersive Telepresence and Remote Collaboration using Mobile and Wearable Devices. IEEE Transactions on Visualization and Computer Graphics 25, 5 (May 2019), 1908--1918. https://doi.org/10.1109/TVCG.2019.2898737Google ScholarCross Ref
Index Terms
- Mobileportation: Nomadic Telepresence for Mobile Devices
Recommendations
VROOM: Virtual Robot Overlay for Online Meetings
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing SystemsTelepresence robots allow users to freely explore a remote space and provide a physical embodiment in that space. However, they lack a compelling representation of the remote user in the local space. We present VROOM (Virtual Robot Overlay for Online ...
Garden: A Mixed Reality Experience Combining Virtual Reality and 3D Reconstruction
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsGarden is a Mixed Reality (MR) experience that combines both Virtual Reality (VR) and Augmented Reality (AR), and lets players transform their environment into a virtual garden they can play in. This is done by doing both stereoscopic rendering and 3D ...
Effects of avatar and background representation forms to co-presence in mixed reality (MR) tele-conference systems
SA '16: SIGGRAPH ASIA 2016 Virtual Reality meets Physical Reality: Modelling and Simulating Virtual Humans and EnvironmentsWith continued technology innovation, the traditional 2D video based tele-conferencing and collaborative systems are evolving into ones that are immersive, 3D, more interactive and even augmented in real environment. One important quality of a tele-...
Comments