Skip to main content
SpringerLink
Log in

Exploring Human-to-Human Telepresence and the Use of Vibro-Tactile Commands to Guide Human Streamers

  • Conference paper
  • First Online:
Virtual, Augmented and Mixed Reality (HCII 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12770))

Included in the following conference series:

  • 2982 Accesses

Abstract

Human-to-human telepresence is rising to mainstream use, and there is opportunity to provide rich experiences through novel interactions. While previous systems are geared towards situations where two users are previously acquainted, or provide channels for verbal communication, our work focuses on situations where audio is not desirable or available, by incorporating vibro-tactile commands into a telepresence setup. We present results from a lab-based study regarding a human-to-human telepresence system which enables one person to remotely control another through these vibro-tactile cues. We conducted a study with 8 participants to solicit their feedback when acting as a Streamer, 8 additional participants to solicit feedback as a Viewer, and 30 bystanders, through surveys and debriefing sessions. While our participants generally found the application favorable, we did find mixed feelings towards vibro-tactile devices, and much room for improvement for the whole interaction. We discuss the implications of our findings and provide design guidelines for future telepresence developers.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://ffmpeg.org.

References

  1. Alohali, A., Kunze, K., Earle, R.: Run with me: designing storytelling tools for runners. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, pp. 5–8. ACM (2016)

    Google Scholar 

  2. Anderson, K.E.: Getting acquainted with social networks and apps: streaming video games on twitch. tv. Library Hi Tech News 35(9), 7–10 (2018)

    Google Scholar 

  3. Baishya, U., Neustaedter, C.: In your eyes: anytime, anywhere video and audio streaming for couples. In: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, pp. 84–97. ACM (2017)

    Google Scholar 

  4. Baus, O., Bouchard, S.: Exposure to an unpleasant odour increases the sense of presence in virtual reality. Virtual Reality 21(2), 59–74 (2017)

    Article  Google Scholar 

  5. Bellotti, V., Ambard, A., Turner, D., Gossmann, C., Demkova, K., Carroll, J.M.: A muddle of models of motivation for using peer-to-peer economy systems. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 1085–1094. ACM (2015)

    Google Scholar 

  6. Cassinelli, A., Reynolds, C., Ishikawa, M.: Augmenting spatial awareness with haptic radar. In: 2006 10th IEEE International Symposium on Wearable Computers, pp. 61–64. IEEE (2006)

    Google Scholar 

  7. Chaudary, B., Paajala, I., Keino, E., Pulli, P.: Tele-guidance based navigation system for the visually impaired and blind persons. In: Giokas, K., Bokor, L., Hopfgartner, F. (eds.) eHealth 360\(^{\circ }\). LNICST, vol. 181, pp. 9–16. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-49655-9_2

    Chapter  Google Scholar 

  8. Cosgun, A., Sisbot, E.A., Christensen, H.I.: Guidance for human navigation using a vibro-tactile belt interface and robot-like motion planning. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 6350–6355. IEEE (2014)

    Google Scholar 

  9. Ellison, L.M., Nguyen, M., Fabrizio, M.D., Soh, A., Permpongkosol, S., Kavoussi, L.R.: Postoperative robotic telerounding: a multicenter randomized assessment of patient outcomes and satisfaction. Arch. Surg. 142(12), 1177–1181 (2007). https://doi.org/10.1001/archsurg.142.12.1177

    Article  Google Scholar 

  10. Faklaris, C., Cafaro, F., Hook, S.A., Blevins, A., O’Haver, M., Singhal, N.: Legal and ethical implications of mobile live-streaming video apps. In: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, pp. 722–729. ACM (2016)

    Google Scholar 

  11. Glöss, M., McGregor, M., Brown, B.: Designing for labour: uber and the on-demand mobile workforce. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 1632–1643. ACM (2016)

    Google Scholar 

  12. Heshmat, Y., et al.: Geocaching with a beam: shared outdoor activities through a telepresence robot with 360 degree viewing. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, p. 359. ACM (2018)

    Google Scholar 

  13. Hilvert-Bruce, Z., Neill, J.T., Sjöblom, M., Hamari, J.: Social motivations of live-streaming viewer engagement on twitch. Comput. Hum. Behav. 84, 58–67 (2018)

    Article  Google Scholar 

  14. Ishak, C., Neustaedter, C., Hawkins, D., Procyk, J., Massimi, M.: Human proxies for remote university classroom attendance. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 931–943. ACM (2016)

    Google Scholar 

  15. Islands, V.F.: Remote tourism - visit faroe islands (2020). https://visitfaroeislands.com/remote-tourism/

  16. Kasahara, S., Nagai, S., Rekimoto, J.: Jackin head: immersive visual telepresence system with omnidirectional wearable camera. IEEE Trans. Visual Comput. Graphics 23(3), 1222–1234 (2017)

    Article  Google Scholar 

  17. Kasahara, S., Rekimoto, J.: Jackin: integrating first-person view with out-of-body vision generation for human-human augmentation. In: Proceedings of the 5th Augmented Human International Conference, p. 46. ACM (2014)

    Google Scholar 

  18. Kasahara, S., Rekimoto, J.: Jackin head: immersive visual telepresence system with omnidirectional wearable camera for remote collaboration. In: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology, pp. 217–225. ACM (2015)

    Google Scholar 

  19. Kaul, O.B., Rohs, M.: Haptichead: a spherical vibrotactile grid around the head for 3D guidance in virtual and augmented reality. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 3729–3740. ACM (2017)

    Google Scholar 

  20. Kim, S., Junuzovic, S., Inkpen, K.: The nomad and the couch potato: enriching mobile shared experiences with contextual information. In: Proceedings of the 18th International Conference on Supporting Group Work - GROUP 2014, Sanibel Island, Florida, USA, pp. 167–177. ACM Press (2014). http://dl.acm.org/citation.cfm?doid=2660398.2660409. https://doi.org/10.1145/2660398.2660409

  21. Kimber, D., et al.: Polly: telepresence from a guide’s shoulder. In: Agapito, L., Bronstein, M.M., Rother, C. (eds.) ECCV 2014. LNCS, vol. 8927, pp. 509–523. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-16199-0_36

    Chapter  Google Scholar 

  22. Kontaris, D., Harrison, D., Patsoule, E.E., Zhuang, S., Slade, A.: Feelybean: communicating touch over distance. In: CHI 2012 Extended Abstracts on Human Factors in Computing Systems, pp. 1273–1278. ACM (2012)

    Google Scholar 

  23. Kratz, S., Avrahami, D., Kimber, D., Vaughan, J., Proppe, P., Severns, D.: Polly wanna show you: examining viewpoint-conveyance techniques for a shoulder-worn telepresence system. In: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, pp. 567–575. ACM (2015)

    Google Scholar 

  24. Kratz, S., Kimber, D., Su, W., Gordon, G., Severns, D.: Polly: being there through the parrot and a guide. In: Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services, pp. 625–630. ACM (2014)

    Google Scholar 

  25. Kreimer, S.F.: Pervasive image capture and the first amendment: memory, discourse, and the right to record. U. Pa. L. Rev. 159, 335 (2010)

    Google Scholar 

  26. Kristoffersson, A., Coradeschi, S., Loutfi, A.: A review of mobile robotic telepresence. In: Advances in Human-Computer Interaction 2013, p. 3 (2013)

    Google Scholar 

  27. Li, Y., Kou, Y., Lee, J.S., Kobsa, A.: Tell me before you stream me: managing information disclosure in video game live streaming. In: Proceedings of the ACM on Human-Computer Interaction 2(CSCW), no. 107 (2018)

    Google Scholar 

  28. McDaniel, T., Krishna, S., Balasubramanian, V., Colbry, D., Panchanathan, S.: Using a haptic belt to convey non-verbal communication cues during social interactions to individuals who are blind. In: IEEE International Workshop on Haptic Audio visual Environments and Games, HAVE 2008, pp. 13–18. IEEE (2008)

    Google Scholar 

  29. McGrath, B., Estrada, A., Braithwaite, M., Raj, A., Rupert, A.: Tactile situation awareness system flight demonstration. Technical report, Army Aeromedical Research Lab Fort Rucker AL (2004)

    Google Scholar 

  30. Meier, A., Matthies, D.J., Urban, B., Wettach, R.: Exploring vibrotactile feedback on the body and foot for the purpose of pedestrian navigation. In: Proceedings of the 2nd International Workshop on Sensor-Based Activity Recognition and Interaction, p. 11. ACM (2015)

    Google Scholar 

  31. Minsky, M.: Telepresence (1980)

    Google Scholar 

  32. Misawa, K., Rekimoto, J.: Chameleonmask: embodied physical and social telepresence using human surrogates. In: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, pp. 401–411. ACM (2015)

    Google Scholar 

  33. Misawa, K., Rekimoto, J.: Wearing another’s personality: a human-surrogate system with a telepresence face. In: Proceedings of the 2015 ACM International Symposium on Wearable Computers, pp. 125–132. ACM (2015)

    Google Scholar 

  34. Munyan, B.G., Neer, S.M., Beidel, D.C., Jentsch, F.: Olfactory stimuli increase presence during simulated exposure. In: Lackey, S., Shumaker, R. (eds.) VAMR 2016. LNCS, vol. 9740, pp. 164–172. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-39907-2_16

    Chapter  Google Scholar 

  35. Myles, K., Kalb, J.T.: Guidelines for head tactile communication. Technical report, Army Research Lab Aberdeen Proving Ground Md Human Research and Engineering Directorate (2010)

    Google Scholar 

  36. Neustaedter, C., Venolia, G., Procyk, J., Hawkins, D.: To beam or not to beam: a study of remote telepresence attendance at an academic conference. In: Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, pp. 418–431. ACM (2016)

    Google Scholar 

  37. Pallarino, T., Free, A., Mutuc, K., Yarosh, S.: Feeling distance: an investigation of mediated social touch prototypes. In: Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion, pp. 361–364. ACM (2016)

    Google Scholar 

  38. Pfeil, K., Chatlani, N., Wisniewski, P.: Bridging the socio-technical gaps in body-worn interpersonal live-streaming telepresence through a critical review of the literature. Proc. ACM Hum.-Comput. Interact. (2021, to appear)

    Google Scholar 

  39. Pfeil, K., Wisniewski, P., LaViola Jr., J.J.: An analysis of user perception regarding body-worn 360\(^{\circ }\) camera placements and heights for telepresence. In: ACM Symposium on Applied Perception 2019. SAP 2019. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3343036.3343120

  40. Pfeil, K., Wisniewski, P.J., Laviola Jr., J.J.: The effects of gender and the presence of third-party humans on telepresence camera height preferences. In: ACM Symposium on Applied Perception 2020. SAP 2020. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3385955.3407924

  41. Pulli, P., et al.: Mobile augmented teleguidance-based safety navigation concept for senior citizens. In: 2nd International Conference on Applied and Theoretical Information Systems Research (2nd. ATISR2012), pp. 1–9 (2012)

    Google Scholar 

  42. Rae, I., Venolia, G., Tang, J.C., Molnar, D.: A framework for understanding and designing telepresence. In: Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW 2015, Vancouver, BC, Canada, pp. 1552–1566. ACM Press (2015). http://dl.acm.org/citation.cfm?doid=2675133.2675141. https://doi.org/10.1145/2675133.2675141

  43. Scheggi, S., Talarico, A., Prattichizzo, D.: A remote guidance system for blind and visually impaired people via vibrotactile haptic feedback. In: 22nd Mediterranean Conference on Control and Automation, pp. 20–23. IEEE (2014)

    Google Scholar 

  44. Sjöblom, M., Hamari, J.: Why do people watch others play video games? An empirical study on the motivations of twitch users. Comput. Hum. Behav. 75, 985–996 (2017)

    Article  Google Scholar 

  45. Slater, M., Linakis, V., Usoh, M., Kooper, R.: Immersion, presence and performance in virtual environments: an experiment with tri-dimensional chess. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST 1996, pp. 163–172. Association for Computing Machinery, New York (1996). https://doi.org/10.1145/3304181.3304216

  46. Steltenpohl, H., Bouwer, A.: Vibrobelt: tactile navigation support for cyclists. In: Proceedings of the 2013 International Conference on Intelligent User Interfaces, pp. 417–426. ACM (2013)

    Google Scholar 

  47. Stewart, D.R., Littau, J.: Up, periscope: mobile streaming video technologies, privacy in public, and the right to record. Journal. Mass Commun. Q. 93(2), 312–331 (2016)

    Article  Google Scholar 

  48. Tang, A., Fakourfar, O., Neustaedter, C., Bateman, S.: Collaboration in 360 videochat: challenges and opportunities. Technical report, University of Calgary (2017)

    Google Scholar 

  49. Tsukada, K., Yasumura, M.: ActiveBelt: belt-type wearable tactile display for directional navigation. In: Davies, N., Mynatt, E.D., Siio, I. (eds.) UbiComp 2004. LNCS, vol. 3205, pp. 384–399. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-30119-6_23

    Chapter  Google Scholar 

  50. Van Erp, J.B., Van Veen, H.A., Jansen, C., Dobbins, T.: Waypoint navigation with a vibrotactile waist belt. ACM Trans. Appl. Percept. (TAP) 2(2), 106–117 (2005)

    Article  Google Scholar 

  51. Wang, H.C., Katzschmann, R.K., Teng, S., Araki, B., Giarré, L., Rus, D.: Enabling independent navigation for visually impaired people through a wearable vision-based feedback system. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 6533–6540. IEEE (2017)

    Google Scholar 

  52. Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments: a presence questionnaire. Presence 7(3), 225–240 (1998)

    Article  Google Scholar 

Download references

Acknowledgments

Special thanks to Ravikiran Kattoju for assistance with running the user study.

Author information

Authors and Affiliations

  1. University of Central Florida, Orlando, FL, USA

    Kevin P. Pfeil, Katelynn A. Kapalo, Seng Lee Koh, Pamela Wisniewski & Joseph J. LaViola Jr.

Authors
  1. Kevin P. Pfeil
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Katelynn A. Kapalo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Seng Lee Koh
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pamela Wisniewski
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Joseph J. LaViola Jr.
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kevin P. Pfeil .

Editor information

Editors and Affiliations

  1. U.S. Army Research Laboratory, Aberdeen Proving Ground, MD, USA

    Jessie Y. C. Chen

  2. U.S. Army Combat Capabilities Development Command Soldier Center, Orlando, FL, USA

    Gino Fragomeni

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pfeil, K.P., Kapalo, K.A., Koh, S.L., Wisniewski, P., LaViola, J.J. (2021). Exploring Human-to-Human Telepresence and the Use of Vibro-Tactile Commands to Guide Human Streamers. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality. HCII 2021. Lecture Notes in Computer Science(), vol 12770. Springer, Cham. https://doi.org/10.1007/978-3-030-77599-5_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77599-5_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77598-8

  • Online ISBN: 978-3-030-77599-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation