Skip to main content

Comfort and Sickness While Virtually Aboard an Autonomous Telepresence Robot

  • Conference paper
  • First Online:
Virtual Reality and Mixed Reality (EuroXR 2021)

Abstract

In this paper, we analyze how different path aspects affect a user’s experience, mainly VR sickness and overall comfort, while immersed in an autonomously moving telepresence robot through a virtual reality headset. In particular, we focus on how the robot turns and the distance it keeps from objects, with the goal of planning suitable trajectories for an autonomously moving immersive telepresence robot in mind; rotational acceleration is known for causing the majority of VR sickness, and distance to objects modulates the optical flow. We ran a within-subjects user study (n = 36, women = 18) in which the participants watched three panoramic videos recorded in a virtual museum while aboard an autonomously moving telepresence robot taking three different paths varying in aspects such as turns, speeds, or distances to walls and objects. We found a moderate correlation between the users’ sickness as measured by the SSQ and comfort on a 6-point Likert scale across all paths. However, we detected no association between sickness and the choice of the most comfortable path, showing that sickness is not the only factor affecting the comfort of the user. The subjective experience of turn speed did not correlate with either the SSQ scores or comfort, even though people often mentioned turning speed as a source of discomfort in the open-ended questions. Through exploring the open-ended answers more carefully, a possible reason is that the length and lack of predictability also play a large role in making people observe turns as uncomfortable. A larger subjective distance from walls and objects increased comfort and decreased sickness both in quantitative and qualitative data. Finally, the SSQ subscales and total weighted scores showed differences by age group and by gender.

This work was in part supported by Business Finland project HUMOR 3656/31/2019, in part by Academy of Finland project PERCEPT 322637, in part by European Research Counsil project ILLUSIVE 101020977, in part by the US National Science Foundation under Grants 035345 and 1328018, and in part by the Secretaría de Innovación, Ciencia Y Educación Superior SICES under Grant SICES/CONV/250/2019 CIMAT.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Baker, G., Bridgwater, T., Bremner, P., Giuliani, M.: Towards an immersive user interface for waypoint navigation of a mobile robot. In: The Second International Workshop on Virtual, Augmented and Mixed Reality for Human-Robot Interaction (2020)

    Google Scholar 

  2. Becerra, I., Suomalainen, M., Lozano, E., Mimnaugh, K.J., Murrieta-Cid, R., LaValle, S.M.: Human perception-optimized planning for comfortable VR-based telepresence. IEEE Robot. Autom. Lett. 5(4), 6489–6496 (2020)

    Article  Google Scholar 

  3. Buttussi, F., Chittaro, L.: Locomotion in place in virtual reality: a comparative evaluation of joystick, teleport, and leaning. IEEE Trans. Vis. Comput. Graph. 27, 1–12 (2020)

    Google Scholar 

  4. Cao, Z., Jerald, J., Kopper, R.: Visually-induced motion sickness reduction via static and dynamic rest frames. In: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 105–112 (2018). https://doi.org/10.1109/VR.2018.8446210

  5. Chang, E., Kim, H.T., Yoo, B.: Virtual reality sickness: a review of causes and measurements. Int. J. Hum. Comput. Interact. 36(17), 1–25 (2020)

    Article  Google Scholar 

  6. Cohen, J.: Statistical Power Analysis for Behavioral Sciences, 2nd edn. Routledge, New York (1988)

    MATH  Google Scholar 

  7. Darken, R.P., Peterson, B.: Spatial orientation, wayfinding, and representation. In: Handbook of Virtual Environments. CRC Press (2014)

    Google Scholar 

  8. Davis, S., Nesbitt, K., Nalivaiko, E.: Comparing the onset of cybersickness using the oculus rift and two virtual roller coasters. In: Proceedings of the 11th Australasian Conference on Interactive Entertainment (IE 2015), vol. 27, p. 30 (2015)

    Google Scholar 

  9. Dużmańska, N., Strojny, P., Strojny, A.: Can simulator sickness be avoided? A review on temporal aspects of simulator sickness. Front. Psychol. 9, 2132 (2018)

    Article  Google Scholar 

  10. Faul, F., Erdfelder, E., Lang, A.G., Buchner, A.: G*power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 39(2), 175–191 (2007)

    Article  Google Scholar 

  11. Fitter, N.T., Raghunath, N., Cha, E., Sanchez, C.A., Takayama, L., Matarić, M.J.: Are we there yet? Comparing remote learning technologies in the university classroom. IEEE Robot. Autom. Lett. 5(2), 2706–2713 (2020)

    Article  Google Scholar 

  12. García, J.C., et al.: A natural interface for remote operation of underwater robots. IEEE Comput. Graphics Appl. 37(1), 34–43 (2015)

    Article  Google Scholar 

  13. Grassini, S., Laumann, K.: Are modern head-mounted displays sexist? A systematic review on gender differences in HMD-mediated virtual reality. Front. Psychol. 11, 1604 (2020)

    Article  Google Scholar 

  14. Guna, J., Geršak, G., Humar, I., Song, J., Drnovšek, J., Pogačnik, M.: Influence of video content type on users’ virtual reality sickness perception and physiological response. Futur. Gener. Comput. Syst. 91, 263–276 (2019)

    Article  Google Scholar 

  15. Heshmat, Y., et al.: Geocaching with a beam: shared outdoor activities through a telepresence robot with 360 degree viewing. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–13 (2018)

    Google Scholar 

  16. Hilty, D.M., et al.: A review of telepresence, virtual reality, and augmented reality applied to clinical care. J. Technol. Behav. Sci. 5, 1–28 (2020)

    Google Scholar 

  17. Howarth, P.A., Hodder, S.G.: Characteristics of habituation to motion in a virtual environment. Displays 29(2), 117–123 (2008)

    Article  Google Scholar 

  18. Islam, R., Lee, Y., Jaloli, M., Muhammad, I., Zhu, D., Quarles, J.: Automatic detection of cybersickness from physiological signal in a virtual roller coaster simulation. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), pp. 649–650. IEEE (2020)

    Google Scholar 

  19. Jin, W., Fan, J., Gromala, D., Pasquier, P.: Automatic prediction of cybersickness for virtual reality games. In: 2018 IEEE Games, Entertainment, Media Conference (GEM), pp. 1–9. IEEE (2018)

    Google Scholar 

  20. Johnson, D.M.: Introduction to and review of simulator sickness research. Technical report, Army Research Inst Field Unit Fort Rucker Al (2005)

    Google Scholar 

  21. Kennedy, R.S., Lane, N.E., Berbaum, K.S., Lilienthal, M.G.: Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int. J. Aviat. Psychol. 3(3), 203–220 (1993)

    Article  Google Scholar 

  22. Keshavarz, B., Hecht, H.: Axis rotation and visually induced motion sickness: the role of combined roll, pitch, and yaw motion. Aviat. Space Environ. Med. 82(11), 1023–1029 (2011)

    Article  Google Scholar 

  23. Khenak, N., Vézien, J., Bourdot, P.: Spatial presence, performance, and behavior between real, remote, and virtual immersive environments. IEEE Trans. Visual Comput. Graphics 26(12), 3467–3478 (2020)

    Article  Google Scholar 

  24. Kolasinski, E.M.: Simulator sickness in virtual environments, vol. 1027. US Army Research Institute for the Behavioral and Social Sciences (1995)

    Google Scholar 

  25. Kourtesis, P., Collina, S., Doumas, L.A.A., MacPherson, S.E.: Validation of the virtual reality neuroscience questionnaire: maximum duration of immersive virtual reality sessions without the presence of pertinent adverse symptomatology. Front. Hum. Neurosci. 13, 417 (2019)

    Article  Google Scholar 

  26. LaValle, S.M.: Virtual Reality. Cambridge University Press, Cambridge (2021)

    Google Scholar 

  27. LaValle, S.M., Kuffner, J.J., Jr.: Randomized kinodynamic planning. The Int. J. Robot. Res. 20(5), 378–400 (2001)

    Google Scholar 

  28. Lee, M.K., Takayama, L.: Now, i have a body: uses and social norms for mobile remote presence in the workplace. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 33–42. ACM (2011)

    Google Scholar 

  29. Lenhard, W., Lenhard, A.: Calculation of effect sizes (2016)

    Google Scholar 

  30. Martins, H., Ventura, R.: Immersive 3-D teleoperation of a search and rescue robot using a head-mounted display. In: 2009 IEEE Conference on Emerging Technologies & Factory Automation, pp. 1–8. IEEE (2009)

    Google Scholar 

  31. McHugh, N., Jung, S., Hoermann, S., Lindeman, R.W.: Investigating a physical dial as a measurement tool for cybersickness in virtual reality. In: 25th ACM Symposium on Virtual Reality Software and Technology, pp. 1–5 (2019)

    Google Scholar 

  32. Mimnaugh, K.J., Suomalainen, M., Becerra, I., Lozano, E., Murrieta-Cid, R., LaValle, S.M.: Analysis of user preferences for robot motions in immersive telepresence. In: 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE (2021)

    Google Scholar 

  33. Minsky, M.: Telepresence (1980)

    Google Scholar 

  34. Nesbitt, K., Davis, S., Blackmore, K., Nalivaiko, E.: Correlating reaction time and nausea measures with traditional measures of cybersickness. Displays 48, 1–8 (2017)

    Article  Google Scholar 

  35. Neustaedter, C., Singhal, S., Pan, R., Heshmat, Y., Forghani, A., Tang, J.: From being there to watching: shared and dedicated telepresence robot usage at academic conferences. ACM Trans. Comput. Hum. Interact. (TOCHI) 25(6), 1–39 (2018)

    Article  Google Scholar 

  36. Oh, Y., Parasuraman, R., McGraw, T., Min, B.C.: 360 VR based robot teleoperation interface for virtual tour. In: Proceedings of the 1st International Workshop on Virtual, Augmented, and Mixed Reality for HRI (VAM-HRI) (2018)

    Google Scholar 

  37. Patton, M.Q.: Qualitative research. Encyclopedia of statistics in behavioral science (2005)

    Google Scholar 

  38. Paulos, E., Canny, J.: Social tele-embodiment: understanding presence. Auton. Robot. 11(1), 87–95 (2001)

    Article  Google Scholar 

  39. Peck, T.C., Sockol, L.E., Hancock, S.M.: Mind the gap: the underrepresentation of female participants and authors in virtual reality research. IEEE Trans. Visual Comput. Graphics 26(5), 1945–1954 (2020)

    Article  Google Scholar 

  40. Rae, I., Mutlu, B., Takayama, L.: Bodies in motion: mobility, presence, and task awareness in telepresence. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems, pp. 2153–2162. ACM (2014)

    Google Scholar 

  41. Rae, I., Neustaedter, C.: Robotic telepresence at scale. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 313–324 (2017)

    Google Scholar 

  42. Reason, J.T., Brand, J.J.: Motion Sickness. Academic Press, London (1975)

    Google Scholar 

  43. Rebenitsch, L., Owen, C.: Individual variation in susceptibility to cybersickness. In: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, pp. 309–317 (2014)

    Google Scholar 

  44. Sanchez-Vives, M.V., Slater, M.: From presence to consciousness through virtual reality. Nat. Rev. Neurosci. 6(4), 332–339 (2005)

    Article  Google Scholar 

  45. Saredakis, D., Szpak, A., Birckhead, B., Keage, H.A., Rizzo, A., Loetscher, T.: Factors associated with virtual reality sickness in head-mounted displays: a systematic review and meta-analysis. Front. Hum. Neurosci. 14, 96 (2020)

    Google Scholar 

  46. Singer, M.J., Ehrlich, J.A., Allen, R.C.: Virtual environment sickness: adaptation to and recovery from a search task. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 42, pp. 1506–1510. SAGE Publications Sage, Los Angeles (1998)

    Google Scholar 

  47. Soares, N., Kay, J.C., Craven, G.: Mobile robotic telepresence solutions for the education of hospitalized children. Persp. Health Inf. Manage. 14(Fall) (2017)

    Google Scholar 

  48. Stoll, B., Reig, S., He, L., Kaplan, I., Jung, M.F., Fussell, S.R.: Wait, can you move the robot? examining telepresence robot use in collaborative teams. In: Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, pp. 14–22 (2018)

    Google Scholar 

  49. Tomczak, M., Tomczak, E.: The need to report effect size estimates revisited. An overview of some recommended measures of effect size. Trends Sport Sci. 1(21), 19–25 (2014)

    Google Scholar 

  50. Tsui, K.M., Desai, M., Yanco, H.A., Uhlik, C.: Exploring use cases for telepresence robots. In: 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 11–18. IEEE (2011)

    Google Scholar 

  51. Widdowson, C., Becerra, I., Merrill, C., Wang, R.F., LaValle, S.: Assessing postural instability and cybersickness through linear and angular displacement. Hum. Factors 63, 296–311 (2019)

    Article  Google Scholar 

  52. Yang, L., Neustaedter, C.: Our house: living long distance with a telepresence robot. Proc. ACM Hum. Comput. Interact. 2(CSCW), 1–18 (2018)

    Google Scholar 

  53. Zhang, J., Langbehn, E., Krupke, D., Katzakis, N., Steinicke, F.: Detection thresholds for rotation and translation gains in 360 video-based telepresence systems. IEEE Trans. Visual Comput. Graphics 24(4), 1671–1680 (2018)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Markku Suomalainen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Suomalainen, M., Mimnaugh, K.J., Becerra, I., Lozano, E., Murrieta-Cid, R., LaValle, S.M. (2021). Comfort and Sickness While Virtually Aboard an Autonomous Telepresence Robot. In: Bourdot, P., Alcañiz Raya, M., Figueroa, P., Interrante, V., Kuhlen, T.W., Reiners, D. (eds) Virtual Reality and Mixed Reality. EuroXR 2021. Lecture Notes in Computer Science(), vol 13105. Springer, Cham. https://doi.org/10.1007/978-3-030-90739-6_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90739-6_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90738-9

  • Online ISBN: 978-3-030-90739-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics