skip to main content
10.1145/3688268.3688290acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicccmConference Proceedingsconference-collections
research-article

Remote Ship Control through Head Mounted Display (HMD) Based User Experience

Published: 18 December 2024 Publication History

Abstract

This research aims to revolutionize the remote travel experience by addressing the lack of proactiveness of user often associated with virtual tours and pre-recorded videos. We propose a novel approach that utilizes a remote-controlled boat equipped with a 360-degree camera, stationed at popular coastal tourist destinations. This innovative setup enables users to engage in immersive experiences such as remote sightseeing, racing game simulations, and interactive fish feeding activities. During the development process, we encountered various challenges, including the selection of a suitable omnidirectional camera that balances quality, price, and compatibility with the boat's system. Ensuring low-latency communication between the user's device and the remote-controlled boat was also crucial for a seamless and responsive experience. Additionally, maintainability, battery operating time, and navigating regulatory requirements posed significant hurdles. To overcome these challenges, we implemented creative solutions. We opted for a compact digital camera capable of capturing 360-degree footage using the USB UVC protocol, striking a balance between image quality and affordability. We leveraged WebRTC protocol to achieve low-latency video streaming and control input transmission, minimizing perceptible delays and enhancing the user experience. To validate the effectiveness of our remote ship control system, we conducted an experiment using the Meta Quest 2 head-mounted display (HMD). Participants controlled the remote boat while immersed in the 360-degree video feed, experiencing the coastal environment as if they were physically present. The results confirmed the system's ability to deliver an immersive and engaging remote travel experience. Looking ahead, we aim to address challenges such as reducing boat rocking, enhancing the sense of presence through additional sensory feedback, and implementing collision avoidance and automatic return functions for the boat. By refining and optimizing the system, we strive to offer users a truly transformative remote travel experience that brings them closer to the wonders of coastal destinations worldwide.

References

[1]
DWANGO Co., Ltd. (2022, June 7). Remote sightseeing: Niconico live streaming of a free bus tour visiting famous places in Niigata with a tour guide. PR Times.
[2]
Google Arts & Culture Retrieved June 21, 2024. https://artsandculture.google.com/
[3]
YouVisit Retrieved June 21, 2024. https://www.youvisit.com/
[5]
KNT-CT Holdings Co.,Ltd. Retrieved June 21, 2024. https://www.knt.co.jp/contents/ouchitabi/
[6]
Zeng, Y., Liu, L., & Xu, R. (2022). The effects of a virtual reality tourism experience on tourist's cultural dissemination behavior. Tourism and Hospitality, 3(1), 314–329.
[7]
Jain, D., et al. (2016). Immersive scuba diving simulator using virtual reality. In Proceedings of the 29th annual symposium on user interface software and technology (pp. 729–739).
[8]
Nagata, K., Hatsushika, D., & Hashimoto, Y. (2017). Virtual scuba diving system utilizing the sense of weightlessness underwater. In Entertainment Computing–ICEC 2017: 16th IFIP TC 14 International Conference, Tsukuba City, Japan, September 18–21, 2017, Proceedings 16 (pp. 205–210). Springer International Publishing.
[9]
Reitmann, S., & Jung, B. (2024, March). VR-based assistance system for semi-autonomous robotic boats. In Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction (HRI ’24 Companion) (pp. 877–881).
[10]
Jürgens, D., & Singer, S. (2021, October). Developments for remote controlled ship assistance operations of harbour tugs. In Tug Technology 2021.
[11]
Kondo, M., Shoji, R., Miyake, K., et al. (2018). Monitor system for remotely small vessel navigating. In S. Yamamoto & H. Mori (Eds.), HIMI 2018 (LNCS, vol. 10905, pp. 419–428). Springer, Cham.
[12]
Cheng, Y.;Wang, Y.; Zhao,W. Shared Virtual Reality Experiences during the COVID-19 Pandemic:Exploring the Gratifications andEffects of Engagement with ImmersiveVideos. Int. J. Environ. Res. PublicHealth 2022, 19, 5056.
[13]
A-Frame Retrieved June 21, 2024 . https://aframe.io/
[14]
Chang, E., Kim, H. T., & Yoo, B. (2020). Virtual reality sickness: A review of causes and measurements. International Journal of Human–Computer Interaction, 36(17), 1658–1682.
[15]
Geršak, G., Lu, H., & Guna, J. (2020). Effect of VR technology matureness on VR sickness. Multimedia Tools and Applications, 79, 14491–14507.
[16]
Saredakis, D., et al. (2020). Factors associated with virtual reality sickness in head-mounted displays: A systematic review and meta-analysis. Frontiers in human neuroscience, 14, 96.
[17]
Jining Han, Qiyu Zheng, and Yunan Ding,(2021). Lost in Virtual Reality? Cognitive Load in High Immersive VR Environments, Journal of Advances in Information Technology, Vol. 12, No. 4, pp. 302-310.

Index Terms

  1. Remote Ship Control through Head Mounted Display (HMD) Based User Experience

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICCCM '24: Proceedings of the 2024 12th International Conference on Computer and Communications Management
    July 2024
    179 pages
    ISBN:9798400718038
    DOI:10.1145/3688268
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 December 2024

    Check for updates

    Author Tags

    1. 360-degree camera
    2. Head-mounted display
    3. immersive experience
    4. mobile robots
    5. remote control
    6. remote-controlled boat
    7. teleoperation
    8. user experience
    9. virtual reality

    Qualifiers

    • Research-article

    Conference

    ICCCM 2024

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 21
      Total Downloads
    • Downloads (Last 12 months)21
    • Downloads (Last 6 weeks)17
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media