Abstract
MR remote cooperative work refers to cooperative work in the MR space. In my research, it refers to cooperative work between a remote instructor wearing a VR head-mounted display (HMD) and a local worker wearing an AR HMD. I am engaged in research on how to communicate under such work. For the purpose of my research, I considered instructing using multiple non-verbal cues in different ways of communicating. This allows the instructor to freely express what they want to communicate. In addition, the research objective was to achieve smooth communication between the instructor and the worker to complete the work remotely and efficiently. As a proposal, we proposed three patterns of instruction using gestures. As a result, only operability and task completion rate were significant. In the future, we plan to approach the problem of the large number of miscommunications due to ambiguous instructions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kim, S., Lee, G., Huang, W., Kim, H., Woo, W., Billinghurst, M.: Evaluating the combination of visual communication cues for HMD-based mixed reality remote collaboration. In: Proceeding of the 2019 CHI Conference on Human Factors in Computing Systems (CHI 2019), Paper 173, pp. 1–13. Association for Computing Machinery, New York 2019. 10/1145/3290605.3300403
Naganuma, H.: MR Remote Collaboration Using Trajectory Effects. Tokyo City University Graduation Thesis (2020)
Ministry of Foreign Affairs: Survey on the number of Japanese companies operating overseas.https://www.mofa.go.jp/mofaj/ecm/ec/page22_003410.html
Bai, H., Sasikumar, P., Yang, J., Billinghurst, M.: A user study on mixed reality remote collaboration with eye gaze and hand gesture sharing. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing System (CHI 2020), pp. 1–13. Association for Computing Machinery, New York 2020. https://doi.org/10.1145/3313831.3376550
Kuzuoka, H., Ishimoda, G., Nishimura, Y., Suzuki, R., Kondo, K.: Can the GestureCam be a Surrogate? In: Marmolin, H., Sundblad, Y., Schmidt, K. (eds.) Proceedings of the Fourth European Conference on Computer-Supported Cooperative Work, ECSCW 1995, pp. 181–196. Springer, Dordrecht(1995). https://doi.org/10.1007/978-94-011-0349-7_12
Higuch, K., Yonetani, R., Sato, Y.: Can eye help you?: effects of visualizing eye fixations on remote collaboration scenarios for physical tasks. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI 2016), pp. 5180–5190. ACM, New York (2016). https://doi.org/10.1145/2858036.2858438
Gupta, K., Lee, G.A., Billinghurst, M.: Do you see what i see? The effect of gaze tracking on task space remote collaboration. IEEE Trans. Vis. Comput. Graph. 22(11), 2413–2422 (2016). https://doi.org/10.1109/TVCG.2016.2593778
Sketch line image. https://www.clipstudio.net/oekaki/archives/153211
Pointer image. https://www.gettyimages.co.jp/%E5%86%99%E7%9C%9F/%E3%83%AC%E3%83%BC%E3%82%B6%E3%83%BC%E3%83%9D%E3%82%A4%E3%83%B3%E3%82%BF%E3%83%BC
Base Station Image. https://www.vive.com/eu/accessory/base-station2/
LeapMotion and Vive Pro Eye. https://www.thingiverse.com/thing:3019075
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Satomi, K., Mori, H. (2023). A Study on Visual Communication with Different Conveyance Under MR Remote Collaboration. In: Mori, H., Asahi, Y. (eds) Human Interface and the Management of Information. HCII 2023. Lecture Notes in Computer Science, vol 14016. Springer, Cham. https://doi.org/10.1007/978-3-031-35129-7_41
Download citation
DOI: https://doi.org/10.1007/978-3-031-35129-7_41
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-35128-0
Online ISBN: 978-3-031-35129-7
eBook Packages: Computer ScienceComputer Science (R0)