Abstract
The authors have proposed an idea of augmented tele-presence system called ARM-COMS (ARm-supported eMbodied COmmunication Monitor System), which detects the orientation of a subject face by face-tracking based on image processing technique, and mimics the head motion of a remote person to behave as if its avatar makes interaction during video communication. In addition to that, ARM-COMS makes appropriate reactions by audio signals during talk when a remote person speaks even without any significant motion in video communication.
Based on the basic idea of ARM-COMS, this study implemented an advanced prototype system using ROS platform for natural video conference involvement. This paper describes the prototype system developed in this study, shows how the basic procedure was implemented, and discusses the natural involvement targeted by this approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bertrand, C., Bourdeau, L.: Research interviews by Skype: a new data collection method. In: Esteves, J. (Ed.) Proceedings from the 9th European Conference on Research Methods, pp. 70–79. IE Business School, Spain (2010)
Dionisio, J.D.N., Burns III, W.G., Gilbert, R.: 3D virtual worlds and the metaverse: Current status and future possibilities. ACM Comput. Surv. 45(3), 1–38. Article no. 34. https://doi.org/10.1145/2480741.2480751
Dlib c++ library.: http://dlib.net/
Ekman, P., Friesen, W.V.: The repertoire or nonverbal behavior: categories, origins, usage, and coding. Semiotica 1, 49–98 (1969)
Gerkey B., Smart, W., Quigley, M.: Programming Robots with ROS. O’Reilly Media (2015)
Ito, T., Watanabe, T.: Motion Control Algorithm of ARM-COMS for Entrainment Enhancement. In: Yamamoto, S. (ed.) HIMI 2016. LNCS, vol. 9734, pp. 339–346. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40349-6_32
Ito, T., Kimachi, H., Watanabe, T.: Combination of Local Interaction with Remote Interaction in ARM-COMS Communication. In: Yamamoto, S., Mori, H. (eds.) HCII 2019. LNCS, vol. 11570, pp. 347–356. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22649-7_28
Ito, T., Oyama, T., Watanabe, T.: Smart Speaker Interaction Through ARM-COMS for Health Monitoring Platform. In: Yamamoto, S., Mori, H. (eds.) HCII 2021. LNCS, vol. 12766, pp. 396–405. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-78361-7_30
Kumar, A., Haider, Y., Kumar, M., et al.: Using WhatsApp as a quick-access personal logbook for maintaining clinical records and follow-up of orthopedic patients. Cureus 13(1), e12900 (2021). https://doi.org/10.7759/cureus.12900
Lee, A., Kawahara, T.: Recent development of open-source speech recognition engine Julius. In: Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) (2009)
Lokshina, I., Lanting, C.: A Qualitative Evaluation of IoT-Driven eHealth: Knowledge Management, Business Models and Opportunities, Deployment and Evolution. In: Kryvinska, N., Greguš, M. (eds.) Data-Centric Business and Applications. LNDECT, vol. 20, pp. 23–52. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-94117-2_2
Helmke, M., Elizabech, J., Rey, J.A.: Official Ubuntu Book, 9th edn. Pearson (2016)
Medical Alert Advice.: www.medicalalertadvice.com. Accessed on 23 Feb 2021
Quigley, M., Gerkey, B., Smart, W.D.: Programming Robots with ROS: A Practical Introduction to the Robot Operating System. O’Reilly Media (2015)
OpenCV.: http://opencv.org/
OpenFace API Documentation.: http://cmusatyalab.github.io/openface/
Osawa, T., Matsuda, Y., Ohmura, R., Imai, M.; Embodiment of an agent by an-thropomorphization of a common object. Int. J. Web Intell. Agent Syst. 10, 345–358 (2012)
Rviz.: https://carla.readthedocs.io/projects/ros-bridge/en/latest/rviz_plugin/
Schoff, F., Kalenichenko, D., Philbin, J.: FaceNet: a unified embedding for face recognition and clustering.In: IEEE Conf. on CVPR 2015, pp. 815–823 (2015)
Society 5.0.: https://www.japan.go.jp/abenomics/_userdata/abenomics/pdf/society_5.0.pdf. Accessed on 23 Feb 2021
Ubuntu.: https://www.ubuntu.com/
urdf/XML/Transmission.: http://wiki.ros.org/urdf/XML/Transmission. Accessed on 16 Feb 2020
Watanabe, T.: Human-entrained embodied interaction and communication technology. In: Fukuda, S. (eds) Emotional Engineering. Springer, London. https://doi.org/10.1007/978-1-84996-423-4_9 (2011)
Wongphati, M., Matsuda, Y., Osawa, H., Imai, M.: Where do you want to use a robotic arm? And what do you want from the robot ? In: International Symposium on Robot and Human Interactive Communication, pp. 322–327 (2012)
Acknowledgement
This work was partly supported by JSPS KAKENHI Grant Numbers JP19K12082 and Original Research Grant 2021 of Okayama Prefectural University. The author would like to acknowledge Dr.Takashi Oyama, Mr.Shuto Misawa, Mr.Kengo Sadakane for implementing the basic modules, and all members of Kansei Information Engineering Labs at Okayama Prefectural University for their cooperation to conduct the experiments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ito, T., Watanabe, T. (2022). Natural Involvement to Video Conference Through ARM-COMS. In: Yamamoto, S., Mori, H. (eds) Human Interface and the Management of Information: Applications in Complex Technological Environments. HCII 2022. Lecture Notes in Computer Science, vol 13306. Springer, Cham. https://doi.org/10.1007/978-3-031-06509-5_17
Download citation
DOI: https://doi.org/10.1007/978-3-031-06509-5_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-06508-8
Online ISBN: 978-3-031-06509-5
eBook Packages: Computer ScienceComputer Science (R0)