Abstract
Conventional human-robot interaction is usually limited to a set of commands a professional human operator is supposed to use, and/or teleoperation capabilities. The paper explores capabilities a robot could use to communicate more naturally with a human, support for a range of hardware configurations is provided. The capabilities developed for interaction toolkit include speech and face recognition. Finally, a use case for such a toolkit and performance with respect to different hardware configurations are discussed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Fong, T., Nourbakhsh, I., Kunz, C., Fluckiger, L., Schreiner, J., Ambrose, R., Burridge, R., Simmons, R., Hiatt, L., Schultz, A., Trafton, J.G., Bugajska, M., Scholtz, J.: The peer-to-peer human-robot interaction project. In: Space 2005. American Institute of Aeronautics and Astronautics (2005)
Abadi, M., Agarwal, A., Barham, P., et al.: TensorFlow: large-scale machine learning on heterogeneous systems. In: arXiv e-prints (2015)
OpenVINO deep learning computer vision toolkit. https://software.intel.com/en-us/openvino-toolkit
Povey, D., et al.: The Kaldi speech recognition toolkit. In: Proc. ASRU, Hawaii, US, pp. 1–4 (2011)
Zhang, S., Zhu, X., Lei, Z., Shi, H., Wang, X., Li, S.Z.: FaceBoxes: a CPU real-time face detector with high accuracy. In: 2017 IEEE International Joint Conference on Biometrics (IJCB). IEEE (2017)
Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: a unified embedding for face recognition and clustering. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE (2015)
GSteamer multimedia framework. https://gstreamer.freedesktop.org/
Alumäe, Tanel: Full-duplex speech-to-text system for Estonian. FAIA 268, 3–10 (2014)
Introducing the Intel Neural Compute Stick 2. https://software.intel.com/en-us/neural-compute-stick
Steinfeld, A., Fong, T., Kaber, D., Lewis, M., Scholtz, J., Schultz, A., Goodrich, M.: Common metrics for human-robot interaction. In: Proceeding of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction - HRI ’06. ACM Press (2006)
Acknowledgements
This work has been supported by the Ministry of Science and Higher Education of the Russian Federation with the project “Development of anthropomorphic robotic complexes with variable stiffness actuators for movement on the flat and the rugged terrains” (agreement: № 075-10-2018-010 (№ 14.606.21.0007), ID: RFMEFI60617X0007).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Gaifullin, R., Ivanou, M., Gazizov, R. (2020). Natural Human-Robot Interaction Toolkit. In: Ahram, T., Taiar, R., Colson, S., Choplin, A. (eds) Human Interaction and Emerging Technologies. IHIET 2019. Advances in Intelligent Systems and Computing, vol 1018. Springer, Cham. https://doi.org/10.1007/978-3-030-25629-6_31
Download citation
DOI: https://doi.org/10.1007/978-3-030-25629-6_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-25628-9
Online ISBN: 978-3-030-25629-6
eBook Packages: EngineeringEngineering (R0)