skip to main content
research-article

Waiting for Tactile: Robotic and Virtual Experiences in the Fog

Published: 16 June 2021 Publication History

Abstract

Social robots adopt an emotional touch to interact with users inducing and transmitting humanlike emotions. Natural interaction with humans needs to be in real time and well grounded on the full availability of information on the environment. These robots base their way of communicating on direct interaction (touch, listening, view), supported by a range of sensors on the surrounding environment that provide a radially central and partial knowledge on it. Over the past few years, social robots have been demonstrated to implement different features, going from biometric applications to the fusion of machine learning environmental information collected on the edge. This article aims at describing the experiences performed and still ongoing and characterizes a simulation environment developed for the social robot Pepper that aims to foresee the new scenarios and benefits that tactile connectivity will enable.

References

[1]
N. Akshatha, K. H. J. Rai, M. K. Haritha, R. Ramesh, R. Hegde, and S. Kumar. 2019. Tactile internet: Next generation IoT. In Proceedings of the 3rd International Conference on Inventive Systems and Control (ICISC’19). 22–26.
[2]
Dhiya Al-Jumeily, Mohamad Al-Zawi, Abir Hussain, and Ciprian Dobre. 2014. Adaptive pipelined neural network structure in self-aware internet of things. In Big Data and Internet of Things: A Roadmap for Smart Environments. Springer, Cham, 111–136.
[3]
M. Al-khafajiy, T. Baker, A. Waraich, D. Al-Jumeily, and A. Hussain. 2018. IoT-Fog optimal workload via fog offloading. In Proceedings of the 2018 IEEE/ACM International Conference on Utility and Cloud Computing Companion (UCC’18 Companion). IEEE, 359–364. https://doi.org/10.1002/spe.2688
[4]
Tanweer Alam. 2019. Tactile internet and its contribution in the development of smart cities. International Journal of Electronics and Information Engineering 12, 3 (2020), 112–118.
[5]
Remi Arnaud and Mark C. Barnes. 2006. COLLADA: Sailing the Gulf of 3D Digital Content Creation. CRC Press.
[6]
Thar Baker, Muhammad Asim, Áine MacDermott, Farkhund Iqbal, Faouzi Kamoun, Babar Shah, Omar Alfandi, and Mohammad Hammoudeh. 2019. A secure fog-based platform for SCADA-based IoT critical infrastructure. Softw.: Pract. Exper. 50, 5 (2019), 503–518.
[7]
Paola Barra, Carmen Bisogni, Antonio Rapuano, Andrea Francesco Abate, and Gerardo Iovane. 2019. HiMessage: An interactive voice mail system with the humanoid robot pepper. In Proceedings of the IEEE Digital Avionics Systems Conference (DASC’19). IEEE, 652–656.
[8]
Zuria Bauer, Felix Escalona, Edmanuel Cruz, Miguel Cazorla, and Francisco Gomez-Donoso. 2019. Refining the fusion of pepper robot and estimated depth maps method for improved 3D perception. IEEE Access 7 (2019), 185076–185085.
[9]
Carmen Bisogni, Lucia Cascone, Aniello Castiglione, Gerardo Costabile, and Ilenia Mercuri. 2020. Social robot interactions for social engineering: Opportunities and open issues. In Proceedings of the IEEE Digital Avionics Systems Conference (DASC’20). IEEE, 527–535.
[10]
Hongming Cai, Boyi Xu, Lihong Jiang, and Athanasios Vasilakos. 2016. IoT-based big data storage systems in cloud computing: Perspectives and challenges. IEEE IoT J. 4, 1 (2016), 75–87.
[11]
H. Cai, B. Xu, L. Jiang, and A. V. Vasilakos. 2017. IoT-based big data storage systems in cloud computing: Perspectives and challenges. IEEE IoT J. 4, 1 (2017), 75–87.
[12]
John Alejandro Castro Vargas, Alberto Garcia-Garcia, Sergiu Oprea, Sergio Orts, and José Rodríguez. 2018. Detecting and manipulating objects with a social robot: An ambient assisted living approach. Advances in Intelligent Systems and Computing, 613–624.
[13]
John H. Challis. 1995. A procedure for determining rigid body transformation parameters. J. Biomech. 28, 6 (1995), 733–737.
[14]
H. Chen, H. W. Park, and C. Breazeal. 2020. Teaching and learning with children: Impact of reciprocal peer learning with a social robot on children’s learning and emotive engagement. Comput. Educat. 150 (2020).
[15]
Laurens De Gauquier, Hoang-Long Cao, Pablo Gomez Esteban, Albert De Beir, Stephanie Van de sanden, Kim Willems, Malaika Brengman, and Bram Vanderborght. 2018. Humanoid robot pepper at a belgian chocolate shop. In Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction.373–373.
[16]
G. P. Fettweis. 2014. The tactile internet: Applications and challenges. IEEE Vehic. Technol. Mag. 9, 1 (2014), 64–70.
[17]
Pasquale Foggia, Antonio Greco, Gennaro Percannella, Mario Vento, and Vincenzo Vigilante. 2019. A system for gender recognition on mobile robots. In Proceedings Of The 2nd International Conference On Applications Of Intelligent Systems. 1–6.
[18]
Andrzej Goscinski, Zahir Tari, Abdul Izzatdin, and Eidah Alzahrani. 2018. Fog computing as a critical link between a central cloud and iot in support of fast discovery of new hydrocarbon reservoirs. In International Conference on Mobile Networks and Management. Springer, Cham, 247–261.
[19]
S. Haddadin, L. Johannsmeier, and F. Díaz Ledezma. 2019. Tactile robots as a central embodiment of the tactile internet. Proc. IEEE 107, 2 (2019), 471–487.
[20]
William Harrington. 2015. Learning Raspbian. Packt Publishing Ltd.
[21]
Matthias Hirschmanner, Stephanie Gross (Schreitter), Brigitte Krenn, Friedrich Neubarth, Martin Trapp, and Markus Vincze. 2018. Grounded word learning on a pepper robot. In Proceedings of the 18th International Conference on Intelligent Virtual Agents. 351–352.
[22]
Rui Hu, Zheng Yan, Wenxiu Ding, and Laurence Yang. 2019. A survey on data provenance in IoT. World Wide Web (11 2019).
[23]
P1918.1 IEEE. 2016. Tactile Internet: Application Scenarios, Definitions and Terminology, Architecture, Functions, and Technical Assumptions. Retrieved from https://standards.ieee.org/develop/project/1918.1.html.
[24]
Min Jia, Zheng Gao, Qing Guo, Yun Lin, and Xuemai Gu. 2019. Sparse feature learning for correlation filter tracking toward 5g-enabled tactile internet. IEEE Trans. Industr. Inf. (03 2019), 1–1.
[25]
Arthur Juliani, Vincent-Pierre Berges, Esh Vckay, Yuan Gao, Hunter Henry, Marwan Mattar, and Danny Lange. 2018. Unity: A general platform for intelligent agents. arXiv:1809.02627. Retrieved from https://arxiv.org/abs/1809.02627.
[26]
M. Khalaf, H. Alaskar, A. J. Hussain, T. Baker, Z. Maamar, R. Buyya, P. Liatsis, W. Khan, H. Tawfik, and D. Al-Jumeily. 2020. IoT-Enabled flood severity prediction via ensemble machine learning models. IEEE Access 8 (2020), 70375–70386.
[27]
H. Kumarage, I. Khalil, A. Alabdulatif, Z. Tari, and X. Yi. 2016. Secure data analytics for cloud-integrated internet of things applications. IEEE Cloud Comput. 3, 2 (2016), 46–56.
[28]
Z. Liu, H. Seo, A. Castiglione, K. R. Choo, and H. Kim. 2019. Memory-efficient implementation of elliptic curve cryptography for the internet-of-things. IEEE Trans. Depend. Sec. Comput. 16, 3 (2019), 521–529.
[29]
Zakaria Maamar, Ejub Kajan, Muhammad Asim, and Thar Baker. 2019. Open challenges in vetting the internet-of-things. Internet Technol. Lett. (08 2019), e129.
[30]
Áine MacDermott, Thar Baker, Paul Buck, Farkhund Iqbal, and Qi Shi. 2019. The internet of things: Challenges and considerations for cybercrime investigations and digital forensics. Int. J. Dig. Crime Forens. 12 (06 2019), 1–13.
[31]
Mina Marmpena, Fernando Garcia, and Angelica Lim. 2020. Generating robotic emotional body language of targeted valence and arousal with conditional variational autoencoders. In Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. 357–359.
[32]
Prodromos-Vasileios Mekikis, Kostas Ramantas, Luis Sanabria-Russo, Jordi Serra, Angelos Antonopoulos, David Pubill, Elli Kartsakli, and Christos Verikoukis. 2019. NFV-enabled experimental platform for 5g tactile internet support in industrial environments. IEEE Trans. Industr. Inf. (05 2019), 1–1.
[33]
Woongsoo Na, Nhu-Ngoc Dao, Joongheon Kim, Eun-Seok Ryu, and Sungrae Cho. 2020. Simulation and measurement: Feasibility study of tactile internet applications for mmWave virtual reality. ETRI J. 42 (01 2020).
[34]
Nashwan Adnan Othman and Ilhan AYDIN. 2018. A new deep learning application based on Movidius NCS for embedded object detection and recognition. In Proceedings of the 2nd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT’18). IEEE, 1–5.
[35]
Tomoe Ozeki, Tetsuya Mouri, Hiroko Sugiura, Yuu Yano, and Kunie Miyosawa. 2020. Use of communication robots to converse with people suffering from schizophrenia. ROBOMECH J. 7 (12 2020).
[36]
K. Polachan, B. Turkovic, P. T. V., C. Singh, and F. A. Kuipers. 2020. Dynamic network slicing for the tactile internet. In Proceedings of the 2020 ACM/IEEE 11th International Conference on Cyber-Physical Systems (ICCPS’20). 129–140.
[37]
C. Rajabhushanam and V. Sundar. 2017. Thick client web application prototype. Int. J. Pure Appl. Math. 116, 10 (2017), 127–131.
[38]
K. Aava Rani. 2014. Learning Unity Physics. Packt Publishing Ltd.
[39]
Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016. You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 779–788.
[40]
Esteban Reyes, Cristopher Gómez, Esteban Norambuena, and Javier Ruiz-del Solar. 2018. Near real-time object recognition for pepper based on deep neural networks running on a backpack. In Robot World Cup. Springer, Cham, 287–298.
[41]
Aldebaran Robotics. 2006. Aldebaran 2.0.6.8 documentation. Retrieved from http://doc.aldebaran.com/2-0/family/juliette_technical/joints_juliette.html.
[42]
Deepak Tolani, Ambarish Goswami, and Norman I. Badler. 2000. Real-time inverse kinematics techniques for anthropomorphic limbs. Graph. Models 62, 5 (2000), 353–388.
[43]
Mohammad Wazid, Ashok Kumar Das, Khurram Khan, A. Al-Dhawailie, Neeraj Kumar, and Athanasios Vasilakos. 2017. Secure authentication scheme for medicine anti-counterfeiting system in iot environment. IEEE IoT J. (05 2017), 1–1.
[44]
P. Xu, C. F. Cheung, C. Wang, and C. Zhao. 2020. Novel hybrid robot and its processes for precision polishing of freeform surfaces. Precis. Eng. 64 (2020), 53–62.
[45]
Ayesha Younis, Li Shixin, Shelembi Jn, and Zhang Hai. 2020. Real-time object detection using pre-trained deep learning models MobileNet-SSD. In Proceedings of the 6th International Conference on Computing and Data Engineering (ICCDE’20). Association for Computing Machinery, New York, NY, 44–48.
[46]
Marco Zaratti, Marco Fratarcangeli, and Luca Iocchi. 2006. A 3D simulator of multiple legged robots based on USARSim. In Robot Soccer World Cup. Springer, 13–24.
[47]
J. Zhou, Z. Cao, X. Dong, and A. V. Vasilakos. 2017. Security and Privacy for Cloud-Based IoT: Challenges. IEEE Commun. Mag. 55, 1 (2017), 26–33.

Cited By

View all
  • (2023)PePUT: A Unity Toolkit for the Social Robot Pepper2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309447(1012-1019)Online publication date: 28-Aug-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Internet Technology
ACM Transactions on Internet Technology  Volume 21, Issue 3
August 2021
522 pages
ISSN:1533-5399
EISSN:1557-6051
DOI:10.1145/3468071
  • Editor:
  • Ling Liu
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 June 2021
Accepted: 01 August 2020
Revised: 01 August 2020
Received: 01 May 2020
Published in TOIT Volume 21, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Tactile Internet
  2. ambient-robot interaction
  3. robotics
  4. 3D simulation
  5. wireless IoT communication

Qualifiers

  • Research-article
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)25
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)PePUT: A Unity Toolkit for the Social Robot Pepper2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309447(1012-1019)Online publication date: 28-Aug-2023

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media