Abstract
Recent advances in communications and robotics enable myriad teleoperation applications, empowering real-time remote operation in various application areas such as healthcare, education, manufacturing, and aerial manipulation. The main problems in teleoperation systems are the time delay and packet loss caused by poor network conditions. Ultra-reliable Low-Latency Communication (URLLC), one of the key services of fifth-generation cellular communications (5G), is expected to enable real-time teleoperation by mitigating latency and reliability issues of pre-5G communications. In this study, we develop a 5G-enabled teleoperation testbed to conduct experiments on communication latency and packet loss, demonstrating the current capabilities of 5G communications for teleoperation applications. Furthermore, we propose a two-way timeout approach to reduce the communication latency. The proposed approach reduces the end-to-end (E2E) latency by limiting the waiting time for new packet reception. Extensive latency and packet loss experiments are conducted to demonstrate the superiority of the proposed approach compared to the benchmark approach without a timeout. The experimental results corroborate that the proposed approach can reduce E2E latency by up to 65% and improves overall reliability.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
System description: https://youtu.be/c3onK5Vh6QE.
- 2.
Remote dental inspection use case: https://youtu.be/afJFUwUW6Dg.
References
Franka control interface documentation (2017). https://frankaemika.github.io/docs/
Antonakoglou, K., Xu, X., Steinbach, E., Mahmoodi, T., Dohler, M.: Toward haptic communications over the 5G tactile internet. IEEE Commun. Surv. Tutor. 20(4), 3034–3059 (2018)
Beik-Mohammadi, H., et al.: Model mediated teleoperation with a hand-arm exoskeleton in long time delays using reinforcement learning. In: IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 713–720. IEEE (2020)
Denavit, J., Hartenberg, R.S.: A kinematic notation for lower-pair mechanisms based on matrices (1955)
Durairajan, R., Mani, S.K., Sommers, J., Barford, P.: Time’s forgotten: using NTP to understand internet latency. In: ACM Workshop on Hot Topics in Networks, pp. 1–7 (2015)
Feizi, N., Tavakoli, M., Patel, R.V., Atashzar, S.F.: Robotics and AI for teleoperation, tele-assessment, and tele-training for surgery in the era of COVID-19: existing challenges, and future vision. Front. Robot. AI 16 (2021)
Girgis, A.M., Park, J., Bennis, M., Debbah, M.: Predictive control and communication co-design via two-way gaussian process regression and AOI-aware scheduling. arXiv preprint arXiv:2101.11647 (2021)
Hou, Z., She, C., Li, Y., Zhuo, L., Vucetic, B.: Prediction and communication co-design for ultra-reliable and low-latency communications. IEEE Trans. Wireless Commun. 19(2), 1196–1209 (2019)
Kaul, S., Gruteser, M., Rai, V., Kenney, J.: Minimizing age of information in vehicular networks. In: IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks, pp. 350–358. IEEE (2011)
Kebria, P.M., Abdi, H., Dalvand, M.M., Khosravi, A., Nahavandi, S.: Control methods for internet-based teleoperation systems: A review. IEEE Trans. Hum.-Mach. Syst. 49(1), 32–46 (2018)
Kim, S., Shin, S., Moon, J.: UDP-based extremely low latency streaming. In: IEEE Annual Consumer Communications & Networking Conference (CCNC), pp. 94–99. IEEE (2022)
Kizilkaya, B., Zhao, G., Sambo, Y.A., Li, L., Imran, M.A.: 5g-enabled education 4.0: Enabling technologies, challenges, and solutions. IEEE Access 9, 166962–166969 (2021)
Liu, C.: Adaptive control of teleoperation systems with uncertainties: a survey. In: The 3rd International Conference on Robotics Systems and Automation Engineering (RSAE), pp. 5–9 (2021)
Patriciello, N., Lagen, S., Giupponi, L., Bojovic, B.: 5G new radio numerologies and their impact on the end-to-end latency. In: IEEE International Workshop on Computer Aided Modeling and Design of cCommunication Links and Networks (CAMAD), pp. 1–6. IEEE (2018)
Risiglione, M., Sleiman, J.P., Minniti, M.V., Cizmeci, B., Dresscher, D., Hutter, M.: Passivity-based control for haptic teleoperation of a legged manipulator in presence of time-delays. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5276–5281. IEEE (2021)
Tahir, M.N., Katz, M.: ITS performance evaluation in direct short-range communication (IEEE 802.11p) and cellular network (5G) (TCP vs UDP). In: Hamid, U.Z.A., Al-Turjman, F. (eds.) Towards Connected and Autonomous Vehicle Highways. EICC, pp. 257–279. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-66042-0_10
Tokatli, O., et al.: Robot-assisted glovebox teleoperation for nuclear industry. Robotics 10(3), 85 (2021)
Tong, X., Zhao, G., Imran, M.A., Pang, Z., Chen, Z.: Minimizing wireless resource consumption for packetized predictive control in real-time cyber physical systems. In: IEEE International Conference on Communications Workshops (ICC Workshops), pp. 1–6. IEEE (2018)
Wang, Z., Lam, H.K., Xiao, B., Chen, Z., Liang, B., Zhang, T.: Event-triggered prescribed-time fuzzy control for space teleoperation systems subject to multiple constraints and uncertainties. IEEE Trans. Fuzzy Syst. 29(9), 2785–2797 (2020)
Xu, X., Zhang, S., Liu, Q., Steinbach, E.: QoE-driven delay-adaptive control scheme switching for time-delayed bilateral teleoperation with haptic data reduction. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 8838–8844. IEEE (2021)
Yang, Y., Hanzo, L.: Permutation-based TCP and UDP transmissions to improve goodput and latency in the internet of things. IEEE Internet Things J. 8(18), 14276–14286 (2021)
Zhang, D., Tron, R.: Stable haptic teleoperation of UAVs via small L2 gain and control barrier functions. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 8352–8357. IEEE (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Kizilkaya, B., Popoola, O., Zhao, G., Imran, M.A. (2023). 5G-Based Low-Latency Teleoperation: Two-Way Timeout Approach. In: Iida, F., Maiolino, P., Abdulali, A., Wang, M. (eds) Towards Autonomous Robotic Systems. TAROS 2023. Lecture Notes in Computer Science(), vol 14136. Springer, Cham. https://doi.org/10.1007/978-3-031-43360-3_38
Download citation
DOI: https://doi.org/10.1007/978-3-031-43360-3_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-43359-7
Online ISBN: 978-3-031-43360-3
eBook Packages: Computer ScienceComputer Science (R0)