Skip to main content

Design and Development of a Teleoperation System for Affective Tabletop Robot Haru

  • Conference paper
  • First Online:
Social Robotics (ICSR 2021)

Abstract

The experimental tabletop robot Haru, used for affective telepresence research, enables a teleoperator to communicate a variety of information to a remote user through the robotic medium from a distance. However, the robot’s rich communicative modality poses some problems to the teleoperator. Based on their experience of controlling the robot, teleoperators feel the need to be constantly attentive to and engaged with the stream of data from the remote user in order to achieve a seamless and affective interaction. Consequently, teleoperators report feeling fatigued, resulting in a decrease in time using the teleoperation system. In addition, the bulk of the data stream containing information about the remote user poses data privacy concerns. In this paper, we describe the design and development of an improved affective teleoperation system that focuses on privacy, controllability, and mental fatigue. The proposed system enables a teleoperator to maintain the same degree of robot control with a minimal amount of data from the remote user. Moreover, our studies show that the proposed system drastically reduces teleoperation fatigue as shown by the increase in time the system is in use.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.cereproc.com.

  2. 2.

    https://www.qt.io.

  3. 3.

    https://www.ros.org.

  4. 4.

References

  1. Arkin, R., Ali, K.: Integration of reactive and telerobotic control in multi-agent robotic systems. In: Proceedings Simulation of Adaptive Behavior. Citeseer (1994)

    Google Scholar 

  2. Calo, R.: The drone as a privacy catalyst. Stan. L. Rev. Online 64, 29 (2011)

    Google Scholar 

  3. Feil-Seifer, D., Skinner, K., Mataric, M.J.: Benchmarks for evaluating socially assistive robotics. Int. Stud. 8(3), 423–439 (2007)

    Article  Google Scholar 

  4. Fong, T., Thorpe, C.: Vehicle teleoperation interfaces. Auton. Robot. 11(1), 9–18 (2001)

    Article  Google Scholar 

  5. Gomez, R., Nakamura, K., Szapiro, D., Merino, L.: A holistic approach in designing tabletop robot’s expressivity. In: Proceedings of the International Conference on Robotics and Automation (2020)

    Google Scholar 

  6. Gomez, R., Szapiro, D., Galindo, K., Nakamura, K.: Haru: hardware design of an experimental tabletop robot assistant. In: Proceedings of the 2018 ACM/IEEE International Conference on Human-robot Interaction, pp. 233–240 (2018)

    Google Scholar 

  7. Kaber, D.B., Onal, E., Endsley, M.R.: Design of automation for telerobots and the effect on performance, operator situation awareness, and subjective workload. Hum. Fact. Ergon. Manuf. Serv. Ind. 10(4), 409–430 (2000)

    Article  Google Scholar 

  8. Macharet, D.G., Florencio, D.A.: A collaborative control system for telepresence robots. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5105–5111. IEEE (2012)

    Google Scholar 

  9. Music, S., Salvietti, G., Dohmann, P., Chinello, F., Prattichizzo, D., Hirche, S.: Human-multi-robot teleoperation for cooperative manipulation tasks using wearable haptic devices (2017)

    Google Scholar 

  10. Nakamichi, D., Nishio, S., Ishiguro, H.: Training of telecommunication through teleoperated android “telenoid" and its effect. In: The 23rd IEEE International Symposium on Robot and Human Interactive Communication, pp. 1083–1088. IEEE (2014)

    Google Scholar 

  11. Niemelä, M., van Aerschot, L., Tammela, A., Aaltonen, I., Lammi, H.: Towards ethical guidelines of using telepresence robots in residential care. Int. J. Soc. Robot. 13(3), 1–9 (2019)

    Google Scholar 

  12. Poyatos, F.: The reality of multichannel verbal-nonverbal communication in simultaneous and consecutive interpretation. Benjamins Trans. Lib. 17, 249–282 (1997)

    Article  Google Scholar 

  13. Sandry, E.: Robots and Communication. Palgrave Macmillan UK, London (2015). https://doi.org/10.1057/9781137468376

    Book  Google Scholar 

  14. Scholtz, J., Antonishek, B., Young, J.: Evaluation of a human-robot interface: Development of a situational awareness methodology. In: 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the, p. 9. IEEE (2004)

    Google Scholar 

  15. Small, N., Lee, K., Mann, G.: An assigned responsibility system for robotic teleoperation control. Int. J. Intell. Robot. Appl. 2(1), 81–97 (2018). https://doi.org/10.1007/s41315-018-0043-0

    Article  Google Scholar 

  16. Steinfeld, A.: Interface lessons for fully and semi-autonomous mobile robots. In: IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA’04. 2004, vol. 3, pp. 2752–2757. IEEE (2004)

    Google Scholar 

  17. Steinfeld, A., et al.: Common metrics for human-robot interaction. In: Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction, pp. 33–40 (2006)

    Google Scholar 

  18. Wada, K., Glas, D.F., Shiomi, M., Kanda, T., Ishiguro, H., Hagita, N.: Capturing expertise: developing interaction content for a robot through teleoperation by domain experts. Int. J. Soc. Robot. 7(5), 653–672 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Yurii Vasylkiv , Ricardo Ragel , Luis Merino , Eleanor Sandry , Heike Brock , Keisuke Nakamura , Irani Pourang or Randy Gomez .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Vasylkiv, Y. et al. (2021). Design and Development of a Teleoperation System for Affective Tabletop Robot Haru. In: Li, H., et al. Social Robotics. ICSR 2021. Lecture Notes in Computer Science(), vol 13086. Springer, Cham. https://doi.org/10.1007/978-3-030-90525-5_49

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90525-5_49

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90524-8

  • Online ISBN: 978-3-030-90525-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics