Skip to main content
SpringerLink
Log in
Book cover

International Conference on Robotics in Alpe-Adria Danube Region

RAAD 2019: Advances in Service and Industrial Robotics pp 188–193Cite as

Towards Using Natural User Interfaces for Robotic Arm Manipulation

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 980))

Abstract

In this paper, we propose a Natural User Interface (NUI) based on Leap Motion controller which enables intuitive manipulation of a 6-DOF Jaco robotic arm. By using this NUI interface, we aim to study the effects of hand movements and gestures for interaction with a robotic arm. We present a qualitative evaluation of the proposed NUI system by trials with subjects carrying out a standard robotic arm manipulation session using both the conventional joystick interface and the NUI based one. The results are discussed in the last part of the paper.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Bassily, D., Georgoulas, C., Guettler, J., Linner, T., Bock, T.: Intuitive and adaptive robotic arm manipulation using the leap motion controller. In: Proceedings of 41st International Symposium on Robotics 2014, pp. 1–7. VDE, Munich (2014)

    Google Scholar 

  2. Cicirelli, G., Attolico, C., Guaragnella, C., D’Orazio, T.: A kinect-based gesture recognition approach for a natural human robot interface. Int. J. Adv. Rob. Syst. 12(3), 1–11 (2015)

    Google Scholar 

  3. Chandarana, M., Trujillo, A., Shimada, K., Allen, B.D.: A natural interaction interface for UAVs using intuitive gesture recognition. In: Savage-Knepshield, P., Chen, J. (eds.) Advances in Human Factors in Robots and Unmanned Systems. AISC, vol. 499, pp. 387–398. Springer, Cham (2017)

    Chapter  Google Scholar 

  4. Chen, S., Ma, H., Yang, C., Fu, M.: Hand gesture based robot control system using leap motion. In: Liu, H., Kubota, N., Zhu, X., Dillmann, R., Zhou, D. (eds.) Intelligent Robotics and Applications, ICIRA 2015. LNCS, vol. 9244, pp. 581–591. Springer, Cham (2015)

    Chapter  Google Scholar 

  5. García, J.C., Patrão, B., Almeida, L., Pérez, J., Menezes, P., Dias, J., Sanz, P.J.: A natural interface for remote operation of underwater robots. IEEE Comput. Graph. Appl. 37(1), 34–43 (2017)

    Article  Google Scholar 

  6. Gîrbacia, F., Gîrbacia, T., Butnariu, S.: Design review of cad models using a NUI leap motion sensor. J. Ind. Des. Eng. Graph. 10, 21–24 (2015)

    Google Scholar 

  7. Fernández, R.A.S., Sanchez-Lopez, J.L., Sampedro, C., Bavle, H., Molina, M., Campoy, P.: Natural user interfaces for human-drone multi-modal interaction. In: 2016 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 1013–1022. IEEE, Arlington (2016)

    Google Scholar 

  8. Herrmann, R., Schmidt, L.: Design and evaluation of a natural user interface for piloting an unmanned aerial vehicle. i-com 17(1), 15–24 (2018)

    Article  Google Scholar 

  9. Peshkova, E., Hitz, M., Kaufmann, B.: Natural interaction techniques for an unmanned aerial vehicle system. IEEE Pervasive Comput. 16(1), 34–42 (2017)

    Article  Google Scholar 

  10. Sabattini, L., Villani, V., Secchi, C., Fantuzzi, C.: A general approach to natural human-robot interaction. In: Ficuciello, F., Ruggiero, F., Finzi, A. (eds.) Human Friendly Robotics, Springer Proceedings in Advanced Robotics, vol. 7, pp. 61–71. Springer, Cham (2019)

    Chapter  Google Scholar 

  11. Villani, V., Sabattini, L., Riggio, G., Levratti, A., Secchi, C., Fantuzzi, C.: Interacting with a mobile robot with a natural infrastructure-less interface. IFAC-PapersOnLine 50(1), 12753–12758 (2017)

    Article  Google Scholar 

  12. Weichert, F., Bachmann, D., Rudak, B., Fisseler, D.: Analysis of the accuracy and robustness of the leap motion controller. Sensors 13(5), 6380–6393 (2013)

    Article  Google Scholar 

Download references

Acknowledgment

This work was supported by a grant of the Ministry of National Education and Scientific Research, RDI Programme for Space Technology and Advanced Research - STAR, project number 566. We would also like to thank members of Transilvania University of Brasov for their participation in the experiment.

Author information

Authors and Affiliations

  1. Transilvania University of Brasov, Eroilor 29, 500036, Brasov, Romania

    Florin Gîrbacia, Cristian Postelnicu & Gheorghe-Daniel Voinea

Authors
  1. Florin Gîrbacia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cristian Postelnicu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gheorghe-Daniel Voinea
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Florin Gîrbacia .

Editor information

Editors and Affiliations

  1. Department of Computer Science, Robotics Research Lab, Technische Universität Kaiserslautern, Kaiserslautern, Germany

    Karsten Berns

  2. Department of Electrical and Computer Engineering, Electromobility Group, Technische Universität Kaiserslautern, Kaiserslautern, Germany

    Daniel Görges

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gîrbacia, F., Postelnicu, C., Voinea, GD. (2020). Towards Using Natural User Interfaces for Robotic Arm Manipulation. In: Berns, K., Görges, D. (eds) Advances in Service and Industrial Robotics. RAAD 2019. Advances in Intelligent Systems and Computing, vol 980. Springer, Cham. https://doi.org/10.1007/978-3-030-19648-6_22

Download citation

Publish with us

Policies and ethics

Search

Navigation