Skip to main content

Upper Limbs Motion Tracking for Collaborative Robotic Applications

  • Conference paper
  • First Online:
Human Interaction, Emerging Technologies and Future Applications III (IHIET 2020)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1253))

Abstract

In the perspective of Industry 4.0, the contemporary presence of workers and robots in the same workspace requires the development of human motion prediction algorithms for a safe and efficient interaction. In this context, the purpose of the present study was to perform an operation of sensor fusion, by creating a collection of spatial and inertial variables of human upper limbs kinematics of typical industrial movements. Spatial and inertial data of ten healthy young subjects performing three pick and place gestures at different heights were measured with a stereophotogrammetric system and Inertial Measurement Units, respectively. Elbow and shoulder angles estimated from both instruments according to a multibody approach showed very similar trends. Moreover, two variables of the database were identified as distinctive features able to differentiate among the three gestures of pick and place.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bauer, A., Wollherr, D., Buss, M.: Human-robot collaboration: a survey. Int. J. Humanoid Robot. 5, 47–66 (2008)

    Article  Google Scholar 

  2. Ajoudani, A., Zanchettin, A.M., Ivaldi, S., Albu-Schäffer, A., Kosuge, K., Khatib, O.: Progress and prospects of the human–robot collaboration. Auton. Robots 42(5), 957–975 (2018)

    Article  Google Scholar 

  3. Mauro, S., Pastorelli, S., Scimmi, L.S.: Collision avoidance algorithm for collaborative robotics. Int. J. Autom. Technol. 11, 481–489 (2017)

    Article  Google Scholar 

  4. Lasota, P.A., Fong, T., Shah, J.A.: A survey of methods for safe human-robot interaction. Found. Trends Robot. 5, 261–349 (2017)

    Article  Google Scholar 

  5. Melchiorre, M., Scimmi, L.S., Mauro, S., Pastorelli, S.: Influence of human limb motion speed in a collaborative hand-over task. In: ICINCO 2018 – Proceedings of 15th International Conference on Informatics in Control, Automation and Robotics, vol. 2, pp. 349–356 (2018)

    Google Scholar 

  6. Perez-D’Arpino, C., Shah, J.A.: Fast target prediction of human reaching motion for cooperative human-robot manipulation tasks using time series classification. In: Proceedings - IEEE International Conference on Robotics and Automation, June 2015, pp. 6175–6182 (2015)

    Google Scholar 

  7. Pereira, A., Althoff, M.: Overapproximative arm occupancy prediction for human-robot co-existence built from archetypal movements. In: IEEE International Conference on Intelligent Robots and Systems, November 2016, pp. 1394–1401 (2016)

    Google Scholar 

  8. Wang, Y., Ye, X., Yang, Y., Zhang, W.: Collision-free trajectory planning in human-robot interaction through hand movement prediction from vision. In: IEEE-RAS International Conference on Humanoid Robots, pp. 305–310 (2017)

    Google Scholar 

  9. Mainprice, J., Berenson, D.: Human-robot collaborative manipulation planning using early prediction of human motion. In: IEEE International Conference on Intelligent Robots and Systems, pp. 299–306 (2013)

    Google Scholar 

  10. Ghosh, P., Song, J., Aksan, E., Hilliges, O.: Learning human motion models for long-term predictions. In: Proceedings - 2017 International Conference on 3D Vision, 3DV 2017, pp. 458–466 (2018)

    Google Scholar 

  11. Butepage, J., Kjellstrom, H., Kragic, D.: Anticipating many futures: online human motion prediction and generation for human-robot interaction. In: Proceedings - IEEE International Conference on Robotics and Automation, pp. 4563–4570 (2018)

    Google Scholar 

  12. Ionescu, C., Papava, D., Olaru, V., Sminchisescu, C.: Human3.6M: large scale datasets and predictive methods for 3D human sensing in natural environments. IEEE Trans. Pattern Anal. Mach. Intell. 36, 1325–1339 (2014)

    Article  Google Scholar 

  13. Xia, S., Wang, C., Chai, J., Hodgins, J.: Realtime style transfer for unlabeled heterogeneous human motion. ACM Trans. Graph. 34, 1–10 (2015)

    Article  Google Scholar 

  14. Müller, M., Röder, T., Clausen, M., Eberhardt, B., Krüger, B., Weber, A.: Documentation Mocap database HDM05. Technical report (2007)

    Google Scholar 

  15. Holden, D., Saito, J., Komura, T.: A deep learning framework for character motion synthesis and editing. ACM Trans. Graph. 35, 1–11 (2016)

    Article  Google Scholar 

  16. Ofli, F., Chaudhry, R., et al.: Berkeley MHAD: a comprehensive multimodal human action database. In: Proceedings of IEEE Workshop on Applications of Computer Vision, pp. 53–60 (2013)

    Google Scholar 

  17. De La Torre, F., Hodgins, J., Bargteil, A.W., Martin, X., Macey, J.C., Collado, A., Beltran, P.: Guide to the Carnegie Mellon University Multimodal Activity (CMU-MMAC) Database. Robotics, 19 (2008)

    Google Scholar 

  18. De Leonardis, G., Rosati, S., Balestra, G., Agostini, V., Panero, E., Gastaldi, L., Knaflitz, M.: Human Activity Recognition by Wearable Sensors: comparison of different classifiers for real-time applications. In: MeMeA 2018 - 2018 IEEE International Symposium on Medical Measurement and Applications, Proceedings, pp. 1–6 (2018)

    Google Scholar 

  19. Digo, E., Pierro, G., Pastorelli, S., Gastaldi, L.: Tilt-twist method using inertial sensors to assess spinal posture during gait. In: International Conference on Robotics in Alpe-Adria Danube Region, pp. 384–392. Spinger, Cham (2019)

    Google Scholar 

  20. Rab, G., Petuskey, K., Bagley, A.: A method for determination of upper extremity kinematics. Gait Posture. 15, 113–119 (2002)

    Article  Google Scholar 

  21. Wu, G., Van Der Helm, F.C.T., Veeger, H.E.J., Makhsous, M., Van Roy, P., Anglin, C., Nagels, J., Karduna, A.R., McQuade, K., Wang, X., Werner, F.W., Buchholz, B.: ISB recommendation on definitions of joint coordinate systems of various joints for the reporting of human joint motion - Part II: shoulder, elbow, wrist and hand. J. Biomech. 38, 981–992 (2005)

    Article  Google Scholar 

  22. Peppoloni, L., Filippeschi, A., Ruffaldi, E., Avizzano, C.A.: A novel 7 degrees of freedom model for upper limb kinematic reconstruction based on wearable sensors. In: SISY 2013 - IEEE 11th International Symposium on Intelligent Systems and Informatics, Proceedings, pp. 105–110 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Elisa Digo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Digo, E., Antonelli, M., Pastorelli, S., Gastaldi, L. (2021). Upper Limbs Motion Tracking for Collaborative Robotic Applications. In: Ahram, T., Taiar, R., Langlois, K., Choplin, A. (eds) Human Interaction, Emerging Technologies and Future Applications III. IHIET 2020. Advances in Intelligent Systems and Computing, vol 1253. Springer, Cham. https://doi.org/10.1007/978-3-030-55307-4_59

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-55307-4_59

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-55306-7

  • Online ISBN: 978-3-030-55307-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics