Skip to main content

Force-Torque Sensor Disturbance Observer Using Deep Learning

  • Conference paper
  • First Online:
Proceedings of the 2018 International Symposium on Experimental Robotics (ISER 2018)

Abstract

Robots executing force controlled tasks require accurate perception of the applied force in order to guarantee precision. However, dynamic motions generate non-contact forces due to the inertia. These non-contact forces can be regarded as disturbances to be removed such that only the forces generated by contacts with the environment remain. This paper presents an observer based on a recurrent neural network that estimates the non-contact forces measured by a force-torque sensor attached at the end-effector of a robotic arm. The approach is proven to also work with an external load attached to the robotic arm. The recurrent neural network observer uses signals from the joint encoders of the robotic arm and a low-cost inertial measurement unit to estimate the wrenches (i.e. forces and torques) generated due to gravity, inertia, centrifugal and Coriolis forces. The accuracy of the proposed observer is experimentally evaluated by comparing the measurements of the attached force-torque sensor to the observer’s non-contact forces estimation. Additionally, the pure contact force estimation is evaluated against an external force-torque sensor.

K.M. el Dine and J. Sanchez—These authors contributed equally to the work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    http://www.ati-ia.com/products/ft/ft_models.aspx?id=Gamma.

  2. 2.

    https://www.adafruit.com/product/1714.

  3. 3.

    https://www.shadowrobot.com/products/dexterous-hand/.

  4. 4.

    https://www.ati-ia.com/products/ft/ft_models.aspx?id=Mini45.

  5. 5.

    Note that for simplicity, when the subscripts are not indicated the quantities are assumed to be of the end-effector expressed on the robot frame.

References

  1. García, J.G., Robertsson, A., Ortega, J.G., Johansson, R.: Force and acceleration sensor fusion for compliant robot motion control. In: IEEE International Conference on Robotics and Automation, pp. 2709–2714, Barcelona, Spain (2005)

    Google Scholar 

  2. Kröger, T., Kubus, D., Wahl, F.: 6D force and acceleration sensor fusion for compliant manipulation control. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2626–2631, Beijing, China (2006)

    Google Scholar 

  3. Kubus, D., Wahl, F.M.: Scaling and eliminating non-contact forces and torques to improve bilateral teleoperation. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5133–5139, St. Louis, USA (2009)

    Google Scholar 

  4. Smith, A.C., Mobasser, F., Hashtrudi-Zaad, K.: Neural-network-based contact force observers for haptic applications. IEEE Trans. Robot. 22(6), 1163–1175 (2006)

    Article  Google Scholar 

  5. Kollmitz, M., Büscher, D., Schubert, T., Burgard, W.: Whole-body sensory concept for compliant mobile robots. In: IEEE International Conference on Robotics and Automation, Brisbane, Australia (2018). (To appear in)

    Google Scholar 

  6. Erickson, Z., Clegg, A., Yu, W., Turk, G., Liu, C.K., Kemp, C.C.: What does the person feel? learning to infer applied forces during robot-assisted dressing. In: IEEE International Conference on Robotics and Automation, pp. 6058–6065, Singapore (2017)

    Google Scholar 

  7. Karlsson, M., Robertsson, A., Johansson, R.: Detection and control of contact force transients in robotic manipulation without a force sensor. In: IEEE International Conference on Robotics and Automation, pp. 21–25, Brisbane, Australia (2018)

    Google Scholar 

  8. Graves, A., Mohamed, A.R., Hinton, G.: Speech recognition with deep recurrent neural networks. In: IEEE International Conference on Acoustics. Speech and Signal Processing, pp. 6645–6649, Vancouver, Canada (2013)

    Google Scholar 

Download references

Acknowledgements

Kamal Mohy El Dine works for the European project Robots to Re-Construction (Bots2ReC). His research leading to these results has received funding from the European Union’s Horizon 2020 research and innovation programmes under grant agreement No. 687593.

Jose Sanchez is sponsored by the French government research program Investissements d’Avenir through the RobotEx Equipment of Excellence (ANR-10-EQPX-44) and the IMobS3 Laboratory of Excellence (ANR-10-LABX-16-01), by the European Union through the program Regional competitiveness and employment 2007–2013 (ERDF - Auvergne region) and by the Auvergne region.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kamal Mohy el Dine .

Editor information

Editors and Affiliations

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (mp4 20267 KB)

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

el Dine, K.M., Sanchez, J., Corrales, J.A., Mezouar, Y., Fauroux, JC. (2020). Force-Torque Sensor Disturbance Observer Using Deep Learning. In: Xiao, J., Kröger, T., Khatib, O. (eds) Proceedings of the 2018 International Symposium on Experimental Robotics. ISER 2018. Springer Proceedings in Advanced Robotics, vol 11. Springer, Cham. https://doi.org/10.1007/978-3-030-33950-0_32

Download citation

Publish with us

Policies and ethics