Skip to main content

Advertisement

Log in

Human-centered design of a wearable kinesthetic haptic device for surgical teleoperation

  • Original Article
  • Published:
Artificial Life and Robotics Aims and scope Submit manuscript

Abstract

This paper describes the design and performance evaluation of a flexible wearable haptic device that aims to realize full kinesthetic haptic feedback for application in robot-assisted surgery (RAS). Contrary to the existing practice, where the haptic feedback and leader—follower control are implemented in the same driver device, which leads to control instabilities at times, the proposed haptic device enables to achieve a separation between the haptic loop and the leader—follower control. This separation is expected to circumvent control instability issues faced by traditional haptic teleoperation systems and, therefore, safely achieve a full kinesthetic haptic experience for RAS. The proposed device can provide 3-D kinesthetic feedback (flexion–extension, abduction–adduction, and along the finger axis) to the operator’s fingertip. An open-loop force control has been implemented and the device performance is evaluated by displaying force in the above-mentioned directions. The results confirmed the feasibility of the design and control scheme with a mean absolute error of around \(16\%\) for flexion, \(4\%\) for extension, \(9\%\) for abduction–adduction, and \(7\%\) along the finger axis direction. In the future, the device will be integrated with a surgical robot to evaluate its performance in experimental surgical teleoperation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Notes

  1. https://www.pololu.com/file/0J1487/pololu-micro-metal-gearmotors_rev-5-1.pdf

References

  1. Okamura AM (2004) Methods for haptic feedback in teleoperated robot-assisted surgery. Ind Robot Int J. https://doi.org/10.1108/01439910410566362

    Article  Google Scholar 

  2. Bowyer SA, Davies BL, Rodriguezy Baena F (2014) Active constraints/virtual fixtures: a survey. IEEE Trans Robot 30(1):138–157. https://doi.org/10.1109/TRO.2013.2283410

    Article  Google Scholar 

  3. Abdi E, Kulić D, Croft E (2020) Haptics in teleoperated medical interventions: force measurement, haptic interfaces and their influence on user’s performance. IEEE Trans Biomed Eng 67(12):3438–3451. https://doi.org/10.1109/TBME.2020.2987603

    Article  Google Scholar 

  4. Nisar S (2021) Human-in-the-loop-truly: A new approach to achieve haptic-enabled teleoperation in safety-critical robotic applications. In: Proceedings of the 39th annual conference of the robotics society of Japan (RSJ2021)

  5. Okamura AM (2009) Haptic feedback in robot-assisted minimally invasive surgery. Curr Opin Urol 19(1):102. https://doi.org/10.1097/MOU.0b013e32831a478c

    Article  Google Scholar 

  6. Wang D, Song M, Naqash A, Zheng Y, Xu W, Zhang Y (2018) Toward whole-hand kinesthetic feedback: A survey of force feedback gloves. IEEE Trans Haptics 12(2):189–204. https://doi.org/10.1109/TOH.2018.2879812

    Article  Google Scholar 

  7. Ma Z, Ben-Tzvi P (2015) Design and optimization of a five-finger haptic glove mechanism. J Mech Robot 7(4):041008. https://doi.org/10.1115/1.4029437

    Article  Google Scholar 

  8. Gu X, Zhang Y, Sun W, Bian Y, Zhou D, and Kristensson PO (2016) Dexmo: an inexpensive and lightweight mechanical exoskeleton for motion capture and force feedback in vr. In: Proceedings of the 2016 CHI conference on human factors in computing systems, pp 1991–1995. https://doi.org/10.1145/2858036.2858487

  9. Zubrycki I, Granosik G (2015) Novel haptic glove-based interface using jamming principle. In 2015 10th international workshop on robot motion and control (RoMoCo). IEEE, pp 46–51. https://doi.org/10.1109/RoMoCo.2015.7219712

  10. Bouzit M, Burdea G, Popescu G, Boian R (2002) The rutgers master ii-new design force-feedback glove. IEEE/ASME Trans Mechatron 7(2):256–263. https://doi.org/10.1109/TMECH.2002.1011262

    Article  Google Scholar 

  11. Michikawa R, Endo T, Matsuno F (2022) A multi-dof exoskeleton haptic device for the grasping of a compliant object adapting to a user’s motion using jamming transitions. IEEE Trans Robot. https://doi.org/10.1109/TRO.2022.3192979 (Accepted)

    Article  Google Scholar 

  12. Pacchierotti C, Sinclair S, Solazzi M, Frisoli A, Hayward V, Prattichizzo D (2017) Wearable haptic systems for the fingertip and the hand: taxonomy, review, and perspectives. IEEE Trans Haptics 10(4):580–600. https://doi.org/10.1109/TOH.2017.2689006

    Article  Google Scholar 

  13. Endo T, Kawasaki H, Mouri T, Ishigure Y, Shimomura H, Matsumura M, Koketsu K (2010) Five-fingered haptic interface robot: Hiro iii. IEEE Trans Haptics 4(1):14–27. https://doi.org/10.1109/WHC.2009.4810812

    Article  Google Scholar 

  14. Perret J, Parent Q, Giudicelli B (2017) Hglove: a wearable force-feedback device for the hand. In: 14th annual EuroVR conference

  15. Shabani F, Nisar S, Matsuno F (2021) Design of a highly-compatible wearable kinesthetic device for surgical teleoperation. In: 2021 IEEE world haptics conference (WHC), pp 589–589. https://doi.org/10.1109/WHC49131.2021.9517244

  16. Singh PK, Krishna CM (2014) Continuum arm robotic manipulator: a review. Univers J Mech Eng 2(6):193–198. https://doi.org/10.13189/ujme.2014.020603

    Article  Google Scholar 

  17. Zhong Y, Hu L, Xu Y (2020) Recent advances in design and actuation of continuum robots for medical applications. In: Actuators, vol. 9, no. 4. Multidisciplinary Digital Publishing Institute, p 142. https://doi.org/10.3390/act9040142

  18. Nisar S, Martinez MO, Endo T, Matsuno F, Okamura AM (2018) Effects of different hand-grounding locations on haptic performance with a wearable kinesthetic haptic device. IEEE Robot Autom Lett 4(2):351–358. https://doi.org/10.1109/LRA.2018.2890198

    Article  Google Scholar 

  19. Wilson R, Niemeyer G (2009) Motion control of impedance-type haptic devices. In: 2009 IEEE international conference on robotics and automation, pp 1092–1097. https://doi.org/10.1109/ROBOT.2009.5152839

  20. Enayati N, De Momi E, Ferrigno G (2016) Haptics in robot-assisted surgery: challenges and benefits. IEEE Rev Biomed Eng 9:49–65. https://doi.org/10.1109/RBME.2016.2538080

    Article  Google Scholar 

  21. Wang Y, Feng L, Andersson K (2021) A position-control based approach to haptic rendering of stiff objects. IEEE Trans Haptics 14(3):646–659. https://doi.org/10.1109/TOH.2020.3044682

    Article  Google Scholar 

  22. Cheng M, Zhu G, Zhang F, Tang W-L, Jianping S, Yang J-Q, Zhu L-Y (2020) A review of flexible force sensors for human health monitoring. J Adv Res 26:53–68. https://doi.org/10.1016/j.jare.2020.07.001

    Article  Google Scholar 

  23. Xu S, Vogt DM, Hsu W-H, Osborne J, Walsh T, Foster JR, Sullivan SK, Smith VC, Rousing AW, Goldfield EC et al (2019) Biocompatible soft fluidic strain and force sensors for wearable devices. Adv Func Mater 29(7):1807058. https://doi.org/10.1002/adfm.201807058

    Article  Google Scholar 

  24. Chin K, Hellebrekers T, Majidi C (2020) Machine learning for soft robotic sensing and control. Adv Intell Syst 2(6):1900171. https://doi.org/10.1002/aisy.201900171

    Article  Google Scholar 

  25. Kim D, Kim S-H, Kim T, Kang BB, Lee M, Park W, Ku S, Kim D, Kwon J, Lee H et al (2021) Review of machine learning methods in soft robotics. PLoS One 16(2):e0246102. https://doi.org/10.1371/journal.pone.0246102

    Article  Google Scholar 

Download references

Acknowledgements

The lead author is thankful to Scott Erickson, Belal A. Elsayed, Mahmoud Ghodrati, and Naser Faryad for their valuable discussion about the experimental results and proofreading the manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Farhad Shabani.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shabani, F., Nisar, S. & Matsuno, F. Human-centered design of a wearable kinesthetic haptic device for surgical teleoperation. Artif Life Robotics 28, 253–263 (2023). https://doi.org/10.1007/s10015-022-00818-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10015-022-00818-y

Keywords

Navigation