Skip to main content

Preliminary Study on Real-Time Interactive Virtual Fixture Generation Method for Shared Teleoperation in Unstructured Environments

  • Conference paper
  • First Online:
Haptics: Science, Technology, and Applications (EuroHaptics 2018)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10894))

Abstract

We present a method for interactively generating virtual fixtures for shared teleoperation in unstructured remote environments. The proposed method allows a human operator to intuitively assign various types of virtual fixtures on-the-fly to provide virtual guidance forces helping the operator to accomplish a given task while minimizing the cognitive workload. The proposed method augments the visual feedback image from the slave’s robot video camera with automatically extracted geometric features (shapes, surfaces, etc.) computed from both depth and color video sensor attached next to the slave robot’s base. The human operator can select a feature on the computer screen which is then automatically associated with a virtual haptic fixture. The performance of the proposed method was evaluated with a peg-in-hole task and the experiment showed improvements in teleoperation performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Aarno, D., Ekvall, S., Kragic, D.: Adaptive virtual fixtures for machine-assisted teleoperation tasks. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation, ICRA 2005, pp. 1139–1144 (2005)

    Google Scholar 

  2. Abbott, J.J., Panadda, M., Allison, O., Marayong, P., Okamura, A.M.: Haptic virtual fixtures for robot-assisted manipulation. In: Robotics Research, pp. 49–64 (2007)

    Google Scholar 

  3. Bettini, A., Lang, S., Okamura, A., Hager, G.: Vision assisted control for manipulation using virtual fixtures: experiments at macro and micro scales. In: Proceedings of 2002 IEEE International Conference on Robotics and Automation, vol. 4, pp. 3354–3361 (2002)

    Google Scholar 

  4. Bowyer, S.A., Davies, B.L., Rodriguez, Y., Baena, F.: Active constraints/virtual fixtures: a survey. IEEE Trans. Rob. 30(1), 138–157 (2014)

    Article  Google Scholar 

  5. Farkhatdinov, I., Ryu, J.H.: Improving mobile robot bilateral teleoperation by introducing variable force feedback gain. In: 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5812–5817 (2010)

    Google Scholar 

  6. Farkhatdinov, I., Ryu, J.H., Poduraev, J.: A user study of command strategies for mobile robot teleoperation. Intel. Serv. Robot. 2(2), 95–104 (2009)

    Article  Google Scholar 

  7. Garrido-Jurado, S., noz Salinas, R.M., Madrid-Cuevas, F., Marín-Jiménez, M.: Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recogn. 47(6), 2280–2292 (2014)

    Article  Google Scholar 

  8. Hannaford, B., Ryu, J.H.: Time-domain passivity control of haptic interfaces. IEEE Trans. Robot. Autom. 18(1), 1–10 (2002)

    Article  Google Scholar 

  9. Jiang, Z., Liu, Y., Liu, H., Zou, J.: Flexible virtual fixture enhanced by vision and haptics for unstructured environment teleoperation. In: 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 2643–2648 (2013)

    Google Scholar 

  10. Li, M., Taylor, R.H.: Spatial motion constraints in medical robot using virtual fixtures generated by anatomy. In: 2004 IEEE International Conference on Robotics and Automation, Proceedings, ICRA 2004, vol. 2, pp. 1270–1275 (2004)

    Google Scholar 

  11. Lin, H.C., Mills, K., Kazanzides, P., Hager, G.D., Marayong, P., Okamura, A.M., Karam, R.: Portability and applicability of virtual fixtures across medical and manufacturing tasks. In: Proceedings 2006 IEEE International Conference on Robotics and Automation, ICRA 2006, pp. 225–230 (2006)

    Google Scholar 

  12. Li, M., Kapoor, A., Taylor, R.: A constrained optimization approach to virtual fixtures. In: IEEE/RSJ International Conference on Intelligent Robots and Systems 2015, pp. 1408–1413 (2015)

    Google Scholar 

  13. Quintero, C.P., Dehghan, M., Ramirez, O., Ang, M.H., Jagersand, M.: Flexible virtual fixture interface for path specification in tele-manipulation. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 5363–5368, May 2017

    Google Scholar 

  14. Rosenberg, L.: Virtual fixtures: perceptual tools for telerobotic manipulation. In: Proceedings of IEEE Virtual Reality Annual International Symposium. pp. 76–82 (1993)

    Google Scholar 

  15. Rosenberg, L.B.: The Use of Virtual Fixtures as Perceptual Overlays to Enhance Operator Performance in Remote Environments (1992)

    Google Scholar 

  16. Ryden, F., Chizeck, H.J.: Forbidden-region virtual fixtures from streaming point clouds: remotely touching and protecting a beating heart. In: IEEE International Conference on Intelligent Robots and Systems, pp. 3308–3313 (2012)

    Google Scholar 

  17. Selvaggio, M., Chen, F., Gao, B., Notomista, G., Trapani, F., Caldwell, D.: Vision based virtual fixture generation for teleoperated robotic manipulation. In: 2016 International Conference on Advanced Robotics and Mechatronics, pp. 190–195 (2016)

    Google Scholar 

  18. Selvaggio, M., Notomista, G., Chen, F., Gao, B., Trapani, F., Caldwell, D.: Enhancing bilateral teleoperation using camera-based online virtual fixtures generation. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1483–1488 (2016)

    Google Scholar 

Download references

Acknowledgements

This research is supported by the project “Toward the Next Generation of Robotic Humanitarian Assistance and Disaster Relief: Fundamental Enabling Technologies (10069072)” and by the project “Development of core teleoperation technologies for maintaining and repairing tasks in nuclear power plants” funded by the Ministry of Trade, Industry & Energy of S. Korea.

I. Farkhatdinov was partially supported by the UK EPSRC in the framework of the National Centre for Nuclear Robotics project (EP/R02572X/1).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vitalii Pruks .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pruks, V., Farkhatdinov, I., Ryu, JH. (2018). Preliminary Study on Real-Time Interactive Virtual Fixture Generation Method for Shared Teleoperation in Unstructured Environments. In: Prattichizzo, D., Shinoda, H., Tan, H., Ruffaldi, E., Frisoli, A. (eds) Haptics: Science, Technology, and Applications. EuroHaptics 2018. Lecture Notes in Computer Science(), vol 10894. Springer, Cham. https://doi.org/10.1007/978-3-319-93399-3_55

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-93399-3_55

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-93398-6

  • Online ISBN: 978-3-319-93399-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics