Skip to main content

Advertisement

SpringerLink
Log in

Simultaneous remote haptic collaboration for assembling tasks

  • Regular paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Stand-alone virtual environments (VEs) using haptic devices have proved useful for assembly/disassembly simulation of mechanical components. Nowadays, collaborative haptic virtual environments (CHVEs) are also emerging. A new peer-to-peer collaborative haptic assembly simulator (CHAS) has been developed whereby two users can simultaneously carry out assembly tasks using haptic devices. Two major challenges have been addressed: virtual scene synchronization (consistency) and the provision of a reliable and effective haptic feedback. A consistency-maintenance scheme has been designed to solve the challenge of achieving consistency. Results show that consistency is guaranteed. Furthermore, a force-smoothing algorithm has been developed which is shown to improve the quality of force feedback under adverse network conditions. A range of laboratory experiments and several real trials between Labein (Spain) and Queen’s University Belfast (Northern Ireland) have verified that CHAS can provide an adequate haptic interaction when both users perform remote assemblies (assembly of one user’s object with an object grasped by the other user). Moreover, when collisions between grasped objects occur (dependent collisions), the haptic feedback usually provides satisfactory haptic perception. Based on a qualitative study, it is shown that the haptic feedback obtained during remote assemblies with dependent collisions can continue to improve the sense of co-presence between users with regard to only visual feedback.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Savall, J., Borro, D., Gil, J.J., Matey, L.: Description of a haptic system for virtual maintainability in aeronautics. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2887–2892. Laussane, Switzerland (2002)

  2. Iglesias, R., Carrillo, A., Casado, S., Gutiérrez, T., Barbero, J.I.: Virtual assembly simulation in a distributed haptic virtual environment. In: Proceedings of the International conference on Advanced Design and Manufacture, Harbin, China, pp. 418–423 (2006)

  3. Gutierrez, M., Ott, R., Thalmann, D., Vexo, F.: Mediators: virtual haptic interfaces for tele-operated robots. In: IEEE International Workshop on Robot and Human Interactive Communication (ROMAN 2004), pp. 515–520 (2004)

  4. Zhou, J., Shen, X., Georganas, N.D.: Haptic tele-surgery simulation. In: Proceedings of the 3rd IEEE International Workshop on Haptic, Audio and Visual Environments and Their Applications (HAVE 2004), pp. 99–104 (2004)

  5. Feygin, D., Keehner, M., Tendick, R.: Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill. In: Proceedings of Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 40–47 (2002)

  6. Wang, D., Ni, L., Rossi, M., Tuer, K.: Implementation issues for bilateral tele-mentoring applications. In: IEEE International Workshop on Haptic, Audio and Visual Environments and Their Applications (HAVE 2004), pp. 75–79 (2004)

  7. Marsh J., Glencross M., Pettifer S. and Hubbold R. (2006). A network architecture supporting consistent rich behavior in collaborative interactive applications. IEEE Trans. vis. comput. graph. 12(3): 405–416

    Article  Google Scholar 

  8. Iglesias, R., Casado, S., Gutiérrez, T., García-Alonso, A., Meng, K., Yu, W., Marshall, A.: A peer-to-peer architecture for collaborative haptic assembly. In: Proceedings of the 10th IEEE International Symposium on Distributed Simulation and Real Time Applications, pp. 25–34 (2006)

  9. Gunn, C.: Collaborative virtual sculpting with haptic feedback. Virtual Reality, Vol. 10, pp. 73–83. Springer, Berlin (2006)

  10. Sallnäs E.-L. (2000). Supporting Collaboration in Distributed Environments by Haptic Force Feedback. ACM Trans. Comput. Human Interact. (ToCHI) 7(4): 461–476

    Article  Google Scholar 

  11. Shen, X., Zhou, J., El Saddik, A., Georganas, N.D.: Architecture and evaluation of tele-haptic environments. In: Proceedings of the 8th IEEE International Symposium on Distributed Simulation and Real Time Applications, pp. 53–60 (2004)

  12. Gottschalk, S., Lin, M.C., Manocha, D.: OBBTree: A hierarchical structure for rapid interference detection. In: Proceedings of the ACM SIGGRAPH’96—Computer Graphics, pp. 171–180 (1996)

  13. Barbero, J.I., Gutiérrez, T., Alvarez, A., Carrillo, A.R.: Assembly simulation tools: tolerance analysis and haptic virtual environment. EAEC European Automotive Congress, Barcelona, 1999

  14. Buttolo P., Oboe R. and Hannaford B. (1997). Architectures for shared haptic virtual environments. Comput. Graph. 21: 421–429

    Article  Google Scholar 

  15. Matsumoto, S., Fukuda, I., Morino, H., Hikichi, K., Sezaki, K., Yasuda, Y.: The influences of network issues on haptic collaboration in shared virtual environments, Fifth Phantom Users’ Group Workshop, 2000

  16. Goncharenko, I., Svinin, M., Matsumoto, S., Masui, Y., Kanou, Y., Hosoe, S.: Cooperative Control with Haptic Visualization in Shared Virtual Environments. In: Proceedings of the Eighth International Conference on Information Visualization, Washington, USA, pp. 533–538 (2004)

  17. Fukuda, I., Matsumoto, S., Iijima, M., Hikichi, K., Morino H., Sezaki, K., Yasuda, Y.: A robust system for haptic collaboration over the network. In: Touch in Virtual Environments: Haptics and the design of interactive system, pp. 137–157. Prentice-Hall, Englewood Cliffs (2002)

  18. Hespanha J.P., McLaughlin M.L. and Sukhatme G.S. (2001). Haptic collaboration over the Internet. In: McLaughlin, M.L., Hespanha, J.P., and Sukhatme, G.S. (eds) Touch in virtual environments., IMSC Series in Multimedia, pp. Prentice-Hall, New York

    Google Scholar 

  19. Souayed, R.T., Gaiti, D., Yu, W., Dodds, G., Marshall, A.: Experimental study of haptic interaction in distributed virtual environments. In: Proceedings of EuroHaptics, pp. 260–266. Springer, Munich (2004)

  20. Kim J., Kim H., Manivannan M., Srinivasan M.A., Jordan J., Mortensen J., Oliveira M. and Slater M. (2004). Transatlantic touch: a study of haptic collaboration over long distance. Presence Teleoper Virtual Environ. 13(3): 328–337

    Article  Google Scholar 

  21. Cheong, J., Niculescu, S., Annaswamy, A., Srinivasan, M.A.: Motion synchronization in virtual environments with shared haptics and large time delays. In: Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Pisa, Italy, pp. 277–282 (2005)

  22. Roberts, D., Wolff, R.: Controlling consistency within collaborative virtual environments. In: Proceedings of Eighth IEEE International Symposium on Distributed Simulation and Real-Time Applications, Budapest, Hungary, pp. 46–52 (2004)

  23. Iglesias, R., Casado, S., Gutiérrez, T., Carrillo, A., Barbero, J.I., García-Alonso, A.: Analysing different architectures of a distributed environment for assembly simulation. In: Proceedings of the International Conference Virtual Concept, Biarritz, France, pp. 99 (2005)

  24. Hamza-Lup, F.G., Hughes, C.E., Rolland, J.P.: Distributed consistency maintenance scheme for interactive mixed reality environments. In: Proceedings of the International Conference on Cybernetics and Information Technologies, Systems and Applications, Orlando, FL, USA, pp. 7–12 (2004)

  25. Delaney D., Ward T. and McLoone S. (2006). On consistency and network latency in distributed interactive applications: a survey—Part 1. Presence Teleoper Virtual Environ. 15(2): 218–234

    Article  Google Scholar 

  26. Macedonia M.R. and Zyda M.J. (1997). A taxonomy for networked virtual environments. IEEE Multimed. 4(1): 48–56

    Article  Google Scholar 

  27. Salisbury J.K., Conti F. and Barbagli F. (2004). Haptic rendering: introductory concepts. IEEE Comput. Graph. Appl. 24: 24–32

    Article  Google Scholar 

  28. Massie, T.H., Salisbury, J.K.: The PHANTOM haptic interface: a device for probing virtual objects. In: Proceedings of the Winter Annual Meeting, Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Chicago, IL, 1994

  29. Ruspini D.C. and Khatib O. (2001). Haptic display for human interaction with virtual dynamic environments. Robot. Syst. 18: 769–783

    Article  MATH  Google Scholar 

  30. Basdogan C., De S., Kim J., Muniyandi M., Kim H. and Srinivasan M.A. (2004). Haptics in minimally invasive surgical simulation and training. IEEE Comput. Graph. Appl. 24: 56–64

    Article  Google Scholar 

  31. McNeely, W.A., Puterbaugh, K.D., Troy, J.J.: Six degree-of-freedom haptic rendering using voxel sampling. In: Proceedings of the ACM SIGGRAPH—Computer Graphics, pp. 401–408 (1999)

  32. Burdea, G.: Haptics issues in virtual environments. In: Proceedings of Computer Graphics International, Piscataway, USA, pp. 295–302 (2000)

  33. Otaduy, M.A., Jain, N., Sud, A., Lin, M.C.: Haptic display of interaction between textured models. In: Proceedings of the IEEE Visualization Conference, pp. 297–304 (2004)

  34. Cavusoglu, M.C., Tendick, F.: Multirate simulation for high fidelity haptic interaction with deformable objects in virtual environments. In: Proceedings of the IEEE International Conference on Robotics and Automation, San Francisco, USA, pp. 2458–2465 (2000)

  35. Barbagli F., Prattichizzo D. and Salisbury K. (2005). A multirate approach to haptic interaction with deformable objects single and multipoint contacts. Int. J. Robot. 24(9): 703–715

    Article  Google Scholar 

  36. Constantinescu, D., Salcudean, S.E., Croft, E.A.: Haptic rendering of rigid body collisions. In: Proceedings of the 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Chicago, USA, pp. 1–6 (2004)

  37. Allison, R.S., Zacher, J.E., Wang, D., Shu, J.: Effects of network delay on a collaborative motor task with telehaptic and televisual feedback. In: Proceedings of the 2004 ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry, Singapore, pp. 375–381 (2004)

  38. Jay, C., Hubbold, R.: Delayed visual and haptic feedback in a reciprocal tapping task. In: Proceedings of the Eurohaptics Conference, 2005 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics 2005. First Joint March 2005, 655–656

  39. Wilson, J.P., Kline-Schoder, R.J., Kenton, M.A., Hogan, N.: Algorithms for network-based force feedback. Forth Phantom Users’ Group Workshop, 1999

  40. Jeffay, K., Hudson, T., Parris, M.: Beyond audio and video: multimedia networking support for distributed, immersive virtual environments. In: Proceedings of the 27th EUROMICRO Conference, Warsaw, Poland, pp. 300–307 (2001)

  41. Belghit, I., Hennion, B., Guerraz, A.: Predictive algorithms for distant touching. In: Proceedings Eurohaptics, pp. 61–65 (2002)

  42. Postel, J.: User Datagram Protocol. RFC 768, 1980

  43. Iglesias, R.: Collaborative haptic environment for assembly operations. Ph.D. Thesis, Department of Intelligence artificial, University of the Basque Country, Spain, 2006

  44. ZTI Company. NetDisturb. http://www.zti-telecom.com/pages/main-ip.htm

  45. SensAble Technologies, Inc. http://www.sensable.com/

Download references

Author information

Authors and Affiliations

  1. Labein Tecnalia, Edificio 700 C/ Geldo, 48160, Derio, Bizkaia, Spain

    Rosa Iglesias, Sara Casado & Teresa Gutiérrez

  2. University of the Basque Country, P. Manuel de Lardizábal, 1, 20018, Donostia-San Sebastián, Spain

    Alejandro García-Alonso

  3. School of Electrical and Electronic Engineering, Queen’s University Belfast, University Road, BT9 5AH, Belfast, UK

    Wai Yu & Alan Marshall

Authors
  1. Rosa Iglesias
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sara Casado
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Teresa Gutiérrez
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alejandro García-Alonso
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wai Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Alan Marshall
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rosa Iglesias.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Iglesias, R., Casado, S., Gutiérrez, T. et al. Simultaneous remote haptic collaboration for assembling tasks. Multimedia Systems 13, 263–274 (2008). https://doi.org/10.1007/s00530-007-0108-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-007-0108-7

Keywords

Search

Navigation