Skip to main content
SpringerLink
Log in
Book cover

Online Engineering & Internet of Things pp 681–688Cite as

Touching Is Believing - Adding Real Objects to Virtual Reality

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 22))

Abstract

This article presents the idea of adding real objects representations to Virtual Reality as a way to improve the immersive experience. To this end, a low-cost hand tracking device and an instrumented cube based on the use of inertial measurement units is presented. Some preliminary results that show the use of the hand tracker for the animation of a virtual hand model are shown. The fusion of inertial measures with a vision-based marker detector outputs will be performed with the help of a Kalman filter to provide smooth and bias corrected estimates of the object pose. The developed solutions offer the flexibility of interacting either with local or remote systems, as they have been designed as wireless Internet connected objects.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    HTC and Valve virtual reality systems: www.htcvalve.com.

  2. 2.

    Oculus virtual reality systems: www.oculus.com.

  3. 3.

    Samsung VR: http://www.samsung.com/global/galaxy/gear-vr/.

  4. 4.

    Microsoft Hololens: https://www.microsoft.com/microsoft-hololens/en-us.

  5. 5.

    Tactical Haptics Reactive Grip available at: http://tacticalhaptics.com/products/.

  6. 6.

    AxonVR HaptX Skeleton available at: http://axonvr.com/.

References

  1. Almeida, L., Patrão, B., Menezes, P., Dias, J.: Be the robot: human embodiment in teleoperation driving tasks. In: Ro-Man 2014: The 23rd IEEE International Symposium on Robot and Human Interactive Communication, Edinburgh (2014)

    Google Scholar 

  2. Chou, J.C.K.: Quaternion kinematics and dynamic differential equations. IEEE Trans. Robot. Autom. 8(1), 53–64 (1992)

    Article  Google Scholar 

  3. Cobos, S., Ferre, M., Ortego, J.: Efficient human hand kinematics for manipulation tasks. In: Direct, pp. 22–26 (2008)

    Google Scholar 

  4. Dominjon, L., Lécuyer, A., Burkhardt, J., Richard, P., Richir, S.: Influence of control/display ratio on the perception of mass of manipulated objects in virtual environments. In: IEEE Proceedings Virtual Reality, pp. 19–26 (2005)

    Google Scholar 

  5. Gustus, A., Stillfried, G., Visser, J., Jörntell, H., van der Smagt, P.: Human hand modelling: kinematics, dynamics, applications. Biol. Cybern. 106(11–12), 741–755 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  6. Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality, pp. 85–94 (1999)

    Google Scholar 

  7. Lécuyer, A., Coquillart, S., Kheddar, A., Richard, P., Coiffet, P.: Pseudo-haptic feedback: can isometric input devices simulate force feedback? In: Proceedings of the IEEE Virtual Reality Conference, pp. 83–90 (2000)

    Google Scholar 

  8. Pretto, A., Grisetti, G.: Calibration and performance evaluation of low-cost IMUs. In: 18th International Workshop on ADC Modelling and Testing (2014)

    Google Scholar 

  9. Sanchez, J.G., Patrão, B., Almeida, L., Perez, J., Menezes, P., Dias, J., Sanz, P.: Design and evaluation of a natural interface for remote operation of underwater robots. IEEE Comput. Graph. Appl. 11(99), 1 (2016)

    Google Scholar 

  10. Sanfilippo, F., Hatledal, L.I.: A fully-immersive hapto-audio-visual framework for remote touch, November 2015

    Google Scholar 

  11. Welch, G., Bishop, G.: SCAAT: incremental tracking with incomplete information. In: Computer Graphics and Interactive Techniques (SIGGRAPH), pp. 333–344 (1997)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, Institute of Systems and Robotics, University of Coimbra, Polo II, 3030-290, Coimbra, Portugal

    Paulo Menezes, Nuno Gouveia & Bruno Patrão

Authors
  1. Paulo Menezes
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nuno Gouveia
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bruno Patrão
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Paulo Menezes .

Editor information

Editors and Affiliations

  1. Carinthia University of Applied Sciences , Villach, Austria

    Michael E. Auer

  2. Carinthia University of Applied Sciences , Villach, Austria

    Danilo G. Zutin

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Cite this paper

Menezes, P., Gouveia, N., Patrão, B. (2018). Touching Is Believing - Adding Real Objects to Virtual Reality. In: Auer, M., Zutin, D. (eds) Online Engineering & Internet of Things. Lecture Notes in Networks and Systems, vol 22. Springer, Cham. https://doi.org/10.1007/978-3-319-64352-6_64

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-64352-6_64

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-64351-9

  • Online ISBN: 978-3-319-64352-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation