Abstract
In this paper, we introduce “HandyTool” a method (and an interface) for virtual object manipulation based on a metaphorical/structural mapping of various everyday tools to our hands and fingers. The basic idea is to virtually transform the hand/fingers into a proper tool (e.g. a fist becoming a hammer head) and gesturally apply it (e.g. hammer in to insert) to and manipulate the target object (e.g. a nail) directly. The main intended objective of HandyTool is to enhance the tool usage experience by one (or one’s body part) becoming the tool itself and thereby also possibly improving the task performance. A usability experiment was carried out to assess the projected merits, comparing HandyTool to the case of the as-is emulation of the tool usage (i.e. the tracked hand/finger controlling the tool to apply it to the target object) and to the case of using the controller. Our experiment was not able to show the clear and full potential of HandyTool because of the current performance limitation of the hand/fingers tracking sensor and due to the simplicity in the structural mapping between the tool and hand/fingers. The structural metaphor itself was still shown to be helpful when the controller was used (i.e. stable sensing).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Argelaguet, F., Andujar, C.: A survey of 3D object selection techniques for virtual environments. Comput. Graph. 37(3), 121–136 (2013)
Bowman, D., Kruijff, E., LaViola Jr., J.J., Poupyrev, I.P.: 3D User Interfaces: Theory and Practice, CourseSmart eTextbook. Addison-Wesley, Boston (2004)
Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Advances in Psychology, North-Holland, vol. 52, pp. 139–183 (1988)
HTC VIVE. https://www.vive.com/us/product/vive-virtual-reality-system/
Kennedy, R.S., Lane, N.E., Berbaum, K.S., Lilienthal, M.G.: Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int. J. Aviat. Psychol. 3(3), 203–220 (1993)
LeapMotion. https://www.leapmotion.com/
Mendes, D., Caputo, F. M., Giachetti, A., Ferreira, A., Jorge, J.: A survey on 3D virtual object manipulation: from the desktop to immersive virtual environments. In: Computer Graphics Forum. Wiley Online Library (2018)
Mendes, D., Fonseca, F., Araujo, B., Ferreira, A., Jorge, J.: Mid-air interactions above stereoscopic interactive tables. In: 3D User Interfaces (3DUI), pp. 3–10 (2014)
Microsoft. Kinect Sensor. https://msdn.microsoft.com/ko-kr/library/hh438998.aspx
Oculus. Oculus Rift. https://www.oculus.com/rift/oui-csl-rift-games=mages-tale
Poupyrev, I., Billinghurst, M., Weghorst, S., Ichikawa, T.: The go-go interaction technique: non-linear mapping for direct manipulation in VR. In: Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology, pp. 79–80 (1996)
Quam, D.L.: Gesture recognition with a dataglove. In: Aerospace and Electronics Conference, pp. 755–760 (1990)
Rekimoto, J.: Gesturewrist and gesturepad: unobtrusive wearable interaction devices. In: Proceedings of Fifth International Symposium on Wearable Computers, pp. 21–27 (2001)
Sony. PlayStation VR. https://www.vive.com/us/product/vive-virtual-reality-system/
Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments: a presence questionnaire. Presence 7(3), 225–240 (1998)
Acknowledgments
This work was partially supported by the Global Frontier R&D Program on <Human-centered Interaction for Coexistence> funded by the National Research Foundation of Korea grant funded by the Korean Government (MEST) (NRF-2015M3A6A3076490), and by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (NRF-2017M3C1B6070980).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Seol, E., Kim, G.J. (2019). HandyTool: Object Manipulation Through Metaphorical Hand/Fingers-to-Tool Mapping. In: Stephanidis, C. (eds) HCI International 2019 - Posters. HCII 2019. Communications in Computer and Information Science, vol 1033. Springer, Cham. https://doi.org/10.1007/978-3-030-23528-4_58
Download citation
DOI: https://doi.org/10.1007/978-3-030-23528-4_58
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-23527-7
Online ISBN: 978-3-030-23528-4
eBook Packages: Computer ScienceComputer Science (R0)