Abstract
We investigate whether mid-air tactile stimuli generated using ultrasonic arrays can be used as a haptic cursor for physical objects. We combined an ultrasonic array and an interactive haptic map into one setup. Evaluation with 15 participants showed that the method is efficient for guiding user hands to physical objects – miniatures of room equipment. The average error rate was 14.4 %, and the best participant achieved a 5.1 % error rate. Our in-depth analysis provided insights into issues of the method, like signal reflections and user-induced interference of problems with distinguishing physical objects that are too close.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alakhawand, N., Frier, W., Freud, K.M.A., Georgiou, O., Lepora, N.F.: Sensing ultrasonic mid-air haptics with a biomimetic tactile fingertip. In: Nisky, I., Hartcher-O’Brien, J., Wiertlewski, M., Smeets, J. (eds.) EuroHaptics 2020. LNCS, vol. 12272, pp. 362–370. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58147-3_40
Bensmaia, S.J., Leung, Y.Y., Hsiao, S.S., Johnson, K.O.: Vibratory adaptation of cutaneous mechanoreceptive afferents. J. Neurophysiol. 94(5), 3023–3036 (2005). https://doi.org/10.1152/jn.00002.2005
Brock, A.M., Truillet, P., Oriola, B., Picard, D., Jouffrais, C.: Interactivity improves usability of geographic maps for visually impaired people. Hum.-Comput. Interact. 30(2), 156–194 (2015). https://doi.org/10.1080/07370024.2014.924412
Dalecki, D., Child, S.Z., Raeman, C.H., Carstensen, E.L.: Tactile perception of ultrasound. J. Acoust. Soc. Am. 97(5), 3165–3170 (1995). https://doi.org/10.1121/1.411877
Hajas, D., Pittera, D., Nasce, A., Georgiou, O., Obrist, M.: Mid-air haptic rendering of 2D geometric shapes with a dynamic tactile pointer. IEEE Trans. Haptics 13(4), 806–817 (2020). https://doi.org/10.1109/TOH.2020.2966445
Holloway, L., Marriott, K., Butler, M.: Accessible maps for the blind: comparing 3D printed models with tactile graphics. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. p. 198. ACM (2018). https://doi.org/10.1145/3173574.3173772
Hoshi, T., Takahashi, M., Iwamoto, T., Shinoda, H.: Noncontact tactile display based on radiation pressure of airborne ultrasound. IEEE Trans. Haptics 3(3), 155–165 (2010). https://doi.org/10.1109/TOH.2010.4
Jingu, A., Kamigaki, T., Fujiwara, M., Makino, Y., Shinoda, H.: LipNotif: use of lips as a non-contact tactile notification interface based on ultrasonic tactile presentation. In: The 34th Annual ACM Symposium on User Interface Software and Technology, pp. 13–23 (2021). https://doi.org/10.1145/3472749.3474732
Juravle, G., Spence, C.: Juggling reveals a decisional component to tactile suppression. Exp. Brain Res. 213, 87–97 (2011). https://doi.org/10.1007/s00221-011-2780-2
Korres, G., Eid, M.: Haptogram: ultrasonic point-cloud tactile stimulation. IEEE Access 4, 7758–7769 (2016). https://doi.org/10.1109/ACCESS.2016.2608835
Macik, M., Ivanic, T., Treml, L.: Interactive modular tactile maps of rooms for older adults with vision impairments. In: Ardito, C., et al. (eds.) INTERACT 2021. LNCS, vol. 12932, pp. 321–330. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-85623-6_20
Marzo, A., Corkett, T., Drinkwater, B.W.: Ultraino: an open phased-array system for narrowband airborne ultrasound transmission. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 65(1), 102–111 (2017). https://doi.org/10.1109/TUFFC.2017.2769399
Paneva, V., Seinfeld, S., Kraiczi, M., Müller, J.: HaptiRead: reading braille as mid-air haptic information. In: Proceedings of the 2020 ACM Designing Interactive Systems Conference, pp. 13–20 (2020). https://doi.org/10.1145/3357236.3395515
Rakkolainen, I., Sand, A., Raisamo, R.: A survey of mid-air ultrasonic tactile feedback. In: 2019 IEEE International Symposium on Multimedia (ISM), pp. 94–944. IEEE (2019). https://doi.org/10.1109/ISM46123.2019.00022
Suzuki, S., Fujiwara, M., Makino, Y., Shinoda, H.: Midair hand guidance by an ultrasound virtual handrail. In: 2019 IEEE World Haptics Conference (WHC), pp. 271–276. IEEE (2019). https://doi.org/10.1109/WHC.2019.8816123
Suzuki, S., Inoue, S., Fujiwara, M., Makino, Y., Shinoda, H.: Autd3: Scalable airborne ultrasound tactile display. IEEE Trans. Haptics 14(4), 740–749 (2021). https://doi.org/10.1109/TOH.2021.3069976
Triesch, J., Von Der Malsburg, C.: Robotic gesture recognition by cue combination. In: Dassow, J., Kruse, R. (eds.) Informatik’98: Informatik zwischen Bild und Sprache 28. Jahrestagung der Gesellschaft für Informatik Magdeburg, 21–25 September 1998, pp. 223–232. Springer, Berlin, Heidelberg (1998). https://doi.org/10.1007/978-3-642-72283-7_22
Voudouris, D., Fiehler, K.: Enhancement and suppression of tactile signals during reaching. J. Exp. Psychol. Hum. Percept. Perform. 43(6), 1238 (2017). https://doi.org/10.1037/xhp0000373
Acknowledgments
This research has been supported by research the project RCI (reg. no. CZ.02.1.01/0.0/0.0/16_019/0000765) supported by EU.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Macík, M., Branig, M. (2023). Mid-air Haptic Cursor for Physical Objects. In: Abdelnour Nocera, J., Kristín Lárusdóttir, M., Petrie, H., Piccinno, A., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2023. INTERACT 2023. Lecture Notes in Computer Science, vol 14142. Springer, Cham. https://doi.org/10.1007/978-3-031-42280-5_35
Download citation
DOI: https://doi.org/10.1007/978-3-031-42280-5_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-42279-9
Online ISBN: 978-3-031-42280-5
eBook Packages: Computer ScienceComputer Science (R0)