Skip to main content
SpringerLink
Log in

Assignment of a Vibration to a Graphical Object Induced by Resonant Frequency

  • Conference paper
  • First Online:
Human-Computer Interaction – INTERACT 2023 (INTERACT 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14142))

Included in the following conference series:

Abstract

This work aims to provide tactile feedback when touching elements on everyday surfaces using their resonant frequencies. We used a remote speaker to bring a thin wooden surface into vibration for providing haptic feedback when a small graphical fly glued on the board was touched. Participants assigned the vibration to the fly instead of the board it was glued on. We systematically explored when that assignment illusion works best. The results indicate that additional sound, as well as vibration, lasting as long as the touch, are essential factors for having an assignment of the haptic feedback to the touched graphical object. With this approach, we contribute to ubiquitous and calm computing by showing that resonant frequency can provide vibrotactile feedback for images on thin everyday surfaces using only a minimum of hardware.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. AES standard method for digital audio engineering - measurement of digital audio equipment (1991). https://www.aes.org/publications/standards/search.cfm?docID=21. Accessed 25 Jan 2023

  2. Bau, O., Poupyrev, I., Israr, A., Harrison, C.: Teslatouch: electrovibration for touch surfaces. In: UIST 2010. Association for Computing Machinery, New York (2010). https://doi.org/10.1145/1866029.1866074

  3. Berger, C.C., Gonzalez-Franco, M.: Expanding the sense of touch outside the body. In: SAP 2018. Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3225153.3225172

  4. Bradley, J.V.: Complete counterbalancing of immediate sequential effects in a Latin square design. J. Am. Stat. Assoc. 53(282), 525–528 (1958)

    Article  MATH  Google Scholar 

  5. Brewster, S., Chohan, F., Brown, L.: Tactile feedback for mobile interactions. In: CHI 2007. Association for Computing Machinery, New York (2007). https://doi.org/10.1145/1240624.1240649

  6. Burtt, H.E.: Tactual illusions of movement. J. Exp. Psychol. 2, 371–385 (1917). https://doi.org/10.1037/h0074614

    Article  Google Scholar 

  7. v. Békésy, G.: Funneling in the nervous system and its role in loudness and sensation intensity on the skin. J. Acoust. Soc. Am. 30(5), 399–412 (1958). https://doi.org/10.1121/1.1909626

  8. Card, S., Moran, T., Newell, A.: The model human processor - an engineering model of human performance. In: Handbook of Perception and Human Performance, vol. 2, no. 45–1, pp. 1–35 (1986)

    Google Scholar 

  9. Cho, Y., Bianchi, A., Marquardt, N., Bianchi-Berthouze, N.: Realpen: providing realism in handwriting tasks on touch surfaces using auditory-tactile feedback. In: Proceedings of the 29th Annual Symposium on User Interface Software and Technology, UIST 2016, pp. 195–205. Association for Computing Machinery, New York (2016). https://doi.org/10.1145/2984511.2984550

  10. Elkin, L.A., Kay, M., Higgins, J.J., Wobbrock, J.O.: An aligned rank transform procedure for multifactor contrast tests. In: The 34th Annual ACM Symposium on User Interface Software and Technology, UIST 2021, pp. 754–768. Association for Computing Machinery, New York (2021). https://doi.org/10.1145/3472749.3474784

  11. Ernst, M.: Putting together the puzzle of multisensory perception. In: University of Glasgow: Seminar Series in Psychology (2006)

    Google Scholar 

  12. Etzi, R., Ferrise, F., Bordegoni, M., Zampini, M., Gallace, A.: The effect of visual and auditory information on the perception of pleasantness and roughness of virtual surfaces. Multisensory Res. 31(6), 501–522 (2018)

    Article  Google Scholar 

  13. Geldard, F.A., Sherrick, C.E.: The cutaneous “rabbit’’: a perceptual illusion. Science 178(4057), 178–179 (1972)

    Article  Google Scholar 

  14. Gongora, D., Peiris, R.L., Minamizawa, K.: Towards intermanual apparent motion of thermal pulses. In: Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017, pp. 143–145. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3131785.3131814

  15. Gyeltshen, S.: High pass filter designation and it report (2012)

    Google Scholar 

  16. Heo, S., Lee, J., Wigdor, D.: Pseudobend: producing haptic illusions of stretching, bending, and twisting using grain vibrations. In: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, UIST 2019, pp. 803–813. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3332165.3347941

  17. Ishii, H., Lakatos, D., Bonanni, L., Labrune, J.B.: Radical atoms: beyond tangible bits, toward transformable materials. Interactions 19(1), 38–51 (2012). https://doi.org/10.1145/2065327.2065337

  18. Israr, A., Poupyrev, I.: Tactile Brush: Drawing on Skin with a Tactile Grid Display, pp. 2019–2028. Association for Computing Machinery, New York (2011). https://doi.org/10.1145/1978942.1979235

  19. Kaaresoja, T., Brewster, S., Lantz, V.: Towards the temporally perfect virtual button: touch-feedback simultaneity and perceived quality in mobile touchscreen press interactions. ACM Trans. Appl. Percept. 11(2) (2014). https://doi.org/10.1145/2611387

  20. Katzakis, N., et al.: Stylo and handifact: modulating haptic perception through visualizations for posture training in augmented reality. In: Proceedings of the 5th Symposium on Spatial User Interaction, SUI 2017, pp. 58–67. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3131277.3132181

  21. Kim, J., Oh, S., Park, C., Choi, S.: Body-Penetrating Tactile Phantom Sensations, pp. 1–13. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3313831.3376619

  22. Kim, S., Lee, G.: Haptic feedback design for a virtual button along force-displacement curves. In: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST 2013, pp. 91–96. Association for Computing Machinery, New York (2013). https://doi.org/10.1145/2501988.2502041

  23. Kim, Y., Lee, J., Kim, G.J.: Extending “out of the body’’ tactile phantom sensations to 2D and applying it to mobile interaction. Personal Ubiquitous Comput. 19(8), 1295–1311 (2015). https://doi.org/10.1007/s00779-015-0894-4

    Article  Google Scholar 

  24. Lago, N.P., Kon, F.: The quest for low latency. In: ICMC (2004)

    Google Scholar 

  25. Lai, C.H., Niinimäki, M., Tahiroglu, K., Kildal, J., Ahmaniemi, T.: Perceived physicality in audio-enhanced force input. In: Proceedings of the 13th International Conference on Multimodal Interfaces, ICMI 2011, pp. 287–294. Association for Computing Machinery, New York (2011). https://doi.org/10.1145/2070481.2070533

  26. Lee, J., Kim, Y., Jounghyun Kim, G.: Rich pinch: perception of object movement with tactile illusion. IEEE Trans. Haptics 9(1), 80–89 (2016). https://doi.org/10.1109/TOH.2015.2475271

    Article  Google Scholar 

  27. Lee, J., Kim, Y., Kim, G.: Funneling and Saltation Effects for Tactile Interaction with Virtual Objects, pp. 3141–3148. Association for Computing Machinery, New York (2012). https://doi.org/10.1145/2207676.2208729

  28. Longo, R., Delaunay, T., Laux, D., El Mouridi, M., Arnould, O., Le Clezio, E.: Wood elastic characterization from a single sample by resonant ultrasound spectroscopy. Ultrasonics 52(8), 971–974 (2012)

    Article  Google Scholar 

  29. Nunez, C.M., Williams, S.R., Okamura, A.M., Culbertson, H.: Understanding continuous and pleasant linear sensations on the forearm from a sequential discrete lateral skin-slip haptic device. IEEE Trans. Haptics 12(4), 414–427 (2019). https://doi.org/10.1109/TOH.2019.2941190

    Article  Google Scholar 

  30. Patel, P., Ray, R.K., Manivannan, M.: Power law based “out of body’’ tactile funneling for mobile haptics. IEEE Trans. Haptics 12(3), 307–318 (2019). https://doi.org/10.1109/TOH.2019.2933822

    Article  Google Scholar 

  31. Peck, T.C., Gonzalez-Franco, M.: Avatar embodiment. A standardized questionnaire. Front. Virtual Reality 1, 44 (2021)

    Google Scholar 

  32. Peng, W., Peiris, R.L., Minamizawa, K.: Exploring of simulating passing through feeling on the wrist: using thermal feedback. In: Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017, pp. 187–188. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3131785.3131819

  33. Pinhanez, C.: The everywhere displays projector: a device to create ubiquitous graphical interfaces. In: Abowd, G.D., Brumitt, B., Shafer, S. (eds.) UbiComp 2001. LNCS, vol. 2201, pp. 315–331. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-45427-6_27

    Chapter  MATH  Google Scholar 

  34. Pittera, D., Ablart, D., Obrist, M.: Creating an illusion of movement between the hands using mid-air touch. IEEE Trans. Haptics 12(4), 615–623 (2019). https://doi.org/10.1109/TOH.2019.2897303

    Article  Google Scholar 

  35. Pittera, D., Obrist, M., Israr, A.: Hand-to-hand: an intermanual illusion of movement. In: Proceedings of the 19th ACM International Conference on Multimodal Interaction, ICMI 2017, pp. 73–81. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3136755.3136777

  36. Rossing, T.D.: Modal analysis. In: Rossing, T.D. (ed.) Springer Handbook of Acoustics, pp. 1165–1177. Springer, New York (2014). https://doi.org/10.1007/978-1-4939-0755-7_28

    Chapter  Google Scholar 

  37. Schönauer, C., Mossel, A., Zaiti, I.-A., Vatavu, R.-D.: Touch, movement and vibration: user perception of vibrotactile feedback for touch and mid-air gestures. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015. LNCS, vol. 9299, pp. 165–172. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22723-8_14

    Chapter  Google Scholar 

  38. Seo, J., Choi, S.: Perceptual analysis of vibrotactile flows on a mobile device. IEEE Trans. Haptics 6(4), 522–527 (2013). https://doi.org/10.1109/TOH.2013.24

    Article  Google Scholar 

  39. Silva, B., Costelha, H., Bento, L.C., Barata, M., Assuncao, P.A.A.: Subjective evaluation of haptic feedback technologies for interactive multimedia. In: IEEE EUROCON 2019–18th International Conference on Smart Technologies, pp. 1–6 (2019). https://doi.org/10.1109/EUROCON.2019.8861847

  40. Strauss, A., Corbin, J.M.: Grounded Theory in Practice. Sage, Thousand Oaks (1997)

    Google Scholar 

  41. Turchet, L., Marchal, M., Lécuyer, A., Nordahl, R., Serafin, S.: Influence of auditory and visual feedback for perceiving walking over bumps and holes in desktop VR. In: Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology, VRST 2010, pp. 139–142. Association for Computing Machinery, New York (2010). https://doi.org/10.1145/1889863.1889893

  42. Turchet, L., Serafin, S., Cesari, P.: Walking pace affected by interactive sounds simulating stepping on different terrains. ACM Trans. Appl. Percept. 10(4) (2013). https://doi.org/10.1145/2536764.2536770

  43. Villanueva, L., Zampini, M.: Reciprocal interference between audition and touch in the perception of duration. Multisensory Res. 31(5), 351–371 (2018)

    Article  Google Scholar 

  44. Weiser, M.: The computer for the 21st century. Sci. Am. 265(3), 94–105 (1991)

    Article  Google Scholar 

  45. Weiser, M., Brown, J.S.: Designing calm technology. PowerGrid J. 1(1), 75–85 (1996)

    Google Scholar 

  46. Wi, D., Sodemann, A., Chicci, R.: Vibratory haptic feedback assistive device for visually-impaired drivers. In: 2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), pp. 1–5. IEEE (2017)

    Google Scholar 

  47. Withana, A., Koyama, S., Saakes, D., Minamizawa, K., Inami, M., Nanayakkara, S.: Rippletouch: initial exploration of a wave resonant based full body haptic interface. In: Proceedings of the 6th Augmented Human International Conference, AH 2015, pp. 61–68. Association for Computing Machinery, New York (2015). https://doi.org/10.1145/2735711.2735790

  48. Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments: a presence questionnaire. Presence 7(3), 225–240 (1998)

    Article  Google Scholar 

  49. Wobbrock, J.O., Findlater, L., Gergle, D., Higgins, J.J.: The aligned rank transform for nonparametric factorial analyses using only anova procedures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2011, pp. 143–146. Association for Computing Machinery, New York (2011). https://doi.org/10.1145/1978942.1978963

  50. Wolf, K., Bäder, T.: Illusion of surface changes induced by tactile and visual touch feedback. In: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA 2015, pp. 1355–1360. Association for Computing Machinery, New York (2015). https://doi.org/10.1145/2702613.2732703

  51. Won, H.I., Altinsoy, M.E.: Effect of auditory feedback on tactile intensity perception in a touchscreen application. IEEE Trans. Haptics 13(2), 343–353 (2020). https://doi.org/10.1109/TOH.2019.2947553

    Article  Google Scholar 

  52. Yamada, T., Shibata, F., Kimura, A.: Analysis of the R-V dynamics illusion behavior in terms of auditory stimulation. In: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018. Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3281505.3281595

  53. Yeh, C.H., et al.: Application of piezoelectric actuator to simplified haptic feedback system. Sens. Actuators, A 303, 111820 (2020)

    Article  Google Scholar 

  54. Zhao, S., Israr, A., Fenner, M., Klatzky, R.L.: Intermanual apparent tactile motion and its extension to 3d interactions. IEEE Trans. Haptics 10(4), 555–566 (2017). https://doi.org/10.1109/TOH.2017.2678502

    Article  Google Scholar 

Download references

Acknowledgement

This project is funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation)–425869442 and is part of Priority Program SPP2199 Scalable Interaction Paradigms for Pervasive Computing Environments.

Author information

Authors and Affiliations

  1. Berlin University of Applied Science and Technologies (BHT), Berlin, Germany

    Marco Kurzweg, Maximilian Letter & Katrin Wolf

  2. Hamburg University of Applied Sciences (HAW), Hamburg, Germany

    Simon Linke

  3. LMU Munich, Munich, Germany

    Yannick Weiss & Albrecht Schmidt

Authors
  1. Marco Kurzweg
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Simon Linke
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yannick Weiss
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Maximilian Letter
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Albrecht Schmidt
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Katrin Wolf
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marco Kurzweg .

Editor information

Editors and Affiliations

  1. University of West London, London, UK

    José Abdelnour Nocera

  2. Reykjavik University, Reykjavik, Iceland

    Marta Kristín Lárusdóttir

  3. University of York, York, UK

    Helen Petrie

  4. University of Bari Aldo Moro, Bari, Italy

    Antonio Piccinno

  5. Université Côte d’Azur, Sophia Antipolis Cedex, France

    Marco Winckler

1 Electronic supplementary material

A Appendix

A Appendix

The questions from the original embodiment questionnaire [31] were slightly adjusted for our study as follows:

  1. 1.

    I did not believe it was a real fly.

  2. 2.

    It felt as if the graphical fly was slightly becoming real.

  3. 3.

    It felt as if the movements of the graphical fly were influencing my tactile perception.

  4. 4.

    It felt as if the graphical fly was turning into a real fly.

  5. 5.

    At some point, it felt as if a real fly was starting to move simultaneously with the graphical fly.

  6. 6.

    It felt as if there was one more fly in the room from when I came in.

  7. 7.

    It felt as if the fly had changed.

  8. 8.

    I felt a motion at my fingertip when I touched the fly.

  9. 9.

    It felt as if the fly’s body could be affected by my touch.

  10. 10.

    It felt as if the graphical fly was a real fly.

  11. 11.

    At some point, it felt that the graphical fly resembled a real fly in terms of shape, color, and motion.

  12. 12.

    I felt that a real fly was located where I saw the graphical fly.

  13. 13.

    It seemed as if the felt motion came from the fly.

  14. 14.

    It seemed as if I felt the motion of a real fly in the location where I touched the graphical fly.

  15. 15.

    It seemed as if the motions I felt were caused by the movement of the graphical fly.

  16. 16.

    It seemed as if my finger was touching a real fly.

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kurzweg, M., Linke, S., Weiss, Y., Letter, M., Schmidt, A., Wolf, K. (2023). Assignment of a Vibration to a Graphical Object Induced by Resonant Frequency. In: Abdelnour Nocera, J., Kristín Lárusdóttir, M., Petrie, H., Piccinno, A., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2023. INTERACT 2023. Lecture Notes in Computer Science, vol 14142. Springer, Cham. https://doi.org/10.1007/978-3-031-42280-5_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-42280-5_33

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-42279-9

  • Online ISBN: 978-3-031-42280-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation