Skip to main content
SpringerLink
Log in

Vibrotactile and vibroacoustic communications: pairs in interaction and play—an interactive structure and bodies in an urban environment

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

We designed a vibrotactile vest and The Humming Wall, a vibroacoustic interactive furniture set in an urban environment to interact with each other. We developed the vibrotactile patterns in the vest as a form of vibrotactile language to convey information to the wearer. In addition, we designed a set of interactive movements on The Humming Wall that would trigger patterns on the vest and elicit sensations and encourage body movements onto the wearer’s body. We invited people to interact in pairs at The Humming Wall, with one at the wall and one wearing the vest (they later swapped roles). Actions by the one at the wall, such as swiping or knocking on the wall were repeated on the vest wearer’s body. In addition, participants could ‘feel’ (vibroacoustically) and hear their own heartbeats and breath rates at the wall. We conducted a field trial with 39 participants over a 5-week period. Participants wearing the vest (and their pair) completed a set of tasks. We logged use and responses, recorded all activities on video and conducted post-experiment interviews and questionnaires. The results depicted the participants’ experience, communication and connection while wearing the vibrotactile vest and interacting with the wall. The findings show convincing, strong and positive responses to novel interactions between the responsive vibroacoustic environment and the vibrotactile vest. This work constitutes the first field trial with people ‘working’ in pairs with a vibrotactile wearable responding to and driving vibroacoustic displays with an interactive vibroacoustic environment.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Ahonen, H., Deek, P., Kroeker, J.: Low frequency sound treatment promoting physical and emotional relaxation qualitative study. Int. J. Psychosoc. Rehabil. 17(1), 45–58 (2012)

    Google Scholar 

  2. Bao, J., Shou, X., Wang, H., Yang, H.: Study on heartbeat information acquired from pressure cushion based on body sensor network. In: 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, pp. 1103–1108 (2013). https://doi.org/10.1109/GreenCom-iThings-CPSCom.2013.190

  3. da Silva Benini, M.J., Bruinink, M.W., Pekel, A.D., Talbott, W.A., Visser, A., Markopoulos, P.: Restoring balance: replacing the vestibular sense with wearable vibrotactile feedback. In: Röcker, C., Ziefle, M. (eds.) Smart Healthcare Applications and Services: Developments and Practices, pp. 283–301 (2011)

    Chapter  Google Scholar 

  4. Braun, V., Clarke, V.: Using thematic analysis in psychology. Qual. Res. Psychol. 3(2), 77–101 (2006). https://doi.org/10.1191/1478088706qp063oa

    Article  Google Scholar 

  5. Choi, S., Kuchenbecker, K.J.: Vibrotactile display: perception, technology, and applications. Proc. IEEE 101(9), 2093–2104 (2013). https://doi.org/10.1109/JPROC.2012.2221071

    Article  Google Scholar 

  6. Dahiya, R.S., Valle, M.: Tactile Sensing Technologies. In: Robotic Tactile Sensing. Springer, Dordrecht (2013)

    Book  Google Scholar 

  7. De Niet, G., Tiemens, B., Lendemeijer, B., Hutschemaekers, G.: Music-assisted relaxation to improve sleep quality: meta-analysis. J. Adv. Nurs. 65(7), 1356–1364 (2009). https://doi.org/10.1111/j.1365-2648.2009.04982.x

    Article  Google Scholar 

  8. Deci, E.L., Ryan, R.M.: The “what” and “why” of goal pursuits: human needs and the self-determination of behavior. Psychol. Inq. 11(4), 227–268 (2000). https://doi.org/10.1207/S15327965PLI1104_01

    Article  Google Scholar 

  9. Diamond, A., Amso, D.: Contributions of neuroscience to our understanding of cognitive development. Curr. Dir. Psychol. Sci. 17(2), 136–141 (2008). https://doi.org/10.1111/j.1467-8721.2008.00563.x

    Article  Google Scholar 

  10. Dijk, E.O., Weffers, A.: Breathe with the Ocean: a system for relaxation using audio, haptic and visual stimuli. In: Special Symposium at EuroHaptics 2010: Haptic and Audio-Visual Stimuli: Enhancing Experiences and Interaction, pp. 47–60 (2011)

  11. Dijk, E.O., Nijholt, A., van Erp, J.B.F., van Wolferen, G., Kuyper, E.: Audio–tactile stimulation: a tool to improve health and well-being? Int. J. Auton. Adapt. Commun. Syst. 6(4), 305–323 (2013)

    Article  Google Scholar 

  12. Dublon, G., Portocarrero, E.: Listentree: audio-haptic display in the natural environment. In: Proceedings of 20th International Conference on Auditory Display (ICAD–2014) (2014)

  13. Field, T.: Touch for socioemotional and physical well-being: a review. Dev. Rev. 30(4), 367–383 (2010). https://doi.org/10.1016/j.dr.2011.01.001

    Article  Google Scholar 

  14. Field, T.: Touch, 2nd edn. MIT press, Cambridge (2014)

    Google Scholar 

  15. Fuermaier, A.B.M., Tucha, L., Koerts, J., van Heuvelen, M.J.G., van der Zee, E.A., Lange, K.W., Tucha, O.: Good vibrations—effects of whole body vibration on attention in healthy individuals and individuals with ADHD. PLoS One (2014). https://doi.org/10.1371/journal.pone.0090747

    Google Scholar 

  16. Gallace, A., Spence, C.: The science of interpersonal touch: an overview. Neurosci. Biobehav. Rev. 34(2), 246–259 (2010). https://doi.org/10.1016/j.neubiorev.2008.10.004

    Article  Google Scholar 

  17. Geldard, F.A., Sherrick, C.E.: The cutaneous “rabbit”: a perceptual illusion. Science 178(4057), 178–179 (1972)

    Article  Google Scholar 

  18. Haans, A., IJsselsteijn, W.A.: The virtual midas touch: helping behavior after a mediated social touch. IEEE Trans. Haptics 2(3), 136–140 (2009)

    Article  Google Scholar 

  19. Huisman, G., Frederiks, A.D., Dijk, B.V., Hevlen, D., Krose, B.: The TaSSt: tactile sleeve for social touch. In: World Haptics Conference (WHC), 2013, pp. 211–216 (2013)

  20. Jackson, S.A., Marsh, H.W.: Development and validation of a scale to measure optimal experience: the flow state scale. J. Sport Exerc. Psychol. 18(1), 17–35 (1996)

    Article  Google Scholar 

  21. Jones, L.A., Sarter, N.B.: Tactile displays: guidance for their design and application. Human Factors J. Human Factors Ergon. Soc. 50(1), 90–111 (2008). https://doi.org/10.1518/001872008X250638

    Article  Google Scholar 

  22. King, L.K., Almeida, Q.J., Ahonen, H.: Short-term effects of vibration therapy on motor impairments in Parkinson’s disease. Neurorehabilitation 25(4), 297–306 (2009)

    Google Scholar 

  23. Koike, Y., Hoshitani, M., Tabata, Y., Seki, K., Nishimura, R., Kano, Y.: Effects of vibroacoustic therapy on elderly nursing home residents with depression. J. Phys. Ther. Sci. 24(3), 291–294 (2012). https://doi.org/10.1589/jpts.24.291

    Article  Google Scholar 

  24. Loewy, J., Stewart, K., Dassler, A.-M., Telsey, A., Homel, P.: The effects of music therapy on vital signs, feeding, and sleep in premature infants. Pediatrics 131(5), 902–918 (2013)

    Article  Google Scholar 

  25. Manresa-Yee, C., Morrison, A., Muntaner, J.J.: First insights with a vibrotactile interface for children with multiple disabilities. In: CHI’15 Extended Abstracts on Human Factors in Computing Systems (CHI EA’15), pp. 905–910 (2015). https://doi.org/10.1145/2702613.2732910

  26. McDaniel, T., Villanueva, D., Krishna, S., Panchanathan, S.: MOVeMENT: a framework for systematically mapping vibrotactile stimulations to fundamental body movements. In: Proceedings of HAVE 2010, pp. 1–6

  27. Montagu, A.: Touching: the human significance of the skin. Harper and Row Publishers, New York (1972)

    Google Scholar 

  28. Morrison, A., Knoche, H., Manresa-Yee, C.: Designing a vibrotactile language for a wearable vest. In: HCII2015, Design, User Experience, and Usability: Users and Interactions (LNCS 9187), pp. 655–666 (2015)

  29. Morrison, I., Löken, L.S., Olausson, H.: The skin as a social organ. Exp. Brain Res. 204, 305–314 (2010). https://doi.org/10.1007/s00221-009-2007-y

    Article  Google Scholar 

  30. Morrison, A., Manresa-Yee, C., Knoche, H.: Vibrotactile and vibroacoustic interventions into health and well-being. Univ. Access Inf. Soc. (2017). https://doi.org/10.1007/s10209-016-0516-6

    Google Scholar 

  31. Mueller, F.F., Vetere, F., Gibbs, M.R., Kjeldskov, J., Pedell, S., Howard, S.: Hug over a distance. In: CHI’05 Extended Abstracts on Human Factors in Computing Systems (CHI EA’05), pp. 1673–1676 (2005). https://doi.org/10.1145/1056808.1056994

  32. Neumann, D.A.: Kinesiology of the Musculoskeletal System: Foundations for Rehabilitation. 2nd edn. Mosby, St. Louis (2010)

    Google Scholar 

  33. Orso, V., Gamberini, L., Mazza, R., Hsieh, Y.-T.T., Jensen, B.W.S., Jacucci, G., Morrison, A.J., Jensen, W.: Follow the vibes: a comparison between two tactile displays in a navigation task in the field. PsychNol. J. 14(1), 61–79 (2016)

    Google Scholar 

  34. Orso, V., Mazza, R., Gamberini, L., Morrison, A., Jensen, W.: Investigating Tactile Stimulation in Symbiotic Systems, pp. 137–142. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-57753-1_12

    Google Scholar 

  35. Paredes, P., Chan, M.: CalmMeNow: exploratory research and design of stress mitigating mobile interventions. In: Proceedings of CHI EA’11, pp. 1699–1704 (2011)

  36. Pares, N., Carreras, A., Durany, J., Ferrer, J., Freixa, P., Gómez, D., Kruglanski, O., Parés, R., Ribas, J.I., Soler, M., Sanjurjo, A., et al.: MEDIATE: an interactive multisensory environment for children with severe autism and no verbal communication. In: Proceedings of the Third International Workshop on Virtual Rehabilitation (2004)

  37. Park, Y.W., Bae, S.H., Nam, T.J.: How do couples use cheektouch over phone calls?. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12), pp. 763–766 (2012). https://doi.org/10.1145/2207676.2207786

  38. Pless, M., Carlsson, M.: Effects of motor skill intervention on developmental coordination disorder: a meta-analysis. Adapt. Phys. Act. Q. 17(4), 381–401 (2000). https://doi.org/10.1123/apaq.17.4.381

    Article  Google Scholar 

  39. Punkanen, M., Ala-Ruona, E.: Contemporary vibroacoustic therapy: perspectives on clinical practice, research, and training. Music Med. 4(3), 128–135 (2012)

    Article  Google Scholar 

  40. Rosenthal, J., Edwards, N., Villanueva, D., Krishna, S., McDaniel, T., Panchanathan, S.: Design, implementation, and case study of a pragmatic vibrotactile belt. IEEE Trans. Instrum. Meas. 60(1), 114–125 (2011). https://doi.org/10.1109/TIM.2010.2065830

    Article  Google Scholar 

  41. Rüütel, E.: The Psychophysiological effects of music and vibroacoustic stimulation. Nordic J. Music Ther. 11(1), 16–26 (2002). https://doi.org/10.1080/08098130209478039

    Article  Google Scholar 

  42. Rüütel, E., Ratnik, M., Tamm, E., Zilensk, H.: The experience of vibroacoustic therapy in the therapeutic intervention of adolescent girls. Nordic J. Music Ther. 13(1), 33–46 (2004)

    Article  Google Scholar 

  43. Schelle, K.J., Gomez Naranjo, C., ten Bhömer, M., Tomico, O., Wensveen, S.: Tactile dialogues: personalization of vibrotactile behavior to trigger interpersonal communication. In: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction—TEI’14, pp. 637–642 (2015). https://doi.org/10.1145/2677199.2687894

  44. Spelmezan, D., Jacobs, M., Hilgers, A., Borchers, J.: Tactile motion instructions for physical activities. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09), pp. 2243–2252 (2009). https://doi.org/10.1145/1518701.1519044

  45. Tang, F., McMahan, R.P., Allen, T.T.: Development of a low-cost tactile sleeve for autism intervention. In: 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE), pp. 35–40 (2014). https://doi.org/10.1109/HAVE.2014.6954328

  46. Teh, J.K.S., Cheok, A.D., Peiris, R.L., Choi, Y., Thuong, V., Lai, S.: Huggy Pajama: a mobile parent and child hugging communication system. In: Proceedings of the 7th International Conference on Interaction Design and Children (IDC’08), pp. 250–257 (2008). https://doi.org/10.1145/1463689.1463763

  47. Uchiyama, H., Covington, M.A., Potter, W.A.: Vibrotactile glove guidance for semi-autonomous wheelchair operations. In: Proceedings of the 46th Annual Southeast Regional Conference on XX (ACM-SE 46), pp. 336–339 (2008). https://doi.org/10.1145/1593105.1593195

  48. van Boerdonk, K., Tieben, R., Klooster, S., van den Hoven, E.: Contact through canvas: an entertaining encounter. Pers. Ubiquit. Comput. 13(8), 551–567 (2009). https://doi.org/10.1007/s00779-009-0240-9

    Article  Google Scholar 

  49. Van Der Linden, J., Johnson, R., Bird, J., Rogers, Y., Schoonderwaldt, E.: Buzzing to play: lessons learned from an in the wild study of real-time vibrotactile feedback. In: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems—CHI’11, pp. 533–542 (2011)

  50. Van Erp, J.B.F., Toet, A.: Social touch in human computer interaction. Front. Digit. Humanit. 2, 2 (2015). https://doi.org/10.3389/fdigh.2015.00002

    Google Scholar 

  51. Vaucelle, C., Bonanni, L., Ishii, H.: Design of haptic interfaces for therapy. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09), pp. 467–470 (2009). https://doi.org/10.1145/1518701.1518776

  52. Vorderer, P., Wirth, W., Gouveia, F.R., Biocca, F., Saari, T., Jäncke, F., Böcking, S., Chramm, H., Gysbers, A., Hartmann, T., Klimmt, C., Laarni, J., Ravaja, N., Sacau, A., Baumgartner, T., Jäncke, P.: MEC spatial presence questionnaire (MEC-SPQ): short documentation and instructions for application. Report to the European Community, Project Presence: MEC (IST-2001-37661) (2004). http://www.ijk.hmt-hannover.de/presence

  53. Yang, C.C., Zhuang, W.Y., Wu, H.-T.: Assessment of the impact of acupuncture on peripheral blood flow with multi-channel photoplethysmography. In: 2014 IEEE International Conference on Electron Devices and Solid-State Circuits, pp. 1–2 (2014). https://doi.org/10.1109/EDSSC.2014.7061096

  54. Zephyr Bioharness 3. Retrieved 1 Aug 2015 from http://www.zephyranywhere.com

  55. Zhu, Y., Li, B., Cui, M., Fu, Y., Zhu, L.: Acu3D: a cross-platform three-dimensional visualization system for the meridians and acupoints of human body. In: 2015 7th International Conference on Information Technology in Medicine and Education (ITME), pp. 27–31 (2015). https://doi.org/10.1109/ITME.2015.102

Download references

Acknowledgements

We thank the volunteers for the field trials and Aalborg Kommune for support. This work is supported by the EU-funded project CultAR (FP7-ICT-2011-9 601139), TIN2016-81143-R (AEI/FEDER, UE), the FUEIB agreement 3194 and mobility grant CAS12/00199, Programa José Castillejo granted by the Spanish MECD.

Author information

Authors and Affiliations

  1. Department of Architecture, Design and Media Technology, Aalborg University, Rendsburggade 14, 9000, Aalborg, Denmark

    Ann Morrison, Hendrik Knoche & Walther Jensen

  2. Department of Mathematics and Computer Science, Universitat de les Illes Balears, Crta. Valldemossa km 7.5, 07122, Palma, Spain

    Cristina Manresa-Yee

Authors
  1. Ann Morrison
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cristina Manresa-Yee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hendrik Knoche
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Walther Jensen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ann Morrison.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Morrison, A., Manresa-Yee, C., Knoche, H. et al. Vibrotactile and vibroacoustic communications: pairs in interaction and play—an interactive structure and bodies in an urban environment. Univ Access Inf Soc 17, 585–605 (2018). https://doi.org/10.1007/s10209-017-0598-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-017-0598-9

Keywords

Search

Navigation