Skip to main content
SpringerLink
Log in

Vibrotactile and vibroacoustic interventions into health and well-being

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

We designed a vibrotactile vest with physiological monitoring that interacts with a vibroacoustic urban environment, The Humming Wall. We structured vibrotactile patterns and built a vibrotactile language to convey information and to interact towards and from the vibroacoustic environment in order to elicit sensations and encourage particular body movements. The patterns were structured to emulate calming and activating sensations and to guide or warn the vest wearer. In addition, actions such as swiping or knocking on the wall were replicated on the vest for the vest wearer, and participants could ‘feel’ (vibroacoustically) and hear their own heartbeats and breath rates at the wall. A field trial with 39 participants was conducted over a 5-week period in an urban park. Participants wearing the vest completed a set of defined tasks. We logged use and responses, videoed all activities and conducted interviews and questionnaires post-experiment. The results depicted the participants’ experience, engagement and impressions while wearing the vibrotactile vest and interacting with the wall. The findings show convincing, strong and positive responses to novel interactions between the responsive vibroacoustic environment and the vibrotactile vest. We found compelling evidence to support further exploration into vibrotactile and vibroacoustic solutions for improving health and well-being. The work presented demonstrates the capacity for health and well-being solutions with multiple use cases. Additionally, this work constitutes the first field trial with a vibrotactile wearable responding to and driving vibroacoustic displays with an interactive vibroacoustic environment.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Dahiya, R.S., Valle, M.: Robotic tactile sensing technologies and system (2013)

  2. Field, T.: Touch, 2nd edn. MIT press, Cambridge (2014)

    Google Scholar 

  3. Van Erp, J.B.F., Toet, A.: Social touch in human–computer interaction. Front. Digit. Humanit. (2015). doi:10.3389/fdigh.2015.00002

    Google Scholar 

  4. Montagu, A.: Touching: The Human Significance of the Skin. Harper and Row Publishers, New York (1972)

    Google Scholar 

  5. Gallace, A., Spence, C.: The science of interpersonal touch: an overview. Neurosci. Biobehav. Rev. 34, 246–259 (2010). doi:10.1016/j.neubiorev.2008.10.004

    Article  Google Scholar 

  6. Diamond, A., Amso, D.: Contributions of neuroscience to our understanding of cognitive development. Curr. Dir. Psychol. Sci. 17, 136–141 (2008). doi:10.1111/j.1467-8721.2008.00563.x

    Article  Google Scholar 

  7. Field, T.: Touch for socioemotional and physical well-being: a review. Dev. Rev. 30, 367–383 (2010). doi:10.1016/j.dr.2011.01.001

    Article  Google Scholar 

  8. Mueller, F.F., Vetere, F., Gibbs, M.R., et al.: Hug over a distance. CHI’05 Extended Abstracts on Human Factors in Computing Systems, pp. 1673–1676. ACM, New York (2005)

    Google Scholar 

  9. Teh, J.K.S., Cheok, A.D., Peiris, R.L., et al.: Huggy Pajama: a mobile parent and child hugging communication system. In: Proceedings of the 7th International Conference on Interaction Design and Children, pp. 250–257. ACM, New York (2008)

  10. Loewy, J., Stewart, K., Dassler, A.-M., et al.: The effects of music therapy on vital signs, feeding, and sleep in premature infants. Pediatrics 131, 902–918 (2013)

    Article  Google Scholar 

  11. De Niet, G., Tiemens, B., Lendemeijer, B., Hutschemaekers, G.: Music-assisted relaxation to improve sleep quality: meta-analysis. J. Adv. Nurs. 65, 1356–1364 (2009). doi:10.1111/j.1365-2648.2009.04982.x

    Article  Google Scholar 

  12. Dijk, E.O., Nijholt, A., van Erp, J.B.F., et al.: Audio–tactile stimulation: a tool to improve health and well-being? Int. J. Auton. Adapt. Commun. Syst. 6, 305–323 (2013)

    Article  Google Scholar 

  13. Rüütel, E.: The psychophysiological effects of music and vibroacoustic stimulation. Nord. J. Music Ther. 11, 16–26 (2002). doi:10.1080/08098130209478039

    Article  Google Scholar 

  14. Ahonen, H., Deek, P., Kroeker, J.: Low frequency sound treatment promoting physical and emotional relaxation qualitative study. Int. J. Psychosoc. Rehabil. 17, 45–58 (2012)

    Google Scholar 

  15. Koike, Y., Hoshitani, M., Tabata, Y., et al.: Effects of vibroacoustic therapy on elderly nursing home residents with depression. J. Phys. Ther. Sci. 24, 291–294 (2012). doi:10.1589/jpts.24.291

    Article  Google Scholar 

  16. Rüütel, E., Ratnik, M., Tamm, E., Zilensk, H.: The experience of vibroacoustic therapy in the therapeutic intervention of adolescent girls. Nord. J. Music Ther. 13, 33–46 (2004)

    Article  Google Scholar 

  17. King, L.K., Almeida, Q.J., Ahonen, H.: Short-term effects of vibration therapy on motor impairments in Parkinson’s disease. NeuroRehabilitation 25, 297–306 (2009)

    Google Scholar 

  18. Punkanen, M., Ala-Ruona, E.: Contemporary vibroacoustic therapy: perspectives on clinical practice, research, and training. Music Med. 4, 128–135 (2012)

    Article  Google Scholar 

  19. Haans, A., IJsselsteijn, W.A.: The virtual midas touch: helping behavior after a mediated social touch. IEEE Trans. Haptics 2, 136–140 (2009)

    Article  Google Scholar 

  20. Morrison, I., Löken, L., Olausson, H.: The skin as a social organ. Exp. Brain Res. 204, 305–314 (2010). doi:10.1007/s00221-009-2007-y

    Article  Google Scholar 

  21. Vaucelle, C., Bonanni, L., Ishii, H.: Design of haptic interfaces for therapy. Proceedings of the SIGCHI Conference on Human Factors Computing Systems, pp. 467–470. ACM, New York (2009)

    Google Scholar 

  22. Fuermaier, A., Tucha, L., Koerts, J., et al.: Good vibrations: effects of whole body vibration on attention in healthy individuals and individuals with ADHD. PLoS ONE (2014). doi:10.1371/journal.pone.0090747

    Google Scholar 

  23. Dijk, E.O., Weffers, A.: Breathe with the ocean: a system for relaxation using audio, haptic and visual stimuli. In: Special Symposium at EuroHaptics 2010 Haptic and Audio-Visual Stimuli: Enhancing Experiences and Interaction, pp. 47–60. Amsterdam (2011)

  24. Benini, M.J., Bruinink, M., Pekel, A.D., Talbott, W.A., Visser, A., Markopoulos, P.: Restoring Balance: Replacing the Vestibular Sense with Wearable Vibrotactile Feedback. In: Röcker, C., Ziefle, M. (eds.) Smart Healthcare Applications and Services: Developments and Practices, pp. 283–301. IGI Global, Hershey, PA (2011). doi:10.4018/978-1-60960-180-5.ch013

    Chapter  Google Scholar 

  25. Huisman, G., Frederiks, A.D., Van Dijk, B., et al.: The TaSSt: tactile sleeve for social touch. World Haptics Conf. (WHC) 2013, 211–216 (2013)

    Article  Google Scholar 

  26. Tang, F., McMahan, R.P., Allen, T.T.: Development of a low-cost tactile sleeve for autism intervention. In: IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE), 2014, pp. 35–40 (2014)

  27. Arafsha, F., Alam, K.M., El Saddik, A.: EmoJacket: consumer centric wearable affective jacket to enhance emotional immersion. In: 2012 International Conference on Innovations in Information Technology (IIT), pp. 350–355 (2012)

  28. Paredes, P., Chan, M.: CalmMeNow: exploratory research and design of stress mitigating mobile interventions. In: Proceedings of the CHI EA’11, pp. 1699–1704. ACM, New York (2011)

  29. Park, Y.-W., Bae, S.-H., Nam, T.-J.: How do couples use cheektouch over phone calls? Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 763–766. ACM, New York (2012)

    Google Scholar 

  30. Spelmezan, D., Jacobs, M., Hilgers, A., Borchers, J.: Tactile motion instructions for physical activities. Proceedings of the SIGCHI Conference on Human Factors Computing Systems, pp. 2243–2252. ACM, New York (2009)

    Google Scholar 

  31. Geldard, F.A., Sherrick, C.E.: The cutaneous“rabbit”: a perceptual illusion. Science 178(80), 178–179 (1972)

    Article  Google Scholar 

  32. McDaniel, T., Villanueva, D., Krishna, S., Panchanathan, S.: MOVeMENT: a framework for systematically mapping vibrotactile stimulations to fundamental body movements. In: Proceedings of the HAVE 2010. IEEE, pp. 1–6 (2010)

  33. Manresa-Yee, C., Morrison, A., Muntaner, J.J.: First insights with a vibrotactile interface for children with multiple disabilities. CHI’15 Extended Abstracts in Human Factors in Computing Systems, pp. 905–910. ACM, New York (2015)

    Google Scholar 

  34. Rosenthal, J., Edwards, N., Villanueva, D., et al.: Design, implementation, and case study of a pragmatic vibrotactile belt. IEEE Trans. Instrum. Meas. 60, 114–125 (2011). doi:10.1109/TIM.2010.2065830

    Article  Google Scholar 

  35. Morelli, T., Foley, J., Columna, L., et al.: VI-Tennis: a vibrotactile/audio exergame for players who are visually impaired. Proceedings of the Fifth International Conference on Foundations of Digital Games, pp. 147–154. ACM, New York (2010)

    Chapter  Google Scholar 

  36. Yuan, B., Folmer, E.: Blind hero: enabling guitar hero for the visually impaired. In: Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 169–176. ACM, New York (2008)

  37. Knudsen, L., Morrison, A., Andersen, H.: Design of vibrotactile navigation displays for elderly with memory disorders. In: Fostering Social Interactions in the Ageing Society Artefacts Methodologies Research Paradigms. Work 12th European Conference on Computer Supported Cooperative Work, p 6. Aarhus (2011)

  38. Tsukada, K., Yasumura, M.: ActiveBelt: belt-type wearable tactile display for directional navigation. In: UbiComp 2004 Ubiquitous Computing, pp. 384–399 (2004)

  39. Van Erp, J.B.F., Van Veen, H.A.H.C., Jansen, C., Dobbins, T.: Waypoint navigation with a vibrotactile waist belt. ACM Trans. Appl. Percept. 2, 106–117 (2005). doi:10.1145/1060581.1060585

    Article  Google Scholar 

  40. Bosman, S., Groenendaal, B., Findlater, J.W., et al.: GentleGuide: an exploration of haptic output for indoors pedestrian guidance. In: Chittaro, L. (ed.) Proceedings of 5th International Symposium on Human–Computer Interactions with Mobile Devices and Services Mobile HCI 2003, Udine, Italy, pp. 358–362. Springer, Berlin (2003)

  41. Van Erp, J.B.F., Van Veen, H.A.H.C.: Vibrotactile in-vehicle navigation system. Trans. Res. F Traffic Psychol. Behav. 7, 247–256 (2004). doi:10.1016/j.trf.2004.09.003

    Article  Google Scholar 

  42. Uchiyama, H., Covington, M.A., Potter, W.D.: Vibrotactile glove guidance for semi-autonomous wheelchair operations. In: Proceedings of the 46th Annual Southeast Regional Conference on XX, pp. 336–339. ACM, New York (2008)

  43. Pares, N., Carreras, A., Durany, J., et al.: MEDIATE: an interactive multisensory environment for children with severe autism and no verbal communication. In: Proceedings of the Third International Workshop on Virtual Rehabilitation (2004)

  44. Dublon, G., Portocarrero, E.: Listentree: audio-haptic display in the natural enviroinment. In: Proceedings of the 20th International Conference on Auditing Display (ICAD–2014) (2014)

  45. Morrison, A., Knoche, H., Manresa-Yee, C.: Designing a vibrotactile language for a wearable vest. In: HCII2015, Design, User Experience, and Usability Users Interactions (LNCS 9187), pp. 655–666 (2015)

  46. Zephyr Bioharness 3. http://www.zephyranywhere.com. Accessed 1 Aug 2015

  47. Vorderer, P., Wirth, W., Gouveia, F.R., et al.: MEC spatial presence questionnaire (MEC-SPQ): short documentation and instructions for application. Report to the European Community, Project Presence MEC 3 (2004)

  48. Jackson, S., Marsh, H.: Development and validation of a scale to measure optimal experience: the flow state scale. J. Sport Exerc. Psychol. 18, 17–35 (1996)

    Article  Google Scholar 

  49. Deci, E.L., Ryan, R.M.: The “what” and “why” of goal pursuits: human needs and the self-determination of behavior. Psychol. Inq. 11, 227–268 (2000). doi:10.1207/S15327965PLI1104_01

    Article  Google Scholar 

  50. Karuei, I., MacLean, K.E., Foley-Fisher, Z., et al.: Detecting vibrations across the body in mobile contexts. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 3267–3276. ACM, New York (2011)

    Google Scholar 

  51. Obrist, M., Seah, S.A., Subramanian, S.: Talking about tactile experiences. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1659–1668. ACM, New York (2013)

    Chapter  Google Scholar 

  52. Weizenbaum, J.: ELIZA-A computer program for the study of natural language communication between man and machine. Commun. ACM 9, 36–45 (1966). doi:10.1145/365153.365168

    Article  Google Scholar 

  53. Moussette, C.: Simple haptics: sketching perspectives for the design of haptic interactions. Dissertation: Umeå University, 2012. Umeå. ISBN 9789174594843 (2012)

  54. Morrison, A., Salovaara, A.: Sustaining engagement at a public urban display. Situated Large Displays Work. OzCHI (2008)

  55. Orso, V., Gamberini, L., Mazza, R., Hsieh, Y.T., Jacucci, G., Jensen, W., Morrison, A.: Follow the vibes: a comparison between two tactile displays in a navigation task in the field. PsychNology J. 14(1), 61–79 (2016)

    Google Scholar 

  56. Street, S.: The Memory of Sound: Preserving the Sonic Past. Routledge, Abingdon (2014)

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank the volunteers for the field trials and Aalborg Kommune for support. This work is supported by the EU funded project CultAR (FP7-ICT-2011-9 601139), the FUEIB agreement 3194 and mobility Grant CAS12/00199, Programa José Castillejo Granted by the Spanish MECD.

Author information

Authors and Affiliations

  1. Department of Architecture, Design and Media Technology, Aalborg University, Rendsburggade 14, 9000, Aalborg, Denmark

    Ann Morrison & Hendrik Knoche

  2. Department of Mathematics and Computer Science, Universitat de les Illes Balears, Crta. Valldemossa km 7.5, 07122, Palma, Spain

    Cristina Manresa-Yee

Authors
  1. Ann Morrison
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cristina Manresa-Yee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hendrik Knoche
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ann Morrison.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Morrison, A., Manresa-Yee, C. & Knoche, H. Vibrotactile and vibroacoustic interventions into health and well-being. Univ Access Inf Soc 17, 5–20 (2018). https://doi.org/10.1007/s10209-016-0516-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-016-0516-6

Keywords

Search

Navigation