research-article

Haptically augmented remote speech communication: a study of user practices and experiences

Authors:

Sebastian Müller,

Kaisa Väänänen-Vainio-Mattila,

Vuokko LantzAuthors Info & Claims

NordiCHI '12: Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design

Pages 361 - 369

https://doi.org/10.1145/2399016.2399073

Published: 14 October 2012 Publication History

Abstract

Haptic technology provides a channel for interpersonal communication through the sense of touch. In the development of novel haptic communication devices, it is essential to explore people's use behaviors and perceptions of such a communication channel. To this end, we conducted a laboratory study on haptically augmented remote interpersonal communication. Participant pairs tested a communication system that allowed them to send squeezing and thermal feedback to each other's forearm during speech discussion. We explored the use practices and user experience of this setup and compared it to traditional speech-only communication. The findings indicate that squeezing was experienced as a more versatile and immediate type of feedback than thermal feedback. Warm and cold were on the other hand useful for communicating positive and negative meanings. Compared to speech-only communication, the added haptic modality allowed conveying emphases, emotions, and touches related to the discussion, and increased the feeling of closeness between the pairs.

References

[1]

AttrakDiff: A Service of User Interface Design GmbH, http://www.attrakdiff.de/en/Home/. Accessed on 14.2.2012.

[2]

Baumann, M. A., MacLean, K. E., Hazelton, T. W. and McKay, A. Emulating Human Attention-getting Practices with Wearable Haptics. In Haptics Symposium, 2010 IEEE, (2010), 149--156

Digital Library

[3]

Bonanni, L., Vaucelle, C., Lieberman, J. and Zuckerman, O. TapTap: A Haptic Wearable for Asynchronous Distributed Touch Therapy. In Proceedings of CHI EA '06. ACM, New York, NY, USA, (2006), 580--585

Digital Library

[4]

Brown, L. M., Brewster, S. A. and Purchase, H. C. A First Investigation into the Effectiveness of Tactons. In First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, (2005), 167--176.

Digital Library

[5]

Brown, L. M. and Williamson, J. Shake2Talk: Multimodal Messaging for Interpersonal Communication. In Proceedings of the 2nd international conference on Haptic and audio interaction design (HAID'07). Springer-Verlag, Berlin, Heidelberg, (2007), 44--55.

Digital Library

[6]

Chang, A., O'Modhrain, S., Jacob, R., Gunther, E. and Hiroshi, I. ComTouch: Design of a Vibrotactile Communication Device. In Proceedings of DIS 2002. ACM, NY, (2002)

Digital Library

[7]

Gooch, D. and Watts, L. Communicating Social Presence through Thermal Hugs. In Proceedings of First Workshop on Social Interaction in Spatially Separated Environments, SISSI2010. (2010)

[8]

Haans, A. and Ijsselstein, W. Mediated Social Touch: A Review of Current Research and Future Directions. Virtual Reality, Vol. 9, No. 2, (2006), 149--159

Digital Library

[9]

Hassenzahl, M. The Interplay of Beauty, Goodness and Usability in Interactive Products. Human Computer Interaction, Vol. 19, Iss. 4, (2004), 319--349

Digital Library

[10]

Hassenzahl, M., Burmester, M., & Koller, F. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualitäät. (J. Ziegler & G. Szwillus, Eds.) Mensch und Computer 2006: Mensch und Computer im Strukturwandel, B. G. Teubner, (2006), 187--196.

[11]

Heikkinen, J., Rantala, J., Olsson, T., Raisamo, R., Lylykangas, J., Raisamo, J., Surakka, V. and Ahmaniemi, T. Enhancing Personal Communication with Spatial Haptics: Two Scenario-based Experiments on Gestural Interaction. J. Vis. Lang. Comp. Vol. 20, Iss. 5, (2009), 287--304

Digital Library

[12]

Heikkinen, J., Rantala, J., Olsson, T., Raisamo, R. and Surakka, V. Exploring the Effects of Cumulative Contextual Cues on Interpreting Vibrotactile Messages. In Proceedings of MobileHCI 2011, ACM, New York, NY, USA, (2011)

Digital Library

[13]

ISO DIS 9241-210. Ergonomics of Human System Interaction - Part 210: Human-centred Design for Interactive Systems. International Standardization Organization (ISO) (2010)

[14]

Jones, L. A. and Berris, M. The Psychophysics of Temperature Perception and Thermal-Interface Design. In Proceedings of the 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS '02). IEEE Computer Society, Washington, DC, USA, (2002), 137--142.

Digital Library

[15]

Lee, W. and Lim Y-K. Thermo-message: Exploring the Potential of Heat as a Modality of Peripheral Expression. In Proceedings of CHI EA 2010, ACM, (2010)

Digital Library

[16]

Puckette, M. Pure Data: Another Integrated Computer Music Environment. In Proceedings of Second Intercollege Computer Music Concerts, Tachikawa, Japan, (1996), 37--41.

[17]

Rantala, J., Raisamo, R., Lylykangas, J., Ahmaniemi, T., Raisamo, J., Rantala, J., Mäkelä, K., Salminen, K. and Surakka, V. The Role of Gesture Types and Spatial Feedback in Haptic Communication. In IEEE Transactions on Haptics (2011)

Digital Library

[18]

Salminen, K., Surakka, V., Lylykangas, J., Raisamo, J., Saarinen, R., Raisamo, R., Rantala, J., and Evreinov, G. Emotional and Behavioral Responses to Haptic Stimulation. In Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, ACM, New York, NY, USA, (2008), 1555--1562.

Digital Library

[19]

Salminen, K., Surakka, V., Raisamo, J., Lylykangas, J., Pystynen, J., Raisamo, R., Mäkelä, K., and Ahmaniemi, T. Emotional Responses to Thermal Stimuli. In Proceedings of ICMI 2011, ACM, New York, NY, USA, (2011)

Digital Library

[20]

Smith, J. and MacLean, K. Communicating Emotion through a Haptic Link: Design Space and Methodology. International Journal of Human-Computer Studies, Vol. 65, Iss. 4, (2007), 376--387

Digital Library

[21]

Suhonen, K., Väänänen-Vainio-Mattila, K. and Mäkelä, K. User Experiences and Expectations of Vibrotactile, Thermal and Squeeze Feedback in Interpersonal Communication. To appear in Proceedings of HCI 2012, (2012)

Digital Library

[22]

Tan, H., Reed, C. and Durlach, N. Optimum Information Transfer Rates for Communication through Haptic and Other Sensory Modalities. IEEE Transactions on Haptics, Vol. 3 No. 2, (2010), 98--108

Digital Library

[23]

Wang, R. and Quek, F. Touch & Talk: Contextualizing Remote Touch for Affective Interaction. In Proceedings of TEI 2010, ACM, (2010), 13--20

Digital Library

[24]

Wilson, G., Halvey, M., Brewster, S. A. and Hughes, S. A. Some Like It Hot: Thermal Feedback for Mobile Devices. In Proceedings of CHI '11. ACM, New York, NY, USA, (2011), 2555--2564.

Digital Library

Cited By

Rama PMoosa RAlly H(2023)IT disclosures in integrated reporting within the South African banking sectorInternational Journal of Research in Business and Social Science (2147- 4478)10.20525/ijrbs.v12i2.240512:2(237-250)Online publication date: 25-Mar-2023
https://doi.org/10.20525/ijrbs.v12i2.2405
Wei QLi MHu J(2023)Mediated Social Touch With Mobile Devices: A Review of Designs and EvaluationsIEEE Transactions on Haptics10.1109/TOH.2023.332750616:4(785-804)Online publication date: Oct-2023
https://doi.org/10.1109/TOH.2023.3327506
Raisamo RSalminen KRantala JFarooq AZiat M(2022)Interpersonal Haptic CommunicationInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102881166:COnline publication date: 1-Oct-2022
https://dl.acm.org/doi/10.1016/j.ijhcs.2022.102881
Show More Cited By

Index Terms

Haptically augmented remote speech communication: a study of user practices and experiences
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
  2. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

User experiences and expectations of vibrotactile, thermal and squeeze feedback in interpersonal communication
BCS-HCI '12: Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers

The haptic modality provides a new channel for interpersonal communication through technology by utilizing the sense of touch. In the development of novel haptic communication devices, it is essential to explore the potential users' perceptions of such ...
Estimating VR Sickness and user experience using different HMD technologies: An evaluation study
Abstract
This paper presents results of a user study of the effects of virtual reality technology on VR Sickness and User Experience. In our study the participants watched two different panoramic (360) videos, one with relaxing content (beach ...
Highlights
- Assessing VR Sickness discomfort levels using the SSQ and Questionnaire.
- User ...
Haptic interaction in augmented reality
MM '09: Proceedings of the 17th ACM international conference on Multimedia

In an interactive augmented reality (AR) system, people are, most of the time, immersed in an environment rich of visual and audio feedback. The sense of touch is lacking in most of the AR environment. We present an augmented reality system where people ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

NordiCHI '12: Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design

October 2012

834 pages

ISBN:9781450314824

DOI:10.1145/2399016

General Chairs:
Lone Malmborg
IT University of Copenhagen
,
Thomas Pederson
IT University of Copenhagen

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

IT University of Copenhagen

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

NordiCHI '12

Sponsor:

NordiCHI '12: Nordic Conference on Human-Computer Interaction

October 14 - 17, 2012

Copenhagen, Denmark

Acceptance Rates

NordiCHI '12 Paper Acceptance Rate 84 of 341 submissions, 25%;

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
468
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Rama PMoosa RAlly H(2023)IT disclosures in integrated reporting within the South African banking sectorInternational Journal of Research in Business and Social Science (2147- 4478)10.20525/ijrbs.v12i2.240512:2(237-250)Online publication date: 25-Mar-2023
https://doi.org/10.20525/ijrbs.v12i2.2405
Wei QLi MHu J(2023)Mediated Social Touch With Mobile Devices: A Review of Designs and EvaluationsIEEE Transactions on Haptics10.1109/TOH.2023.332750616:4(785-804)Online publication date: Oct-2023
https://doi.org/10.1109/TOH.2023.3327506
Raisamo RSalminen KRantala JFarooq AZiat M(2022)Interpersonal Haptic CommunicationInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102881166:COnline publication date: 1-Oct-2022
https://dl.acm.org/doi/10.1016/j.ijhcs.2022.102881
Huisman GLisini Baldi TD'Aurizio NPrattichizzo D(2021)Feedback of Head Gestures in Audio-haptic Remote CommunicationProceedings of the 2021 ACM International Symposium on Wearable Computers10.1145/3460421.3478809(135-137)Online publication date: 21-Sep-2021
https://dl.acm.org/doi/10.1145/3460421.3478809
Gharat SShetty YMcDaniel T(2021)A Vibrothermal Haptic Display for Socio-emotional CommunicationHCI International 2021 - Late Breaking Papers: Multimodality, eXtended Reality, and Artificial Intelligence10.1007/978-3-030-90963-5_2(17-30)Online publication date: 11-Nov-2021
https://doi.org/10.1007/978-3-030-90963-5_2
McDaniel TTadayon R(2021)Haptic Mediators for Remote Interpersonal CommunicationMultimedia for Accessible Human Computer Interfaces10.1007/978-3-030-70716-3_8(217-250)Online publication date: 19-Feb-2021
https://doi.org/10.1007/978-3-030-70716-3_8
Di Campli San Vito PBrewster SPollick FThompson SSkrypchuk LMouzakitis ATruong KHeylen DCzerwinski MBerthouze NChetouani MNakano M(2020)Purring Wheel: Thermal and Vibrotactile Notifications on the Steering WheelProceedings of the 2020 International Conference on Multimodal Interaction10.1145/3382507.3418825(461-469)Online publication date: 21-Oct-2020
https://dl.acm.org/doi/10.1145/3382507.3418825
El Ali AYang XAnanthanarayan SRöggla TJansen JHartcher-O'Brien JJansen KCesar PBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)ThermalWear: Exploring Wearable On-chest Thermal Displays to Augment Voice Messages with AffectProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376682(1-14)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376682
Motti VMotti V(2020)Wearable InteractionWearable Interaction10.1007/978-3-030-27111-4_3(81-107)Online publication date: 2-Jan-2020
https://doi.org/10.1007/978-3-030-27111-4_3
Motti VMotti V(2020)Design ConsiderationsWearable Interaction10.1007/978-3-030-27111-4_2(41-79)Online publication date: 2-Jan-2020
https://doi.org/10.1007/978-3-030-27111-4_2
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten