research-article

Exploring the effects of cumulative contextual cues on interpreting vibrotactile messages

Authors:

Jani Heikkinen,

Veikko SurakkaAuthors Info & Claims

MobileHCI '11: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services

Pages 1 - 10

https://doi.org/10.1145/2037373.2037375

Published: 30 August 2011 Publication History

Abstract

The sense of touch has been shown to convey emotive information and nuances in face-to-face interpersonal communication, but its applications in mobile communication technologies are still limited. One of the challenges for such new communication medium is the interpretation of tactile messages. This paper presents a study with an early prototype of a mobile tactile device. Twenty novice participants interpreted four messages consisting of a four-channel vibrotactile stimulus, complemented with three cumulative textual cues regarding 1) the communication setting, 2) sender, and 3) situation. The subjective interpretations were assessed with four semantic differential scales, and the reasoning behind the interpretations was inquired by interviewing. The findings show that the intensity and, to some degree, the friendliness of the message could be identified from the tactile-only message. However, to correctly interpret the degree of formality or emotionality in the message, also contextual cues were needed.

References

[1]

Bailenson, J. N., Yee, N., Brave, S., Merget, D., and Koslow, D. Virtual interpersonal touch: expressing and recognizing emotions through haptic devices. Hum.-Comput. Interact. 22, 3 (2007), 325--353.

Digital Library

[2]

Brewster, S., Brown, L. M. Tactons: structured tactile messages for non-visual information display, Proc. AUIC 2004, 15--23.

Digital Library

[3]

Brown, L. M., Sellen, A., Krishna, R., and Harper, R. Exploring the potential of audio-tactile messaging for remote interpersonal communication. Proc. CHI 2009. ACM, New York, NY, 1527--1530

Digital Library

[4]

Brown. L. M., Williamson, J. Shake-to-talk: Multimodal Messaging for Interpersonal Communication. Proc. HAID 2007. Spinger LNCS.

Digital Library

[5]

Cha, J., Oakley, I., Lee, J., and Ryu, J. An AR system for haptic communication. Proc. ICAT 2005, vol. 157. ACM, New York, NY, 241--242.

Digital Library

[6]

Chang, A., O'Modhrain, S., Jacob, R., Gunther, E. and Ishii, H. ComTouch: design of a vibrotactile communication device. In Proceedings of the 4th conference on Designing interactive systems: processes, practices, methods, and techniques (DIS '02). ACM, New York, NY, USA, 312--320.

Digital Library

[7]

Chouvardas, V. G., Miliou, A. N. Hatalis, M. K Tactile displays: Overview and recent advances. Displays, 29, 3 (2008), 185--194.

[8]

Clark, H. H. Using Language. Cambridge, UK: Cambridge University Press. 1996

[9]

Haans, A., de Nood, C., and IJsselsteijn, W. A. Investigating response similarities between real and mediated social touch: a first test. Extended Abstracts CHI '07. ACM, New York, NY, 2405--2410.

Digital Library

[10]

Hall E. T. Beyond Culture. New York: Anchor/Doubleday, 1971.

[11]

Heikkinen, J., Olsson, T., and Väänänen-Vainio-Mattila, K. Expectations for user experience in haptic communication with mobile devices. Proc. MobileHCI 2009. ACM, New York, NY, 1--10.

Digital Library

[12]

Heikkinen, J., Rantala, J., Olsson, T., Raisamo, R., Lylykangas, J., Raisamo, J., Surakka, V., and Ahmaniemi, T. Enhancing personal communication with spatial haptics: Two scenario-based experiments on gestural interaction. J. Vis. Lang. Comput. 20, 5 (2009), 287--304.

Digital Library

[13]

Kortum, P. HCI Beyond the GUI. Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces. Morgan Kaufman Publishers, 2008.

Digital Library

[14]

MacLean, K. E. Designing with Haptic Feedback, in Proc. IEEE Robotics and Automation 2000.

[15]

Mortensen, C. D. Communication Theory. 2^nd edition. Transaction Publishers. New Jersey, USA, 2007.

[16]

Oulasvirta, A., Tamminen, S., Roto, V. and Kuorelahti, J. Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI. Proc. of Chi 2005. ACM, New York, NY, USA, 919--928

Digital Library

[17]

Raisamo, J., Raisamo, R. and Surakka, V. Evaluating the effect of temporal parameters for vibrotactile saltatory patterns. In Proc. of the 2009 international conference on Multimodal interfaces (ICMI-MLMI '09). ACM, New York, NY, USA, 319--326. 2009.

Digital Library

[18]

Rantala, J., Raisamo, R., Lylykangas, J., Ahmaniemi, T., Raisamo, R., Rantala, J., Mäkelä, K., Salminen, K., and Surakka, V. The Role of Gesture Types and Spatial Feedback in Haptic Communication. To appear in IEEE Transactions on Haptics.

Digital Library

[19]

Rovers, A. and van Essen, H. HIM: a framework for haptic instant messaging. Extended Abstracts CHI 2004. ACM, New York, NY, 1313--1316.

Digital Library

[20]

Salminen, K., Surakka, V., Lylykangas, J., Raisamo, J., Saarinen, R., Raisamo, R., Rantala, J., and Evreinov, G. Emotional and behavioral responses to haptic stimulation. In Proc. of CHI 2008. ACM, New York, NY, 1555--1562.

Digital Library

[21]

Smith J., MacLean K. Communicating Emotion through a Haptic Link: Design Space and Methodology. In Int. J. of Human-Computer Studies. 65, 4 (2007), 376--387.

Digital Library

[22]

Swerdfeger, B. A., Fernquist, J., Hazelton, T. W., and MacLean, K. E. Exploring melodic variance in rhythmic haptic stimulus design. In Proc. of Graphics interface. ACM International Conference Proceeding Series, vol. 324 (2009), 133--140.

Digital Library

[23]

Tortora G. & Grabowski S. Principles of Anatomy & Physiology. 10th Edition. John Wiley & Sons Inc.

[24]

Van Dijk, T. A. Cognitive Context Models and Discourse. Language Structure, Discourse and the Access to Consciousness. (pp. 189--226). Amsterdam: Benjamins, 1997.

[25]

Wish, M., Deutsch, M., Kaplan, S. J. Perceived Dimensions of Interpersonal Relations. Journal of Personality and Social Psychology, 33, 4 (1976), 409

Cited By

Wei QLi MHu J(2023)Mediated Social Touch With Mobile Devices: A Review of Designs and EvaluationsIEEE Transactions on Haptics10.1109/TOH.2023.332750616:4(785-804)Online publication date: Oct-2023
https://doi.org/10.1109/TOH.2023.3327506
Suhonen KVäänänen-Vainio-Mattila KMäkelä K(2012)User experiences and expectations of vibrotactile, thermal and squeeze feedback in interpersonal communicationProceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers10.5555/2377916.2377939(205-214)Online publication date: 10-Sep-2012
https://dl.acm.org/doi/10.5555/2377916.2377939
Suhonen KMüller SRantala JVäänänen-Vainio-Mattila KRaisamo RLantz VMalmborg LPederson T(2012)Haptically augmented remote speech communicationProceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design10.1145/2399016.2399073(361-369)Online publication date: 14-Oct-2012
https://dl.acm.org/doi/10.1145/2399016.2399073

Index Terms

Exploring the effects of cumulative contextual cues on interpreting vibrotactile messages
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices

Recommendations

A conversation analytical study on multimodal turn-giving cues: end-of-turn prediction
COST'11: Proceedings of the 2011 international conference on Cognitive Behavioural Systems

The present paper focuses on the systematic study of the sequential organization of verbal as well as nonverbal behavior in spontaneous interaction. The study concerns one of the most universal structural features of conversation, the phenomenon of ...
Speech and face-to-face communication - An introduction

This issue focuses on face-to-face speech communication. Research works have demonstrated that this communicative situation is essential to language acquisition and development (e.g. naming). Face-to-face communication is in fact much more than speaking ...
Interdisciplinary Corpus-based Approach for Exploring Multimodal Conversational Feedback
ICMI '22: Proceedings of the 2022 International Conference on Multimodal Interaction

During spontaneous conversation, interlocutors have three possible actions: speak, be silent or produce feedback. In order to better understand the mechanisms that render spontaneous interactions successful, this PhD research focuses on conversational ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MobileHCI '11: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services

August 2011

781 pages

ISBN:9781450305419

DOI:10.1145/2037373

General Chair:
Markus Bylund
Swedish INstitute of Computer Science (SICS)
,
Program Chairs:
Oskar Juhlin
Mobile Life Centre, Stockholm University
,
Ylva Fernaeus
Mobile Life Centre, SICS

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Nokia
Swedish Institute of Computer Science: Swedish Institute of Computer Science
ERICSSON

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 August 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI '11

Sponsor:

Swedish Institute of Computer Science

MobileHCI '11: 13th International Conference on Human Computer Interaction with Mobile Devices and Services

August 30 - September 2, 2011

Stockholm, Sweden

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
419
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wei QLi MHu J(2023)Mediated Social Touch With Mobile Devices: A Review of Designs and EvaluationsIEEE Transactions on Haptics10.1109/TOH.2023.332750616:4(785-804)Online publication date: Oct-2023
https://doi.org/10.1109/TOH.2023.3327506
Suhonen KVäänänen-Vainio-Mattila KMäkelä K(2012)User experiences and expectations of vibrotactile, thermal and squeeze feedback in interpersonal communicationProceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers10.5555/2377916.2377939(205-214)Online publication date: 10-Sep-2012
https://dl.acm.org/doi/10.5555/2377916.2377939
Suhonen KMüller SRantala JVäänänen-Vainio-Mattila KRaisamo RLantz VMalmborg LPederson T(2012)Haptically augmented remote speech communicationProceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design10.1145/2399016.2399073(361-369)Online publication date: 14-Oct-2012
https://dl.acm.org/doi/10.1145/2399016.2399073

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten