research-article

Using Thermal Stimuli to Enhance Photo-Sharing in Social Media

Authors:

Lynne BaillieAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 1, Issue 2

Article No.: 4, Pages 1 - 21

https://doi.org/10.1145/3090050

Published: 30 June 2017 Publication History

Abstract

Limited work has been undertaken to show how the emotive ability of thermal stimuli can be used for interaction purposes. One potential application area is using thermal stimuli to influence emotions in images shared online such as social media platforms. This paper presents a two-part study, which examines how the documented emotive property of thermal stimuli can be applied to enhance social media images. Participants in part-one supplied images from their personal collection or social media profiles, and were asked to augment each image with thermal stimuli based on the emotions they wanted to enhance or reduce. Part-one participants were interviewed to understand the effects they wanted augmented images to have. In part-two, these augmented images were perceived by a different set of participants in a simulated social media interface. Results showed strong agreement between the emotions augmented images were designed to evoke and the emotions they actually evoked as perceived by part-two participants. Participants in part-one selected thermal stimuli augmentation intended to modulate valence and arousal in images as a way of enhancing the realism of the images augmented. Part-two results indicate this was achieved as participants perceived thermal stimuli augmentation reduced valence in negative images and modulated valence and arousal in positive images.

References

[1]

Moses Akazue, Martin Halvey, and Lynne Baillie. 2017. Using Thermal Stimuli to Influence Affect in Different Picture Display Sizes. Personal and Ubiquitous Computing: 1--19.

[2]

Moses Akazue, Martin Halvey, Lynne Baillie, and Stephen Brewster. 2016. The Effect of Thermal Stimuli on the Emotional Perception of Images. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI ‘16: 4401--4412.

Digital Library

[3]

Shimon Akiyama, Katsunari Sato, Yasutoshi Makino, and Takashi Maeno. 2012. Presentation of thermal sensation through preliminary adjustment of adapting skin temperature. In 2012 IEEE Haptics Symposium (HAPTICS), 355--358.

[4]

Nazanin Andalibi, Pinar Ozturk, and Andrea Forte. 2015. Depression-related Imagery on Instagram. In Proceedings of the 18th ACM Conference Companion on Computer Supported Cooperative work 8 social computing, 231--234.

Digital Library

[5]

Lynne Baillie. 2002. The Home Workshop: A Method for Investigating the Home.

[6]

Lynne Baillie, Lee Morton, David C. Moffat, and Stephen Uzor. 2010. Capturing the response of players to a location-based game. Personal and Ubiquitous Computing 15, 1: 13--24.

Digital Library

[7]

Saeideh Bakhshi, David A Shamma, Lyndon Kennedy, and Eric Gilbert. 2015. Why We Filter Photos and How it Impacts Engagement. In Ninth International AAAI Conference on Web and Social Media.

[8]

David Beattie, Lynne Baillie, and Martin Halvey. 2015. A Comparison of Artificial Driving Sounds for Automated Vehicles. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, 451--462.

Digital Library

[9]

Margaret M. Bradley and Peter J. Lang. 1994. Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry 25, 1: 49--59.

[10]

Andrew M. Cox, Paul D. Clough, and Jennifer Marlow. 2008. Flickr: a first look at user behaviour in the context of photography as serious leisure. Information Research 13, 1.

[11]

Jayson L Dibble and Timothy R Levine. 2013. Sharing Good and Bad News with Friends and Strangers: Reasons for and Communication Behaviors Associated with the MUM Effect. Communication Studies 64, 4: 431--452.

[12]

Barney Glaser and Anselm Strrauss. 1967. The Discovery of Grounded Theory: Strategies for Qualitative Research.

[13]

L Gray, J Stevens, and L Marks. 1982. Thermal stimulus thresholds: Sources of variability. Physiology 8 Behavior 29, 2: 355--360.

[14]

Stefan Greiner, Jan-niklas Antons, and Ina Wechsung. 2015. Emotional Responses to Thermally Augmented Audiovisual Stimuli. Retrieved from http://i-guide.org/app/Papers/23.pdf

[15]

Rebecca Gulotta, Haakon Faste, and Jennifer Mankoff. 2012. Curation, Provocation, and Digital Identity : Risks and Motivations for Sharing Provocative Images Online. In CHI ‘12, 387--390.

Digital Library

[16]

Martin Halvey, Michael Henderson, SA Brewster, Graham Wilson, and Stephen Hughes. 2012. Augmenting media with thermal stimulation. Haptic and Audio Interaction Design 7468: 91--100. Retrieved February 12, 2014 from http://link.springer.com/chapter/10.1007/978-3-642-32796-4_10

Digital Library

[17]

Martin Halvey, Graham Wilson, Stephen A. Brewster, and Stephen A. Hughes. 2013. Perception of thermal stimuli for continuous interaction. In CHI ‘13 Extended Abstracts on Human Factors in Computing Systems on - CHI EA ‘13, 1587.

Digital Library

[18]

Martin Halvey, Graham Wilson, Stephen Brewster, and Stephen Hughes. 2012. “Baby it's cold outside”: The Influence of Ambient Temperature and Humidity on Thermal Feedback. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI ‘12, 715--724.

Digital Library

[19]

Martin Halvey, Graham Wilson, Yolanda Vazquez-Alvarez, Stephen A. Brewster, and Stephen A. Hughes. 2011. The Effect of Clothing on Thermal Feedback Perception. In Proceedings of the 13th international conference on multimodal interfaces - ICMI ‘11, 217--220.

Digital Library

[20]

Nancy A. Van House. 2007. Flickr and public image-sharing. In CHI ‘07 extended abstracts on Human factors in computing systems -CHI ‘07, 2717--2722.

Digital Library

[21]

C.J. Hutto, Sarita Yardi, and Eric Gilbert. 2013. A longitudinal study of follow predictors on twitter. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI ‘13: 821.

Digital Library

[22]

L.A. Jones and M. Berris. 2002. The psychophysics of temperature perception and thermal-interface design. In Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002, 137--142.

Digital Library

[23]

Dan R. Kenshalo, Charles E. Holmes, and Paul B. Wood. 1968. Warm and cool thresholds as a function of rate of stimulus temperature change. Perception 8 Psychophysics 3, 2: 81--84.

[24]

Dan R. Kenshalo and Harley A. Scott Jr. 1966. Temporal course of thermal adaptation. Science 151, 3714: 1095--1096.

[25]

Peter J Lang, Margaret M Bradley, and Bruce N Cuthbert. 2008. International Affective Picture System (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-8. University of Florida, Gainesville, FL.

[26]

Eunji Lee, Jung-Ah Lee, Jang Ho Moon, and Yongjun Sung. 2015. Pictures Speak Louder than Words: Motivations for Using Instagram. Cyberpsychology, Behavior, and Social Networking 18, 9: 552--556.

[27]

Wonjun Lee and Youn Kyung Lim. 2012. Explorative research on the heat as an expression medium: Focused on interpersonal communication. Personal and Ubiquitous Computing 16, 8: 1039--1049.

Digital Library

[28]

Clifton Lin and Haakon Faste. 2012. Photographic Social Media : A Framework For Design. Proceedings of the Designing Interactive Systems Conference on - DIS ‘12: 244--247.

Digital Library

[29]

Markus Löchtefeld, Nadine Lautemann, Sven Gehring, and Antonio Krüger. 2014. AmbiPad: Enriching Mobile DIgital Media with Ambient Feedback. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices 8 services - MobileHCI ‘14, 295--298.

Digital Library

[30]

W.J.T. Mitchell. 2005. What Do Pictures Want? The Lives and Loves of Images. University of Chicago Press.

[31]

Kimberlee Morrison. 2015. Snapchat is the fastest growing social network. Retrieved June 28, 2016 from http://www.adweek.com/socialtimes/snapchat-is-the-fastest-growing-social-network-infographic/624116

[32]

Mutsuhiro Nakashige, Minoru Kobayashi, Yuriko Suzuki, Hidekazu Tamaki, and Suguru Higashino. 2009. “Hiya-Atsu” Media: Augmenting Digital Media with Temperature. In Proceedings of the 27th international conference extended abstracts on Human factors in computing systems - CHI EA ‘09, 3181--3186.

Digital Library

[33]

James A. Russell. 1980. A circumplex model of affect. Journal of Personality and Social Psychology 39, 6: 1161--1178.

[34]

Dean Sabatinelli, C a Tobias Flaisch, Margaret M Bradley, Je R Fitzsimmons, and Peter J Lang. 2004. Affective picture perception: gender differences in visual cortex ? Neuroreport 15, 7: 1109--1112.

[35]

Katri Salminen, Veikko Surakka, Raisamo Jukka, Janis Lylykangas, Roope Raisamo, and Kalle Makela. 2013. Cold or Hot? How Thermal Stimuli Are Related to Human Emotional System? In International Workshop on Haptic and Audio Interaction Design., 20--29.

Digital Library

[36]

Katri Salminen, Veikko Surakka, Jukka Raisamo, Jani Lylykangas, Johannes Pystynen, Roope Raisamo, Kalle Mäkelä, and Teemu Ahmaniemi. 2011. Emotional responses to thermal stimuli. In Proceedings of the 13th international conference on multimodal interfaces - ICMI ‘11, 193--196.

Digital Library

[37]

Katja Suhonen, Kaisa Väänänen-Vainio-Mattila, and Kalle Mäkelä. 2012. User experiences and expectations of vibrotactile, thermal and squeeze feedback in interpersonal communication. BCS-HCI ‘12 Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers: 205--214. Retrieved April 2, 2014 from http://dl.acm.org/citation.cfm?id=2377916.2377939

Digital Library

[38]

Auke Tellegen. 1985. Structures of mood and personality and their relevance to assessing anxiety, with an emphasis on self-report.

[39]

Graham Wilson, Stephen Brewster, Martin Halvey, and Stephen Hughes. 2012. Thermal Icons: Evaluating Structured Thermal Feedback for Mobile Interaction. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services - MobileHCI ‘12, 309.

Digital Library

[40]

Graham Wilson, Stephen Brewster, Martin Halvey, and Stephen Hughes. 2013. Thermal Feedback Identification in a Mobile Environment. Haptic and Audio Interaction Design: 10--19.

Digital Library

[41]

Graham Wilson, Gavin Davidson, and Stephen Brewster. 2015. In the Heat of the Moment : Subjective Interpretations of Thermal Feedback During Interaction. CHI'15 Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems: 2063--2072.

Digital Library

[42]

Graham Wilson, Dobromir Dobrev, and Stephen A Brewster. 2016. Hot Under the Collar: Mapping Thermal Feedback to Dimensional Models of Emotion. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘16).

Digital Library

[43]

Graham Wilson, Martin Halvey, Stephen Brewster, and Stephen Hughes. 2011. Some Like it Hot: Thermal Feedback for Mobile Devices. Proceedings of the SIGCHI conference on Human Factors in Computing Systems. CHI ‘11. Retrieved February 13, 2014 from http://dl.acm.org/citation.cfm?id=1979316

Digital Library

[44]

Bin Xu, Pamara Chang, Christopher L Welker, Natalya N Bazarova, and Dan Cosley. 2016. Automatic Archiving versus Default Deletion: What Snapchat Tells Us About Ephemerality in Design. Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work 8 Social Computing - CSCW ‘16: 1660--1673.

Digital Library

Cited By

Günther SSkogseide ABuhlmann RMühlhäuser M(2024)Assessing the Influence of Visual Cues in Virtual Reality on the Spatial Perception of Physical Thermal StimuliProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642154(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642154
Haliburton LSchött SHirsch LWelsch RSchmidt A(2023)Feeling the Temperature of the RoomProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808207:1(1-21)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580820
Sun ZAnanda RFu X(2022)EmoSparkle: Tangible Prototype to Convey Visual Expressions for Visually Impaired Individuals in Real-time ConversationsProceedings of the Tenth International Symposium of Chinese CHI10.1145/3565698.3565768(38-49)Online publication date: 22-Oct-2022
https://dl.acm.org/doi/10.1145/3565698.3565768
Show More Cited By

Index Terms

Using Thermal Stimuli to Enhance Photo-Sharing in Social Media
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques

Recommendations

The Effect of Thermal Stimuli on the Emotional Perception of Images
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Thermal stimulation is a feedback channel that has the potential to influence the emotional response of people to media such as images. While previous work has demonstrated that thermal stimuli might have an effect on the emotional perception of images, ...
Using thermal stimuli to influence affect in different picture display sizes

The ability of images to evoke emotions in people has been well documented in previous research, as well as the differences in the emotional perception of images when viewed on different-sized screens and device types. The ability of thermal stimuli to ...
Augmenting media with thermal stimulation
HAID'12: Proceedings of the 7th international conference on Haptic and Audio Interaction Design

Thermal interfaces are a new area of research in HCI, with one of their main benefits being the potential to influence emotion. To date, studies investigating thermal feedback for affective interaction have either provided concepts and prototypes, or ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 1, Issue 2

June 2017

665 pages

EISSN:2474-9567

DOI:10.1145/3120957

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 June 2017

Accepted: 01 June 2017

Revised: 01 March 2017

Received: 01 February 2017

Published in IMWUT Volume 1, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
612
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Günther SSkogseide ABuhlmann RMühlhäuser M(2024)Assessing the Influence of Visual Cues in Virtual Reality on the Spatial Perception of Physical Thermal StimuliProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642154(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642154
Haliburton LSchött SHirsch LWelsch RSchmidt A(2023)Feeling the Temperature of the RoomProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808207:1(1-21)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580820
Sun ZAnanda RFu X(2022)EmoSparkle: Tangible Prototype to Convey Visual Expressions for Visually Impaired Individuals in Real-time ConversationsProceedings of the Tenth International Symposium of Chinese CHI10.1145/3565698.3565768(38-49)Online publication date: 22-Oct-2022
https://dl.acm.org/doi/10.1145/3565698.3565768
Günther SMüller FSchön DElmoghazy OMühlhäuser MSchmitz MBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Therminator: Understanding the Interdependency of Visual and On-Body Thermal Feedback in Virtual RealityProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376195(1-14)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376195
Maeda TKurahashi T(2019)TherModuleProceedings of the 10th Augmented Human International Conference 201910.1145/3311823.3311826(1-8)Online publication date: 11-Mar-2019
https://dl.acm.org/doi/10.1145/3311823.3311826
Kotsev VNikolev APawlak KLöchtefeld MHenze NWoźniak PVäänänen KWilliamson JSchneegass S(2017)Investigating the usage of thermal feedback as an active game elementProceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia10.1145/3152832.3152853(91-95)Online publication date: 26-Nov-2017
https://dl.acm.org/doi/10.1145/3152832.3152853

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents