skip to main content
10.1145/3290607.3313015acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

Translating Affective Touch into Text

Published: 02 May 2019 Publication History

Abstract

This paper presents a game-like experience that translates tactile input into text, which captures the emotional qualities of that touch. We describe the experience and the system that generates it: a plush toy instrumented with pressure sensors, a machine learning method that acquires a mapping from touch data into a feature vector of affect values, and a mechanism that transcribes that feature vector into text. We conclude by discussing the range of novel interactions that such a nuanced tactile interface can support.

References

[1]
Heber Cruz Zurian Seyed Reza Atefi Erik Billing Fernando Seoane Martinez Paul Lukowicz Bo Zhou, Carlos Andres Velez Altamirano. 2017. Textile Pressure Mapping Sensor for Emotional Touch Detection in Human-Robot Interaction. Sensors 17, 11 (2017).
[2]
Manfred Clynes. 1978. Sentics: The Touch of the Emotions. Anchor Press/Doubleday.
[3]
Clayton Epp, Michael Lippold, and Regan L. Mandryk. 2011. Identifying Emotional States Using Keystroke Dynamics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 715--724.
[4]
Anna Flagg and Karon MacLean. 2013. Affective Touch Gesture Recognition for a Furry Zoomorphic Machine. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, New York, NY, USA, 25--32.
[5]
Luc Geurts, Jolien Deville, Vero Vanden Abeele, Jelle Saldien, and Karen Vanderloock. 2013. Skweezee Studio: Turn Your Own Plush Toys into Interactive Squeezable Objects. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14). ACM, New York, NY, USA, 377--380.
[6]
Surjya Ghosh, Niloy Ganguly, Bivas Mitra, and Pradipta De. 2017. TapSense: combining self-report patterns and typing characteristics for smartphone based emotion detection. 1--12.
[7]
Javier Hernandez, Pablo Paredes, Asta Roseway, and Mary Czerwinski. 2014. Under Pressure: Sensing Stress of Computer Users. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 51--60.
[8]
Katherine Isbister. 2017. Fidget Toys Aren't Just Hype. Retrieved August 7, 2018 from https://www.scientificamerican. com/article/fidget-toys-arent-just-hype/
[9]
Michael Karlesky and Katherine Isbister. 2016. Understanding Fidget Widgets: Exploring the Design Space of Embodied Self-Regulation. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction.
[10]
Hsiao T-C Lee P-M, Tsui W-H. 2015. The Influence of Emotion on Keyboard Typing: An Experimental Study Using Auditory Stimuli. PLoS ONE 10, 6 (e0129056 2015).
[11]
A.F.M. Nazmul Haque Nahin, Jawad Mohammad Alam, Hasan Mahmud, and Kamrul Hasan. 2014. Identifying emotion by keystroke dynamics and text pattern analysis. Behaviour & Information Technology 33, 9 (2014), 987--996. arXiv:https://doi.org/10.1080/0144929X.2014.907343
[12]
Katherine Isbister Peter Cottrell, April Grow. 2018. Soft-bodied Fidget Toys: A Materials Exploration. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, New York, NY, 42--48.
[13]
Katherine Isbister Suzanne B. da Câmara, Rakshit Agrawal. 2018. Identifying Children's Fidget Object Preferences: Toward Exploring the Impacts of Fidgeting and Fidget-Friendly Tangibles. In DIS '18,. 301--311.
[14]
Lexi Walters Wright. {n. d.}. 6 Types of Fun Fidgets for Kids With ADHD. Retrieved August 7, 2018 from https://www.understood.org/en/learning-attention-issues/child-learning-disabilities/add-adhd/ 6-types-of-fun-fidgets-for-kids-with-adhd?view=slideview
[15]
MacLean K.E. Yohanan, S. 2012. The Role of Affective Touch in Human-Robot Interaction: Human Intent and Expectations in Touching the Haptic Creature. International Journal of Social Robotics 4 (2012), 163--180.

Cited By

View all
  • (2024)Tangible Affect: A Literature Review of Tangible Interactive Systems Addressing Human Core Affect, Emotions and MoodsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661608(424-440)Online publication date: 1-Jul-2024
  • (2024)Extracting the Affective Content of Fidgeting in Adults with ADHD via Machine Learning and a Hand-held Soft Tangible DeviceExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650856(1-8)Online publication date: 11-May-2024
  • (2024)Touch-text answer for human-robot interaction via supervised adversarial learningExpert Systems with Applications10.1016/j.eswa.2023.122738242(122738)Online publication date: May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems
May 2019
3673 pages
ISBN:9781450359719
DOI:10.1145/3290607
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Check for updates

Author Tags

  1. affect display
  2. affective touch
  3. fidgets
  4. gestural input
  5. haptic input
  6. synesthesia
  7. translation

Qualifiers

  • Abstract

Conference

CHI '19
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)21
  • Downloads (Last 6 weeks)2
Reflects downloads up to 06 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Tangible Affect: A Literature Review of Tangible Interactive Systems Addressing Human Core Affect, Emotions and MoodsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661608(424-440)Online publication date: 1-Jul-2024
  • (2024)Extracting the Affective Content of Fidgeting in Adults with ADHD via Machine Learning and a Hand-held Soft Tangible DeviceExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650856(1-8)Online publication date: 11-May-2024
  • (2024)Touch-text answer for human-robot interaction via supervised adversarial learningExpert Systems with Applications10.1016/j.eswa.2023.122738242(122738)Online publication date: May-2024
  • (2023)A Descriptive Analysis of a Formative Decade of Research in Affective Haptic System DesignProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580735(1-23)Online publication date: 19-Apr-2023
  • (2023)Affect Recognition in Hand-Object Interaction Using Object-Sensed Tactile and Kinematic DataIEEE Transactions on Haptics10.1109/TOH.2022.323064316:1(112-117)Online publication date: 1-Jan-2023
  • (2023)Touch Technology in Affective Human–, Robot–, and Virtual–Human Interactions: A SurveyProceedings of the IEEE10.1109/JPROC.2023.3272780111:10(1333-1354)Online publication date: Oct-2023
  • (2021)Multimodal Emotion Recognition of Hand-Object InteractionProceedings of the 26th International Conference on Intelligent User Interfaces10.1145/3397481.3450636(351-355)Online publication date: 14-Apr-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media