skip to main content
10.1145/3460421.3480390acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
poster

MOTUS: Rendering Emotions with a Wrist-worn Tactile Display

Published: 21 September 2021 Publication History

Abstract

This paper investigates whether tactile texture patterns on the wrists can be interpreted as particular emotions. A prototype watch-back tactile display, MOTUS, was implemented to press different texture patterns in various frequencies onto a wrist to convey emotions. We conducted a preliminary guessability study with the prototype. The result reveals the wearers’ agreement in interpreting the emotional states from the tactile texture patterns.

References

[1]
Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch: High-Fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 717–728. https://doi.org/10.1145/2984511.2984526
[2]
Leonardo Bonanni, Cati Vaucelle, Jeff Lieberman, and Orit Zuckerman. 2006. Taptap: a haptic wearable for asynchronous distributed touch therapy. In CHI’06 extended abstracts on Human factors in computing systems. 580–585.
[3]
Ginevra Castellano, Loic Kessous, and George Caridakis. 2008. Emotion recognition through multiple modalities: face, body gesture, speech. In Affect and emotion in human-computer interaction. Springer, 92–103.
[4]
Jongeun Cha, Mohamad Eid, Lara Rahal, and Abdulmotaleb El Saddik. 2008. HugMe: An interpersonal haptic communication system. In 2008 IEEE International Workshop on Haptic Audio visual Environments and Games. IEEE, 99–102.
[5]
Seungmoon Choi and Katherine J Kuchenbecker. 2012. Vibrotactile display: Perception, technology, and applications. Proc. IEEE 101, 9 (2012), 2093–2104.
[6]
Francisco Esteves and Arne Öhman. 1993. Masking the face: Recognition of emotional facial expressions as a function of the parameters of backward masking. Scandinavian journal of psychology 34, 1 (1993), 1–18.
[7]
Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. InFORM: Dynamic Physical Affordances and Constraints through Shape and Object Actuation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST ’13). Association for Computing Machinery, New York, NY, USA, 417–426. https://doi.org/10.1145/2501988.2502032
[8]
John Hardy, Christian Weichel, Faisal Taher, John Vidler, and Jason Alexander. 2015. ShapeClip: Towards Rapid Prototyping with Shape-Changing Displays for Designers. Association for Computing Machinery, New York, NY, USA, 19–28. https://doi.org/10.1145/2702123.2702599
[9]
Mariam Hassib, Max Pfeiffer, Stefan Schneegass, Michael Rohs, and Florian Alt. 2017. Emotion Actuator: Embodied Emotional Feedback through Electroencephalography and Electrical Muscle Stimulation. Association for Computing Machinery, New York, NY, USA, 6133–6146. https://doi.org/10.1145/3025453.3025953
[10]
Matthew J Hertenstein, Rachel Holmes, Margaret McCullough, and Dacher Keltner. 2009. The communication of emotion via touch.Emotion 9, 4 (2009), 566.
[11]
James S House, Karl R Landis, and Debra Umberson. 1988. Social relationships and health. Science 241, 4865 (1988), 540–545.
[12]
Meng-Ju Hsieh, Rong-Hao Liang, and Bing-Yu Chen. 2016. NailTactors: Eyes-Free Spatial Output Using a Nail-Mounted Tactor Array. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (Florence, Italy) (MobileHCI ’16). Association for Computing Machinery, New York, NY, USA, 29–34. https://doi.org/10.1145/2935334.2935358
[13]
Yuhan Hu and Guy Hoffman. 2019. Using skin texture change to design emotion expression in social robots. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 2–10.
[14]
Da-Yuan Huang, Ruizhen Guo, Jun Gong, Jingxian Wang, John Graham, De-Nian Yang, and Xing-Dong Yang. 2017. RetroShape: Leveraging rear-surface shape displays for 2.5 D interaction on smartwatches. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. 539–551.
[15]
Alexandra Ion, Edward Jay Wang, and Patrick Baudisch. 2015. Skin Drag Displays: Dragging a Physical Tactor across the User’s Skin Produces a Stronger Tactile Stimulus than Vibrotactile. Association for Computing Machinery, New York, NY, USA, 2501–2504. https://doi.org/10.1145/2702123.2702459
[16]
Seungwoo Je, Minkyeong Lee, Yoonji Kim, Liwei Chan, Xing-Dong Yang, and Andrea Bianchi. 2018. PokeRing: Notifications by Poking Around the Finger. Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3173574.3174116
[17]
Shinobu Kuroki, Hiroyuki Kajimoto, Hideaki Nii, Naoki Kawakami, and Susumu Tachi. 2007. Proposal for tactile sense presentation that combines electrical and mechanical stimulus. In Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC’07). IEEE, 121–126.
[18]
Jaeyeon Lee, Jaehyun Han, and Geehyuk Lee. 2015. Investigating the Information Transfer Efficiency of a 3x3 Watch-Back Tactile Display. Association for Computing Machinery, New York, NY, USA, 1229–1232. https://doi.org/10.1145/2702123.2702530
[19]
Yi-Chi Liao, Yi-Ling Chen, Jo-Yu Lo, Rong-Hao Liang, Liwei Chan, and Bing-Yu Chen. 2016. EdgeVib: Effective Alphanumeric Character Output Using a Wrist-Worn Tactile Display. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology(Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 595–601. https://doi.org/10.1145/2984511.2984522
[20]
Yi-Chi Liao, Shun-Yao Yang, Rong-Hao Liang, Liwei Chan, and Bing-Yu Chen. 2015. ThirdHand: Wearing a Robotic Arm to Experience Rich Force Feedback. In SIGGRAPH Asia 2015 Emerging Technologies (Kobe, Japan) (SA ’15). Association for Computing Machinery, New York, NY, USA, Article 24, 1 pages. https://doi.org/10.1145/2818466.2818487
[21]
Henning Pohl and Kasper Hornbæk. 2018. ElectricItch: Skin Irritation as a Feedback Modality. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 765–778. https://doi.org/10.1145/3242587.3242647
[22]
Majken K Rasmussen, Esben W Pedersen, Marianne G Petersen, and Kasper Hornbæk. 2012. Shape-changing interfaces: a review of the design space and open research questions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 735–744.
[23]
Alexia Demertzis Rothman and Stephen Nowicki. 2004. A measure of the ability to identify emotion in children’s tone of voice. Journal of Nonverbal Behavior 28, 2 (2004), 67–92.
[24]
AF Rovers and Harm A van ESSEN. 2004. HIM: A framework for haptic instant messaging. In CHI’04 Extended Abstracts on Human Factors in Computing Systems. 1313–1316.
[25]
James Russell. 1980. A Circumplex Model of Affect. Journal of Personality and Social Psychology 39, 1161–1178. https://doi.org/10.1037/h0077714
[26]
Dzmitry Tsetserukou. 2010. Haptihug: A novel haptic display for communication of hug over a distance. In International Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, 340–347.
[27]
Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-Defined Gestures for Surface Computing. Association for Computing Machinery, New York, NY, USA, 1083–1092. https://doi.org/10.1145/1518701.1518866
[28]
Yongjae Yoo, Taekbeom Yoo, Jihyun Kong, and Seungmoon Choi. 2015. Emotional responses of tactile icons: Effects of amplitude, frequency, duration, and envelope. In 2015 IEEE World Haptics Conference (WHC). IEEE, 235–240.

Cited By

View all
  • (2024)Functional Now, Wearable Later: Examining the Design Practices of Wearable TechnologistsProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676615(71-81)Online publication date: 5-Oct-2024
  • (2023)Pulse Wave Generation Method for PPG by Using DisplayIEEE Access10.1109/ACCESS.2023.326086211(31199-31211)Online publication date: 2023
  • (2023)The Dark Side of Augmented Reality: Exploring Manipulative Designs in ARInternational Journal of Human–Computer Interaction10.1080/10447318.2023.218879940:13(3449-3464)Online publication date: 27-Mar-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ISWC '21: Proceedings of the 2021 ACM International Symposium on Wearable Computers
September 2021
220 pages
ISBN:9781450384629
DOI:10.1145/3460421
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 September 2021

Check for updates

Author Tags

  1. Shape display
  2. emotions
  3. guessability
  4. smartwatch
  5. tactile patterns

Qualifiers

  • Poster
  • Research
  • Refereed limited

Conference

UbiComp '21

Acceptance Rates

Overall Acceptance Rate 38 of 196 submissions, 19%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)46
  • Downloads (Last 6 weeks)1
Reflects downloads up to 10 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Functional Now, Wearable Later: Examining the Design Practices of Wearable TechnologistsProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676615(71-81)Online publication date: 5-Oct-2024
  • (2023)Pulse Wave Generation Method for PPG by Using DisplayIEEE Access10.1109/ACCESS.2023.326086211(31199-31211)Online publication date: 2023
  • (2023)The Dark Side of Augmented Reality: Exploring Manipulative Designs in ARInternational Journal of Human–Computer Interaction10.1080/10447318.2023.218879940:13(3449-3464)Online publication date: 27-Mar-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media