Abstract
When refining or personalizing a design, we count on being able to modify or move an element by changing its parameters rather than creating it anew in a different form or location—a standard utility in graphic and auditory authoring tools. Similarly, we need to tune vibrotactile sensations to fit new use cases, distinguish members of communicative icon sets, and personalize items. For tactile vibration display, however, we lack knowledge of the human perceptual mappings that must underlie such tools. Based on evidence that affective dimensions are a natural way to tune vibrations for practical purposes, we attempted to manipulate perception along three emotion dimensions (agitation, liveliness, and strangeness) using engineering parameters of hypothesized relevance. Results from two user studies show that an automatable algorithm can increase a vibration’s perceived agitation and liveliness to different degrees via signal energy, while increasing its discontinuity or randomness makes it more strange. These continuous mappings apply across diverse base vibrations; the extent of achievable emotion change varies. These results illustrate the potential for developing vibrotactile emotion controls as efficient tuning for designers and end-users.
- Audacity. 2015. Audacity software. Retrieved January 24, 2015 from http://audacity.sourceforge.net/.Google Scholar
- Jan O. Blom and Andrew F. Monk. 2003. Theory of personalization of appearance: Why users personalize their pcs and mobile phones. J. Hum.-Comput. Interact. 18, 3 (2003), 193--228. Google ScholarDigital Library
- Lorna M. Brown, Stephen A. Brewster, and Helen C. Purchase. 2006. Tactile crescendos and sforzandos: Applying musical techniques to tactile icon design. In CHI’06 Extended Abstracts on Human Factors in Computing Systems (CHI EA’6). 610--615. Google ScholarDigital Library
- L. Brunet, C. Megard, S. Paneels, G. Changeon, J. Lozada, M. P. Daniel, and F. Darses. 2013. Invitation to the voyage: The design of tactile metaphors to fulfill occasional travelers’ needs in transportation networks. In Proceedings of the IEEE World Haptics Conference (WHC’13). 259--264.Google Scholar
- Andrew Chan, Karon MacLean, and Joanna McGrenere. 2008. Designing haptic icons to support collaborative turn-taking. Int. J. Hum.-Comput. Stud. 66, 5 (2008), 333--355. Google ScholarDigital Library
- W. J. Conover and Ronald L. Iman. 1981. Rank transformations as a bridge between parametric and nonparametric statistics. Am. Stat. 35, 3 (1981), 124--129.Google Scholar
- EAI. 2015. Engineering Acoustics, Inc. Retrieved January 24, 2015 from http://www.atactech.com/PR_tactors.html.Google Scholar
- Martin Evening. 2013. The Adobe Photoshop Lightroom 5 Book: The Complete Guide for Photographers. Pearson Education.Google Scholar
- Google. 2016. Google Play Music. Retrieved October 21, 2016 from play.google.com/music/listen#/now.Google Scholar
- Matthew J. Hertenstein and Sandra J. Weiss. 2011. The Handbook of Touch: Neuroscience, Behavioral, and Health Perspectives. Springer Publishing Company.Google Scholar
- Eve Hoggan and Stephen Brewster. 2007. Designing audio and tactile crossmodal icons for mobile devices. In Proceedings of the 9th ACM International Conference on Multimodal Interfaces (ICMI’07). 162--169. Google ScholarDigital Library
- Instagram. 2016. Instagram. Retrieved October 21, 2016 from https://www.instagram.com/?hl&equal;en.Google Scholar
- Ali Israr, Siyan Zhao, Kaitlyn Schwalje, Roberta Klatzky, and Jill Lehman. 2014. Feel effects: Enriching storytelling with haptic feedback. ACM Trans. Appl. Percept. 11, 3 (2014), 11:1--11:17. Google ScholarDigital Library
- Emilia Koskinen, Topi Kaaresoja, and Pauli Laitinen. 2008. Feel-good touch: Finding the most pleasant tactile feedback for a mobile touch screen button. In Proceedings of the 10th International Conference on Multimodal Interfaces (ICMI’08). ACM, New York, NY, 297--304. Google ScholarDigital Library
- Dae H. Kwak, Galen E. Clavio, Andrea N. Eagleman, and Ki T. Kim. 2010. Exploring the antecedents and consequences of personalizing sport video game experiences. Sport Market. Quart. 19, 4 (12 2010), 217--225.Google Scholar
- Jaebong Lee, J. Ryu, and S. Choi. 2009. Vibrotactile score: A score metaphor for designing vibrotactile patterns. In Proceedings of the IEEE World Haptics Conference (WHC’09). 302--307. Google ScholarDigital Library
- Henry Lieberman, Fabio Paternò, Markus Klann, and Volker Wulf. 2006. End-user development: An emerging paradigm. In End User Development. Springer, 1--8.Google Scholar
- Wendy E. Mackay. 1991. Triggers and barriers to customizing software. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI’91). 153--160. http://dl.acm.org/citation.cfm?id&equal;108867 Google ScholarDigital Library
- Karon E. MacLean, Oliver Schneider, and Hasti Seifi. 2017. Multisensory haptic interactions:Understanding the sense and designing for It. In The Handbook of Multimodal-Multisensor Interfaces. ACM Books. Google ScholarDigital Library
- Sampada Marathe and S. Shyam Sundar. 2011. What drives customization?: Control or identity? In Proceedings of ACM SIGCHI Conference on Human Factors in Computing Systems (CHI’11). 781--790. http://dl.acm.org/citation.cfm?id&equal;1979056 Google ScholarDigital Library
- Francis McGlone, Ake B. Vallbo, Hakan Olausson, Line Loken, and Johan Wessberg. 2007. Discriminative touch and emotional touch. Can. J. Exp. Psychol. 61, 3 (2007), 173.Google ScholarCross Ref
- Joanna McGrenere, Ronald M. Baecker, and Kellogg S. Booth. 2007. A field evaluation of an adaptable two-interface design for feature-rich software. ACM Trans. Comput.-Hum. Interact. 14, 1 (2007), 3. Google ScholarDigital Library
- MoodFuse. 2016. MoodFuse. Retrieved October 21, 2016 from moodfuse.com.Google Scholar
- Musicovery. 2016. Musicovery. Retrieved October 21, 2016 from http://musicovery.com/.Google Scholar
- Piia Nurkka. 2013. “Nobody other than me knows what i want”: Customizing a sports watch. In Proceedings of the Conference on Human-Computer Interaction (INTERACT’13). Lecture Notes in Computer Science, vol. 8120. Springer, Berlin, 384--402.Google ScholarCross Ref
- Uran Oh and Leah Findlater. 2013. The challenges and potential of end-user gesture customization. In Proceedings of Athe CM SIGCHI Conference on Human Factors in Computing Systems (CHI’13). 1129--1138. http://dl.acm.org/citation.cfm?id&equal;2466145 Google ScholarDigital Library
- Conor O’Sullivan and Angela Chang. 2006. An Activity Classification for Vibrotactile Phenomena. Springer, Berlin, 145--156. Google ScholarDigital Library
- Olli Parviainen. 2016. SoundTouch Algorithm. Retrieved September 24, 2016 from http://www.surina.net/soundtouch/.Google Scholar
- Mark Paterson. 2007. The Senses of Touch: Haptics, Affects and Technologies. Berg.Google Scholar
- Photoshop. 2016. Adobe Photoshop. Retrieved October 23, 2016 from https://www.adobe.com/ca/products/photoshop.html.Google Scholar
- Propellerhead. 2016. Figure, on Google Play Store. Retrieved October 21, 2016 from https://www.propellerheads.se/products/figure/manual/introduction/.Google Scholar
- Jonghyun Ryu, Jaemin Chun, Gunhyuk Park, Seungmoon Choi, and Sung H. Han. 2010. Vibrotactile feedback for information delivery in the vehicle. IEEE Trans. Haptics 3, 2 (Apr. 2010), 138--149. Google ScholarDigital Library
- Greg Saul, Manfred Lau, Jun Mitani, and Takeo Igarashi. 2011. SketchChair: An all-in-one chair design system for end users. In Proceedings of the 5th ACM International Conference on Tangible, Embedded, and Embodied Interaction (TEI’11). 73--80. Google ScholarDigital Library
- Oliver S. Schneider, Ali Israr, and Karon E. MacLean. 2015. Tactile animation by direct manipulation of grid displays. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST’15). 21--30. Google ScholarDigital Library
- Oliver S. Schneider and Karon E. MacLean. 2014. Improvising design with a haptic instrument. In Proceedings of the IEEE Haptics Symposium (HAPTICS’14). 327--332.Google Scholar
- Oliver S. Schneider and Karon E. MacLean. 2016. Studying design process and example use with macaron, a web-based vibrotactile effect editor. In Proceedings of the IEEE Haptics Symposium (HAPTICS’16). 52--58.Google Scholar
- Oliver S. Schneider, Hasti Seifi, Salma Kashani, Matthew Chun, and Karon E. MacLean. 2016. HapTurk: Crowdsourcing affective ratings of vibrotactile icons. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI’16). 3248--3260. Google ScholarDigital Library
- Hasti Seifi, Chamila Anthonypillai, and Karon E. MacLean. 2014. End-user customization of affective tactile messages: A qualitative examination of tool parameters. In Proceedings of IEEE Haptics Symposium (HAPTICS’14). 251--256.Google Scholar
- Hasti Seifi and Karon E. MacLean. 2017. Exploiting haptic facets: Users’ sensemaking schemas as a path to design and personalization of experience (unpublished).Google Scholar
- Hasti Seifi, Kailun Zhang, and Karon E. MacLean. 2015. VibViz: Organizing, visualizing and navigating vibration libraries. In Proceedings of the IEEE World Haptics Conference (WHC’15). 254--259.Google Scholar
- Snapseed. 2016. Snapseed, on Google Play Store. Retrieved October 21, 2016 from https://itunes.apple.com/ca/app/snapseed/id439438619?mt&equal;8.Google Scholar
- Diane Tam, Karon E. MacLean, Joanna McGrenere, and Katherine J. Kuchenbecker. 2013. The design and field observation of a haptic notification system for timing awareness during oral presentations. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI’13). ACM, New York, NY, 1689--1698. Google ScholarDigital Library
- David Ternes and Karon E. Maclean. 2008. Designing large sets of haptic icons with rhythm. In Haptics: Perception, Devices and Scenarios. Springer, 199--208. Google ScholarDigital Library
- Jan B. F. van Erp and Michiel M. A. Spapé. 2003. Distilling the underlying dimensions of tactile melodies. In Proceedings of Eurohaptics, Vol. 2003. 111--120.Google Scholar
- Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). ACM, 143--146. Google ScholarDigital Library
- Yongjae Yoo, Taekbeom Yoo, Jihyun Kong, and Seungmoon Choi. 2015. Emotional responses of tactile icons: Effects of amplitude, frequency, duration, and envelope. In Proceedings of the IEEE World Haptics Conference (WHC’15). 235--240.Google Scholar
- Siyan Zhao, Oliver Schneider, Roberta Klatzky, Jill Lehman, and Ali Israr. 2014. FeelCraft: Crafting tactile experiences for media using a feel effect library. In Proceedings of the Adjunct Publication of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST’14). ACM, New York, NY, 51--52. Google ScholarDigital Library
- Ying Zheng and John B. Morrell. 2012. Haptic actuator design parameters that influence affect and attention. In Proceedings of the IEEE Haptics Symposium (HAPTICS’12). IEEE, 463--470.Google Scholar
Index Terms
- Toward Affective Handles for Tuning Vibrations
Recommendations
The Impact of Thermal Cues on Affective Responses to Emotionally Resonant Vibrations
ICMI '22: Proceedings of the 2022 International Conference on Multimodal InteractionThis paper investigates how presenting emotionally resonant vibrotactile stimuli at cool, neutral and warm temperature levels impacts mean ratings for emotional resonance and affective response. Affective vibrotactile stimuli can elicit pleasant or ...
Affective Haptics and Multimodal Experiments Research
Human-Computer Interaction. Multimodal and Natural InteractionAbstractTouch plays a significant role in emotion communication, and affective haptics are becoming an emerging field in terms of designing and implementing multimodal experience in human-computer interactions. The present study explores the affective ...
Intensifying Emotional Reactions via Tactile Gestures in Immersive Films
The film industry continuously strives to make visitors’ movie experience more immersive and thus, more captivating. This is realized through larger screens, sophisticated speaker systems, and high quality 2D and 3D content. Moreover, a recent trend in ...
Comments