skip to main content
10.1145/3411764.3445543acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

MagnetIO: Passive yet Interactive Soft Haptic Patches Anywhere

Published: 07 May 2021 Publication History

Abstract

We propose a new type of haptic actuator, which we call MagnetIO, that is comprised of two parts: one battery-powered voice-coil worn on the user's fingernail and any number of interactive soft patches that can be attached onto any surface (everyday objects, user's body, appliances, etc.). When the user's finger wearing our voice-coil contacts any of the interactive patches it detects its magnetic signature via magnetometer and vibrates the patch, adding haptic feedback to otherwise input-only interactions. To allow these passive patches to vibrate, we make them from silicone with regions doped with polarized neodymium powder, resulting in soft and stretchable magnets. This stretchable form-factor allows them to be wrapped to the user's body or everyday objects of various shapes. We demonstrate how these add haptic output to many situations, such as adding haptic buttons to the walls of one's home. In our technical evaluation, we demonstrate that our interactive patches can be excited across a wide range of frequencies (0-500 Hz) and can be tuned to resonate at specific frequencies based on the patch's geometry. Furthermore, we demonstrate that MagnetIO's vibration intensity is as powerful as a typical linear resonant actuator (LRA); yet, unlike these rigid actuators, our passive patches operate as springs with multiple modes of vibration, which enables a wider band around its resonant frequency than an equivalent LRA.

References

[1]
Agharese, N. 2018. HapWRAP: Soft Growing Wearable Haptic Device. 2018 IEEE International Conference on Robotics and Automation (ICRA) (Brisbane, QLD, May 2018), 5466–5472.
[2]
Akther, A. 2019. Miniaturised acoustofluidic tactile haptic actuator. Soft Matter. 15, 20 (2019), 4146–4152.
[3]
Alexander, J. 2018. Grand Challenges in Shape-Changing Interface Research. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18 (Montreal QC, Canada, 2018), 1–14.
[4]
Almansouri, A.S. 2019. An Imperceptible Magnetic Skin. Advanced Materials Technologies. (Aug. 2019), 1900493.
[5]
Baltzis, K.B. 2010. The finite element method magnetics (FEMM) freeware package: May it serve as an educational tool in teaching electromagnetics? Education and Information Technologies. 15, 1 (Mar. 2010), 19–36.
[6]
Blevins, R.D. 2001. Formulas for natural frequency and mode shape. Krieger Publishing.
[7]
Boem, A. and Troiano, G.M. 2019. Non-Rigid HCI: A Review of Deformable Interfaces and Input. Proceedings of the 2019 on Designing Interactive Systems Conference - DIS ’19 (San Diego, CA, USA, 2019), 885–906.
[8]
Boldu, R. 2019. M-Hair: Creating Novel Tactile Feedback by Augmenting the Body Hair to Respond to Magnetic Field. Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology - UIST ’19 (New Orleans, LA, USA, 2019), 323–328.
[9]
Boys, H. 2018. Soft wearable non-vibratory tactile displays. 2018 IEEE International Conference on Soft Robotics (RoboSoft) (Livorno, Italy, Apr. 2018), 270–275.
[10]
Dandekar, K. 2003. 3-D Finite-Element Models of Human and Monkey Fingertips to Investigate the Mechanics of Tactile Sense. Journal of Biomechanical Engineering. 125, 5 (Oct. 2003), 682–691.
[11]
De Rossi, D. 2011. Electroactive polymer patches for wearable haptic interfaces. 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Boston, MA, Aug. 2011), 8369–8372.
[12]
Dhiab, A.B. and Hudin, C. 2019. Confinement of Vibrotactile Stimuli in Narrow Plates. 2019 IEEE World Haptics Conference (WHC) (Tokyo, Japan, Jul. 2019), 431–436.
[13]
Fails, J.A. and Olsen, D. Light Widgets: Interacting in Every-day Spaces. 7.
[14]
Gong, N.-W. 2014. PrintSense: a versatile sensing technique to support multimodal flexible surface interaction. Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI ’14 (Toronto, Ontario, Canada, 2014), 1407–1410.
[15]
Groeger, D. 2019. Tactlets: Adding Tactile Feedback to 3D Objects Using Custom Printed Controls. Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans LA USA, Oct. 2019), 923–936.
[16]
Groeger, D. and Steimle, J. 2018. ObjectSkin: Augmenting Everyday Objects with Hydroprinted Touch Sensors and Displays. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 1, 4 (Jan. 2018), 1–23.
[17]
Gummeson, J. 2017. RFID Light Bulb: Enabling Ubiquitous Deployment of Interactive RFID Systems. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 1, 2 (Jun. 2017), 1–16.
[18]
Haines, C.S. 2014. Artificial Muscles from Fishing Line and Sewing Thread. Science. 343, 6173 (Feb. 2014), 868–872.
[19]
Han, T. 2020. HapBead: On-Skin Microfluidic Haptic Interface using Tunable Bead. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu HI USA, Apr. 2020), 1–10.
[20]
Han, T. 2018. HydroRing: Supporting Mixed Reality Haptics Using Liquid Flow. The 31st Annual ACM Symposium on User Interface Software and Technology - UIST ’18 (Berlin, Germany, 2018), 913–925.
[21]
Harrison, C. 2012. Acoustic barcodes: passive, durable and inexpensive notched identification tags. Proceedings of the 25th annual ACM symposium on User interface software and technology - UIST ’12 (Cambridge, Massachusetts, USA, 2012), 563.
[22]
Harrison, C. and Hudson, S.E. 2008. Scratch input: creating large, inexpensive, unpowered and mobile finger input surfaces. Proceedings of the 21st annual ACM symposium on User interface software and technology - UIST ’08 (Monterey, CA, USA, 2008), 205.
[23]
Hellebrekers, T. 2019. Soft Magnetic Skin for Continuous Deformation Sensing. Advanced Intelligent Systems. 1, 4 (Aug. 2019), 1900025.
[24]
Holland, S. 2002. Direct Combination: A New User Interaction Principle for Mobile and Ubiquitous HCI. Human Computer Interaction with Mobile Devices. F. Paternò, ed. Springer Berlin Heidelberg. 108–122.
[25]
Hu, W. 2018. Small-scale soft-bodied robot with multimodal locomotion. Nature. 554, 7690 (Feb. 2018), 81–85.
[26]
Iyer, V. 2017. 3D printing wireless connected objects. ACM Transactions on Graphics. 36, 6 (Nov. 2017), 1–13.
[27]
Jansen, Y. 2010. MudPad: localized tactile feedback on touch surfaces. Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (2010), 385–386.
[28]
Lopes, P. 2011. Augmenting touch interaction through acoustic sensing. Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces - ITS ’11 (Kobe, Japan, 2011), 53.
[29]
Lum, G.Z. 2016. Shape-programmable magnetic soft matter. Proceedings of the National Academy of Sciences. 113, 41 (Oct. 2016), E6007–E6015.
[30]
Mazursky, A. 2020. A compact and compliant electrorheological actuator for generating a wide range of haptic sensations. Smart Materials and Structures. (Jan. 2020).
[31]
Mazursky, A. 2019. Design, modeling, and evaluation of a slim haptic actuator based on electrorheological fluid. Journal of Intelligent Material Systems and Structures. (Mar. 2019), 1045389X1983617.
[32]
McIntosh, J. 2019. Magnetips: Combining Fingertip Tracking and Haptic Feedback for Around-Device Interaction. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19 (Glasgow, Scotland Uk, 2019), 1–12.
[33]
Merzouki, R. ed. 2013. Intelligent mechatronic systems: modeling, control and diagnosis. Springer.
[34]
Miruchna, V. 2015. GelTouch: Localized Tactile Feedback Through Thin, Programmable Gel. Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST ’15 (Daegu, Kyungpook, Republic of Korea, 2015), 3–10.
[35]
Nittala, A.S. 2018. Multi-Touch Skin: A Thin and Flexible Multi-Touch Sensor for On-Skin Input. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18 (Montreal QC, Canada, 2018), 1–12.
[36]
Nittala, A.S. PhysioSkin: Rapid Fabrication of Skin-Conformal Physiological Interfaces. 10.
[37]
Olberding, S. 2015. Foldio: Digital Fabrication of Interactive and Shape-Changing Objects With Foldable Printed Electronics. Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST ’15 (Daegu, Kyungpook, Republic of Korea, 2015), 223–232.
[38]
Ono, M. 2013. Touch & activate: adding interactivity to existing objects using active acoustic sensing. Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST ’13 (St. Andrews, Scotland, United Kingdom, 2013), 31–40.
[39]
Paradiso, J.A. 2000. Sensor systems for interactive surfaces. IBM Systems Journal. 39, 3.4 (2000), 892–914.
[40]
Pece, F. 2017. MagTics: Flexible and Thin Form Factor Magnetic Actuators for Dynamic and Wearable Haptic Feedback. Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology - UIST ’17 (Québec City, QC, Canada, 2017), 143–154.
[41]
Poupyrev, I. 2002. Ambient touch: designing tactile interfaces for handheld devices. Proceedings of the 15th annual ACM symposium on User interface software and technology (2002), 51–60.
[42]
Poupyrev, I. and Maruyama, S. 2003. Tactile Interfaces for Small Touch Screens. Proceedings of the 16th annual ACM symposium on User interface software and technology (2003), 217–220.
[43]
Qamar, I.P.S. 2018. HCI meets material science: a literature review of morphing materials for the design of shape-changing interfaces. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18 (2018), 1–23.
[44]
Rizzo, R. 2018. Shape Localization and Recognition Using a Magnetorheological-Fluid Haptic Display. IEEE Transactions on Haptics. 11, 2 (Apr. 2018), 317–321.
[45]
Sato, M. 2012. Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI ’12 (Austin, Texas, USA, 2012), 483.
[46]
Savage, V. 2012. Midas: fabricating custom capacitive touch sensors to prototype interactive objects. Proceedings of the 25th annual ACM symposium on User interface software and technology - UIST ’12 (Cambridge, Massachusetts, USA, 2012), 579.
[47]
Sekiguchi, Y. 2005. The Design and Implementation of Ubiquitous Haptic Device. First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (Pisa, Italy, 2005), 527–528.
[48]
Son, H. 2019. RealWalk: Haptic Shoes Using Actuated MR Fluid for Walking in VR. 2019 IEEE World Haptics Conference (WHC) (Tokyo, Japan, Jul. 2019), 241–246.
[49]
Sörös, G. 2015. Fast blur removal for wearable QR code scanners. Proceedings of the 2015 ACM International Symposium on Wearable Computers - ISWC ’15 (Osaka, Japan, 2015), 117–124.
[50]
Steimle, J. 2009. Designing pen-and-paper user interfaces for interaction with documents. Proceedings of the 3rd International Conference on Tangible and Embedded Interaction - TEI ’09 (Cambridge, United Kingdom, 2009), 197.
[51]
Strasnick, E. 2017. shiftIO: Reconfigurable Tactile Elements for Dynamic Affordances and Mobile Interaction. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI ’17 (Denver, Colorado, USA, 2017), 5075–5086.
[52]
Strohmeier, P. and McIntosh, J. 2020. Novel Input and Output opportunities using an Implanted Magnet. Proceedings of the Augmented Humans International Conference (Kaiserslautern Germany, Mar. 2020), 1–5.
[53]
Teng, C.-H. and Wu, B.-S. 2012. Developing QR Code Based Augmented Reality Using SIFT Features. 2012 9th International Conference on Ubiquitous Intelligence and Computing and 9th International Conference on Autonomic and Trusted Computing (Fukuoka, Japan, Sep. 2012), 985–990.
[54]
Teng, S.-Y. 2018. PuPoP: Pop-up Prop on Palm for Virtual Reality. The 31st Annual ACM Symposium on User Interface Software and Technology - UIST ’18 (Berlin, Germany, 2018), 5–17.
[55]
Tsimeris, J. 2013. ForceForm: a dynamically deformable interactive surface. Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces - ITS ’13 (St. Andrews, Scotland, United Kingdom, 2013), 175–178.
[56]
Unknown 2003. The actuated workbench: computer-controlled actuation in tabletop tangible interfaces. ACM SIGGRAPH 2003 Papers on - SIGGRAPH ’03 (San Diego, California, 2003), 699.
[57]
Vázquez, M. 2015. 3D Printing Pneumatic Device Controls with Variable Activation Force Capabilities. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI ’15 (Seoul, Republic of Korea, 2015), 1295–1304.
[58]
Verrillo, R.T. 1992. Vibration Sensation in Humans. Music Perception. 9, 3 (Apr. 1992), 281–302.
[59]
Wang, F. and Ren, X. 2009. Empirical evaluation for finger input properties in multi-touch interaction. Proceedings of the 27th international conference on Human factors in computing systems - CHI 09 (Boston, MA, USA, 2009), 1063.
[60]
Want, R. 2004. Enabling ubiquitous sensing with RFID. Computer. 37, 4 (Apr. 2004), 84–86.
[61]
Weigel, M. 2015. iSkin: Flexible, Stretchable and Visually Customizable On-Body Touch Sensors for Mobile Computing. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI ’15 (Seoul, Republic of Korea, 2015), 2991–3000.
[62]
Weiser, M. The Computer for the 21st Century. 8.
[63]
Weiss, M. 2011. FingerFlux: near-surface haptic feedback on tabletops. Proceedings of the 24th annual ACM symposium on User interface software and technology - UIST ’11 (Santa Barbara, California, USA, 2011), 615.
[64]
Wessely, M. 2020. Sprayable User Interfaces: Prototyping Large-Scale Interactive Surfaces with Sensors and Displays. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu HI USA, Apr. 2020), 1–12.
[65]
Wimmer, R. and Baudisch, P. 2011. Modular and deformable touch-sensitive surfaces based on time domain reflectometry. Proceedings of the 24th annual ACM symposium on User interface software and technology - UIST ’11 (Santa Barbara, California, USA, 2011), 517.
[66]
Xiao, R. WorldKit: Rapid and Easy Creation of Ad-hoc Interactive Applications on Everyday Surfaces. 10.
[67]
Xing, Z.-W. 2015. A laminated magnetorheological elastomer bearing prototype for seismic mitigation of bridge superstructures. Journal of Intelligent Material Systems and Structures. 26, 14 (Sep. 2015), 1818–1825.
[68]
Xu, T. 2019. Millimeter-scale flexible robots with programmable three-dimensional magnetization and motions. Science Robotics. 4, 29 (Apr. 2019), eaav4494.
[69]
Yang, T.H. and Koo, J.H. 2017. Experimental evaluation of a miniature MR device for a wide range of human perceivable haptic sensations. Smart Materials and Structures. 26, 12 (2017), 1–12.
[70]
Yasu, K. 2019. Magnetact: Magnetic-sheet-based Haptic Interfaces for Touch Devices. (2019), 8.
[71]
Yasu, K. 2017. Magnetic Plotter: A Macrotexture Design Method Using Magnetic Rubber Sheets. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI ’17 (Denver, Colorado, USA, 2017), 4983–4993.
[72]
Yasu, K. and Katsumoto, Y. 2015. Bump ahead: easy-to-design haptic surface using magnet array. SIGGRAPH Asia 2015 Emerging Technologies on - SA ’15 (Kobe, Japan, 2015), 1–3.
[73]
Yatani, K. and Truong, K.N. 2009. SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices. Proceedings of the 22nd annual ACM symposium on User interface software and technology - UIST ’09 (Victoria, BC, Canada, 2009), 111.
[74]
Yoon, S.H. 2019. HapSense: A Soft Haptic I/O Device with Uninterrupted Dual Functionalities of Force Sensing and Vibrotactile Actuation. Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans LA USA, Oct. 2019), 949–961.
[75]
Zhang, Y. 2017. Electrick: Low-Cost Touch Sensing Using Electric Field Tomography. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI ’17 (Denver, Colorado, USA, 2017), 1–14.
[76]
Zhang, Y. 2018. Wall++: Room-Scale Interactive and Context-Aware Sensing. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18 (Montreal QC, Canada, 2018), 1–15.
[77]
Zhao, H. 2020. A Wearable Soft Haptic Communicator Based on Dielectric Elastomer Actuators. Soft Robotics. (Jan. 2020), soro.2019.0113.
[78]
Zheng, C. 2019. Mechamagnets: Designing and Fabricating Haptic and Functional Physical Inputs with Embedded Magnets. Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction - TEI ’19 (Tempe, Arizona, USA, 2019), 325–334.
[79]
Zheng, C. and Do, E.Y.-L. 2018. Mechamagnets: Tactile Mechanisms with Embedded Magnets. Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction - TEI ’18 (Stockholm, Sweden, 2018), 57–64.

Cited By

View all
  • (2025)ReactFold: Towards Camera-based Tangible Interaction on Passive Paper ArtifactsProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704926(1-12)Online publication date: 4-Mar-2025
  • (2024)Understanding the Effects of Restraining Finger Coactivation in Mid-Air Typing: from a Neuromechanical PerspectiveProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676441(1-18)Online publication date: 13-Oct-2024
  • (2024)MagneDot: Integrated Fabrication and Actuation Methods of Dot-Based Magnetic Shape DisplaysProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676427(1-18)Online publication date: 13-Oct-2024
  • Show More Cited By

Index Terms

  1. MagnetIO: Passive yet Interactive Soft Haptic Patches Anywhere
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
      May 2021
      10862 pages
      ISBN:9781450380966
      DOI:10.1145/3411764
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 07 May 2021

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. fabrication
      2. soft magnets
      3. ubiquitous haptics

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      CHI '21
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

      Upcoming Conference

      CHI 2025
      ACM CHI Conference on Human Factors in Computing Systems
      April 26 - May 1, 2025
      Yokohama , Japan

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)369
      • Downloads (Last 6 weeks)56
      Reflects downloads up to 22 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)ReactFold: Towards Camera-based Tangible Interaction on Passive Paper ArtifactsProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704926(1-12)Online publication date: 4-Mar-2025
      • (2024)Understanding the Effects of Restraining Finger Coactivation in Mid-Air Typing: from a Neuromechanical PerspectiveProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676441(1-18)Online publication date: 13-Oct-2024
      • (2024)MagneDot: Integrated Fabrication and Actuation Methods of Dot-Based Magnetic Shape DisplaysProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676427(1-18)Online publication date: 13-Oct-2024
      • (2024)MagPixel: Modular Toolkit for Designing Interactive Magnetic Shape DisplaysExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650901(1-6)Online publication date: 11-May-2024
      • (2024)Reconfigurable Interfaces by Shape Change and Embedded MagnetsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642802(1-12)Online publication date: 11-May-2024
      • (2024)AirPush: A Pneumatic Wearable Haptic Device Providing Multi-Dimensional Force Feedback on a FingertipProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642536(1-13)Online publication date: 11-May-2024
      • (2024)Stick&Slip: Altering Fingerpad Friction via Liquid CoatingsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642299(1-14)Online publication date: 11-May-2024
      • (2024)Haptic Permeability: Adding Holes to Tactile Devices Improves DexterityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642156(1-12)Online publication date: 11-May-2024
      • (2024)ThermalGrasp: Enabling Thermal Feedback even while Grasping and Walking2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00056(342-353)Online publication date: 16-Mar-2024
      • (2024)DynaButtons: Fast Interactive Soft Buttons with Analog Control2024 IEEE Haptics Symposium (HAPTICS)10.1109/HAPTICS59260.2024.10520864(366-371)Online publication date: 7-Apr-2024
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media