Evan Strasnick
Jackie Yang
Alex Olwal
ABSTRACT
Currently, virtual (i.e. touchscreen) controls are dynamic, but lack the advantageous tactile feedback of physical controls. Similarly, devices may also have dedicated physical controls, but they lack the flexibility to adapt for different contexts and applications. On mobile and wearable devices in particular, space constraints further limit our input and output capabilities. We propose utilizing reconfigurable tactile elements around the edge of a mobile device to enable dynamic physical controls and feedback. These tactile elements can be used for physical touch input and output, and can reposition according to the application both around the edge of and hidden within the device. We present shiftIO, two implementations of such a system which actuate physical controls around the edge of a mobile device using magnetic locomotion. One version utilizes PCB-manufactured electromagnetic coils, and the other uses switchable permanent magnets. We perform a technical evaluation of these prototypes and compare their advantages in various applications. Finally, we demonstrate several mobile applications which leverage shiftIO to create novel mobile interactions.
Supplemental Material
- Kota Amano and Akio Yamamoto. 2012. Tangible interactions on a flat panel display using actuated paper sheets. In Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces. ACM, 351--354. Google Scholar
Digital Library
- Olivier Bau, Ivan Poupyrev, Ali Israr, and Chris Harrison. 2010. TeslaTouch: electrovibration for touch surfaces. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 283--292. Google ScholarDigital Library
- Patrick Baudisch and Gerry Chu. 2009. Back-of-device Interaction Allows Creating Very Small Touch Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, NY, NY, USA, 1923--1932. Google ScholarDigital Library
- Gábor Blaskó and Steven Feiner. 2004. Single-handed Interaction Techniques for Multiple Pressure-sensitive Strips. In CHI '04 Extended Abstracts on Human Factors in Computing Systems (CHI EA '04). ACM, NY, NY, USA, 1461--1464. Google ScholarDigital Library
- Stephen Brewster, Faraz Chohan, and Lorna Brown. 2007. Tactile Feedback for Mobile Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, NY, NY, USA, 159--162. Google ScholarDigital Library
- Alex Butler, Shahram Izadi, and Steve Hodges. 2008. SideSight: Multi-"Touch" Interaction Around Small Devices. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08). ACM, NY, NY, USA, 201--204. Google ScholarDigital Library
- David Cappelleri, Dimitrios Efthymiou, Ashesh Goswami, Nikolaos Vitoroulis, and Michael Zavlanos. 2014. Towards mobile microrobot swarms for additive micromanufacturing. International Journal of Advanced Robotic Systems 11 (2014).Google ScholarCross Ref
- Craig Michael Ciesla and Micah B Yairi. 2012. Tactus User interface system. (April 10 2012). US Patent 8,154,527.Google Scholar
- Ronald S Fearing. 1996. A planar milli-robot system on an air bearing. In Robotics Research. Springer, 570--581.Google Scholar
- John Hardy, Christian Weichel, Faisal Taher, John Vidler, and Jason Alexander. 2015. ShapeClip: Towards Rapid Prototyping with Shape-Changing Displays for Designers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 19--28. Google ScholarDigital Library
- Chris Harrison and Scott E Hudson. 2009. Providing dynamically changeable physical buttons on a visual display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 299--308. Google ScholarDigital Library
- Fabian Hemmert, Gesche Joost, André Knörig, and Reto Wettach. 2008. Dynamic knobs: shape change as a means of interaction on a mobile phone. In CHI'08 Extended Abstracts on Human Factors in Computing Systems. ACM, 2309--2314. Google ScholarDigital Library
- David Holman, Andreas Hollatz, Amartya Banerjee, and Roel Vertegaal. 2013. Unifone: Designing for Auxiliary Finger Input in One-handed Mobile Interactions. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, NY, NY, USA, 177--184. Google ScholarDigital Library
- Sungjae Hwang, Myungwook Ahn, and Kwang-yun Wohn. 2013. MagGetz: customizable passive tangible controllers on and around conventional mobile devices. In Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, 411--416. Google ScholarDigital Library
- Hiroshi Ishii and Brygg Ullmer. 1997. Tangible bits: towards seamless interfaces between people, bits and atoms. In Proceedings of the ACM SIGCHI Conference on Human factors in computing systems. ACM, 234--241. Google ScholarDigital Library
- Sungjune Jang, Lawrence H. Kim, Kesler Tanner, Hiroshi Ishii, and Sean Follmer. 2016. Haptic Edge Display for Mobile Tactile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 3706--3716. Google ScholarDigital Library
- Yvonne Jansen, Pierre Dragicevic, and Jean-Daniel Fekete. 2012. Tangible Remote Controllers for Wall-size Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, NY, NY, USA, 2865--2874. Google ScholarDigital Library
- Wuming Jing, Nicholas Pagano, and David J Cappelleri. 2013. A novel micro-scale magnetic tumbling microrobot. Journal of Micro-Bio Robotics 8, 1 (2013), 1--12.Google ScholarCross Ref
- Ara Nerses Knaian. 2010. Electropermanent magnetic connectors and actuators: devices and their application in programmable matter. Ph.D. Dissertation. Massachusetts Institute of Technology.Google Scholar
- Mathieu Le Goc, Lawrence H. Kim, Ali Parsaei, Jean-Daniel Fekete, Pierre Dragicevic, and Sean Follmer. 2016. Zooids: Building Blocks for Swarm User Interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, NY, NY, USA, 97--109. Google ScholarDigital Library
- Joseph Luk, Jerome Pasquero, Shannon Little, Karon MacLean, Vincent Levesque, and Vincent Hayward. 2006. A Role for Haptics in Mobile Interaction: Initial Design Using a Handheld Tactile Display Prototype. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). ACM, NY, NY, USA, 171--180. Google ScholarDigital Library
- David Meeker. 2014. Finite Element Method Magnets. (2014). http://www.femm.info/wiki Accessed Aug. 2016.Google Scholar
- Gian Pangaro, Dan Maynes-Aminzade, and Hiroshi Ishii. 2002. The Actuated Workbench: Computer-controlled Actuation in Tabletop Tangible Interfaces. In Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (UIST '02). ACM, NY, NY, USA, 181--190. Google ScholarDigital Library
- J. Pasquero, J. Luk, V. Levesque, Qi Wang, V. Hayward, and K.E. MacLean. 2007. Haptically Enabled Handheld Information Display With Distributed Tactile Transducer. Multimedia, IEEE Transactions on 9, 4 (June 2007), 746--753. Google ScholarDigital Library
- James Patten and Hiroshi Ishii. 2007. Mechanical Constraints As Computational Constraints in Tabletop Tangible Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, NY, NY, USA, 809--818. Google ScholarDigital Library
- Esben Warming Pedersen and Kasper Hornbæk. 2011. Tangible Bots: Interaction with Active Tangibles in Tabletop Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, NY, NY, USA, 2975--2984. Google ScholarDigital Library
- Ron Pelrine. 1992. Magnetically levitated apparatus. (March 24 1992). US Patent 5,099,216.Google Scholar
- Ron Pelrine, Annjoe Wong-Foy, Brian McCoy, Dennis Holeman, Rich Mahoney, Greg Myers, Jim Herson, and Tony Low. 2012. Diamagnetically levitated robots: An approach to massively parallel robotic systems with unusual motion properties. In Robotics and Automation (ICRA), 2012 IEEE International Conference on. IEEE, 739--744.Google ScholarCross Ref
- Ivan Poupyrev and Shigeaki Maruyama. 2003. Tactile interfaces for small touch screens. In Proceedings of the 16th annual ACM symposium on User interface software and technology. ACM, 217--220. Google ScholarDigital Library
- Simon Robinson, Céline Coutrix, Jennifer Pearson, Juan Rosso, Matheus Fernandes Torquato, Laurence Nigay, and Matt Jones. 2016. Emergeables: Deformable Displays for Continuous Eyes-Free Mobile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 3793--3805. Google ScholarDigital Library
- Dan Rosenfeld, Michael Zawadzki, Jeremi Sudol, and Ken Perlin. 2004. Physical objects as bidirectional user interface elements. Computer Graphics and Applications, IEEE 24, 1 (2004), 44--49. Google ScholarDigital Library
- Evan Strasnick and Sean Follmer. 2016. Applications of Switchable Permanent Magnetic Actuators in Shape Change and Tactile Display. In Proceedings of the 29th Annual ACM Symposium on User Interface Software and Technology (UIST '16). ACM, Tokyo, Japan, 4. Google ScholarDigital Library
- John Tiab and Kasper Hornbæk. 2016. Understanding Affordance, System State, and Feedback in Shape-Changing Buttons. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2752--2763. Google ScholarDigital Library
- Eone Time. 2016. Eone Bradley tactile watch. (2016). https://www.eone-time.comGoogle Scholar
- Nicolas Villar and Hans Gellersen. 2007. A malleable control structure for softwired user interfaces. In Proceedings of the 1st international conference on Tangible and embedded interaction. ACM, 49--56. Google ScholarDigital Library
- Akira Wakita, Akito Nakano, and Nobuhiro Kobayashi. 2011. Programmable blobs: a rheologic interface for organic shape design. In Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction. ACM, 273--276. Google ScholarDigital Library
- Malte Weiss, Florian Schwarz, Simon Jakubowski, and Jan Borchers. 2010. Madgets: Actuating Widgets on Interactive Tabletops. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (UIST '10). ACM, NY, NY, USA, 293--302. Google ScholarDigital Library
- Malte Weiss, Chat Wacharamanotham, Simon Voelker, and Jan Borchers. 2011. FingerFlux: near-surface haptic feedback on tabletops. In Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, 615--620. Google ScholarDigital Library
Index Terms
- shiftIO: Reconfigurable Tactile Elements for Dynamic Affordances and Mobile Interaction
Recommendations
Haptic Edge Display for Mobile Tactile Interaction
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsCurrent mobile devices do not leverage the rich haptic channel of information that our hands can sense, and instead focus primarily on touch based graphical interfaces. Our goal is to enrich the user experience of these devices through bi-directional ...
Stylus-Based Tele-Touch System using a Surface Acoustic Wave Tactile Display
In this study, the authors focus on active touch by a stylus and reproduction of its sensation. Using the stylus, they can recognize the texture of an object surface through a stylus vibration according to the touch. Introducing a concept "Tele-touch," ...
Methods for Presenting Braille Characters on a Mobile Device with a Touchscreen and Tactile Feedback
Three novel interaction methods were designed for reading six-dot Braille characters from the touchscreen of a mobile device. A prototype device with a piezoelectric actuator embedded under the touchscreen was used to create tactile feedback. The three ...
Comments