Teng Han
Tovi Grossman
ABSTRACT
Current haptic devices are often bulky and rigid, making them unsuitable for ubiquitous interaction and scenarios where the user must also interact with the real world. To address this gap, we propose HydroRing, an unobtrusive, finger-worn device that can provide the tactile sensations of pressure, vibration, and temperature on the fingertip, enabling mixed-reality haptic interactions. Different from previous explorations, HydroRing in active mode delivers sensations using liquid travelling through a thin, flexible latex tube worn across the fingerpad, and has minimal impact on a user's dexterity and their perception of stimuli in passive mode. Two studies evaluated participants' ability to perceive and recognize sensations generated by the device, as well as their ability to perceive physical stimuli while wearing the device. We conclude by exploring several applications leveraging this mixed-reality haptics approach.
Supplemental Material
- Merwan Achibet, Benoît Le Gouis, Maud Marchal, et al. 2017. FlexiFingers: Multi-finger interaction in VR combining passive haptics and pseudo-haptics. 3D User Interfaces (3DUI), 2017 IEEE Symposium on, IEEE, 103--106.Google Scholar
- Evan Ackerman. 2018. Cyberdyne's Medical Exoskeleton Strides to FDA Approval. IEEE Spectrum: Technology, Engineering, and Science News. Retrieved April 4, 2018 from https://spectrum.ieee.org/the-human-os/biomedical/devices/cyberdynes-medical-exoskeleton-strides-to-fda-approvalGoogle Scholar
- Hideyuki Ando, Eisuke Kusachi, and Junji Watanabe. 2007. Nail-mounted tactile display for boundary/texture augmentation. Proceedings of the international conference on Advances in computer entertainment technology, ACM, 292--293. Google ScholarDigital Library
- Hideyuki Ando, Takeshi Miki, Masahiko Inami, and Taro Maeda. 2002. The nail-mounted tactile display for the behavior modeling. ACM SIGGRAPH 2002 conference abstracts and applications, ACM, 264--264. Google ScholarDigital Library
- Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. Normaltouch and texturetouch: High-fidelity 3d haptic shape rendering on handheld virtual reality controllers. Proceedings of the 29th Annual Symposium on User Interface Software and Technology, ACM, 717--728. Google ScholarDigital Library
- Carlos Bermejo and Pan Hui. 2017. A survey on haptic technologies for mobile augmented reality. arXiv:1709.00698 {cs}. Retrieved December 12, 2017 from http://arxiv.org/abs/1709.00698Google Scholar
- Matteo Bianchi, Edoardo Battaglia, Mattia Poggiani, Simone Ciotti, and Antonio Bicchi. 2016. A wearable fabric-based display for haptic multi-cue delivery. Haptics Symposium (HAPTICS), 2016 IEEE, IEEE, 277--283.Google ScholarCross Ref
- Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013. UltraHaptics: multi-point mid-air haptic feedback for touch surfaces. Proceedings of the 26th annual ACM symposium on User interface software and technology, ACM, 505--514. Google ScholarDigital Library
- Francesco Chinello, Monica Malvezzi, Claudio Pacchierotti, and Domenico Prattichizzo. 2015. Design and development of a 3RRS wearable fingertip cutaneous device. Advanced Intelligent Mechatronics (AIM), 2015 IEEE International Conference on, IEEE, 293--298.Google ScholarCross Ref
- Inrak Choi, Heather Culbertson, Mark R. Miller, Alex Olwal, and Sean Follmer. 2017. Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality. Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, ACM, 119--130. Google ScholarDigital Library
- Inrak Choi, Elliot W. Hawkes, David L. Christensen, Christopher J. Ploch, and Sean Follmer. 2016. Wolverine: A wearable haptic interface for grasping in virtual reality. Intelligent Robots and Systems (IROS), 2016 IEEE/RSJ International Conference on, IEEE, 986--993.Google ScholarDigital Library
- Joo ChuanáYeo and Chwee TeckáLim. 2016. Emergence of microfluidic wearable technologies. Lab on a Chip 16, 21: 4082--4090.Google Scholar
- Gareth Edwards. 2016. Rogue One: A Star Wars Story. Retrieved April 4, 2018 from http://www.imdb.com/title/tt3748528/Google Scholar
- Yuan-Ling Feng, Charith Lasantha Fernando, Jan Rod, and Kouta Minamizawa. 2017. Submerged haptics: a 3-DOF fingertip haptic display using miniature 3D printed airbags. ACM SIGGRAPH 2017 Emerging Technologies, ACM, 22. Google ScholarDigital Library
- Sean Follmer, Daniel Leithinger, Alex Olwal, Nadia Cheng, and Hiroshi Ishii. 2012. Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices. Proceedings of the 25th annual ACM symposium on User interface software and technology, ACM, 519--528. Google ScholarDigital Library
- Antonio Frisoli, Massimiliano Solazzi, Fabio Salsedo, and Massimo Bergamasco. 2008. A fingertip haptic display for improving curvature discrimination. Presence: Teleoperators and Virtual Environments 17, 6: 550--561. Google ScholarDigital Library
- Brian T. Gleeson, Scott K. Horschel, and William R. Provancher. 2010. Design of a fingertip-mounted tactile display with tangential skin displacement feedback. IEEE Transactions on Haptics 3, 4: 297--301. Google ScholarDigital Library
- Xiaochi Gu, Yifei Zhang, Weize Sun, Yuanzhe Bian, Dao Zhou, and Per Ola Kristensson. 2016. Dexmo: An inexpensive and lightweight mechanical exoskeleton for motion capture and force feedback in VR. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ACM, 1991--1995. Google ScholarDigital Library
- Morton A. Heller. 2013. The psychology of touch. Psychology Press.Google Scholar
- Steven J. Henderson and Steven K. Feiner. 2002. Augmented Reality for Maintenance and Repair (ARMAR). DTIC Document. Retrieved December 4, 2012 from http://oai.dtic.mil/oai/oai?verb=getRecord&metadataPrefix=html&identifier=ADA436321Google Scholar
- Christian Holz, Tovi Grossman, George Fitzmaurice, and Anne Agur. 2012. Implanted User Interfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), ACM, 503--512. Google ScholarDigital Library
- Hyunki In, Brian Byunghyun Kang, MinKi Sin, and Kyu-Jin Cho. 2015. Exo-Glove: a wearable robot for the hand with a soft tendon routing system. IEEE Robotics & Automation Magazine 22, 1: 97--105.Google ScholarCross Ref
- Adafruit Industries. Peristaltic Liquid Pump with Silicone Tubing. Retrieved April 4, 2018 from https://www.adafruit.com/product/1150Google Scholar
- Adafruit Industries. Adafruit Motor/Stepper/Servo Shield for Arduino v2 Kit. Retrieved April 4, 2018 from https://www.adafruit.com/product/1438Google Scholar
- Yvonne Jansen, Thorsten Karrer, and Jan Borchers. 2010. MudPad: localized tactile feedback on touch surfaces. Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology, ACM, 385--386. Google ScholarDigital Library
- Hirokazu Kato and Mark Billinghurst. 1999. Marker tracking and hmd calibration for a video-based augmented reality conferencing system. Augmented Reality, 1999.(IWAR'99) Proceedings. 2nd IEEE and ACM International Workshop on, IEEE, 85--94. Google ScholarDigital Library
- Hwan Kim, Minhwan Kim, and Woohun Lee. 2016. Hapthimble: A wearable haptic device towards usable virtual touch screen. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ACM, 3694--3705. Google ScholarDigital Library
- Seoktae Kim, Hyunjung Kim, Boram Lee, Tek-Jin Nam, and Woohun Lee. 2008. Inflatable mouse: volume-adjustable mouse with air-pressure-sensitive input and haptic feedback. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 211--224. Google ScholarDigital Library
- Susan J. Lederman, Georgie Thorne, and Bill Jones. 1986. Perception of texture by vision and touch: Multidimensionality and intersensory integration. Journal of Experimental Psychology: Human Perception and Performance 12, 2: 169.Google ScholarCross Ref
- Jaeyeon Lee and Geehyuk Lee. 2016. Designing a Non-contact Wearable Tactile Display Using Airflows. Proceedings of the 29th Annual Symposium on User Interface Software and Technology, ACM, 183--194. Google ScholarDigital Library
- Robert W. Lindeman, Yasuyuki Yanagida, Haruo Noma, and Kenichi Hosaka. 2006. Wearable vibrotactile systems for virtual contact and information display. Virtual Reality 9, 2--3: 203--213.Google ScholarDigital Library
- Yanju Liu, Rob Davidson, and Paul Taylor. 2005. Touch sensitive electrorheological fluid based tactile display. Smart materials and structures 14, 6: 1563.Google Scholar
- Yanju Liu, Rob Davidson, and Paul Taylor. 2005. Investigation of the touch sensitivity of ER fluid based tactile display. Smart Structures and Materials 2005: Smart Structures and Integrated Systems, International Society for Optics and Photonics, 92--100.Google Scholar
- Pedro Lopes, Alexandra Ion, You, Sijing, and Patrick Baudisch. 2018. Adding Force Feedback to Mixed Reality Experiences and Games using Electrical Muscle Stimulation. Google ScholarDigital Library
- Qiuyu Lu, Chengpeng Mao, Liyuan Wang, and Haipeng Mi. 2016. Lime: Liquid metal interfaces for non-rigid interaction. Proceedings of the 29th Annual Symposium on User Interface Software and Technology, ACM, 449--452. Google ScholarDigital Library
- Steve Mann, Michael Georgas, and Ryan Janzen. 2006. Water jets as pixels: Water fountains as both sensors and displays. Multimedia, 2006. ISM'06. Eighth IEEE International Symposium on, IEEE, 766--772. Google ScholarDigital Library
- Paul Milgram and Fumio Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems 77, 12: 1321--1329.Google Scholar
- Kouta Minamizawa, Souichiro Fukamachi, Hiroyuki Kajimoto, Naoki Kawakami, and Susumu Tachi. 2007. Gravity grabber: wearable haptic display to present virtual mass sensation. ACM SIGGRAPH 2007 emerging technologies, ACM, 8. Google ScholarDigital Library
- Vincent Miralles, Axel Huerre, Florent Malloggi, and Marie-Caroline Jullien. 2013. A review of heating and temperature control in microfluidic systems: techniques and applications. Diagnostics 3, 1: 33--67.Google ScholarCross Ref
- Takaki Murakami, Tanner Person, Charith Lasantha Fernando, and Kouta Minamizawa. 2017. Altered touch: miniature haptic display with force, thermal and tactile feedback for augmented haptics. ACM SIGGRAPH 2017 Posters, ACM, 53. Google ScholarDigital Library
- Nam-Trung Nguyen and Steven T. Wereley. 2002. Fundamentals and applications of microfluidics. Artech house.Google Scholar
- Ryuma Niiyama, Lining Yao, and Hiroshi Ishii. 2014. Weight and volume changing device with liquid metal transfer. Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction, ACM, 49--52. Google ScholarDigital Library
- Claudio Pacchierotti, Gionata Salvietti, Irfan Hussain, Leonardo Meli, and Domenico Prattichizzo. 2016. The hRing: A wearable haptic device to avoid occlusions in hand tracking. Haptics Symposium (HAPTICS), 2016 IEEE, IEEE, 134--139.Google ScholarCross Ref
- Claudio Pacchierotti, Stephen Sinclair, Massimiliano Solazzi, Antonio Frisoli, Vincent Hayward, and Domenico Prattichizzo. 2017. Wearable haptic systems for the fingertip and the hand: Taxonomy, review, and perspectives. IEEE transactions on haptics 10, 4: 580--600. Google ScholarDigital Library
- Henning Pohl, Peter Brandes, Hung Ngo Quang, and Michael Rohs. 2017. Squeezeback: Pneumatic Compression for Notifications. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ACM, 5318--5330. Google ScholarDigital Library
- Hendrik Richter, Felix Manke, and Moriel Seror. 2013. LiquiTouch: liquid as a medium for versatile tactile feedback on touch surfaces. Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction, ACM, 315--318. Google ScholarDigital Library
- Martin Schmitz, Andreas Leister, Niloofar Dezfuli, Jan Riemann, Florian Müller, and Max Mühlhäuser. 2016. Liquido: Embedding Liquids into 3D Printed Objects to Sense Tilting and Motion. Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, ACM, 2688--2696. Google ScholarDigital Library
- Samuel B. Schorr and Allison M. Okamura. 2017. Fingertip tactile devices for virtual object manipulation and exploration. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ACM, 3115--3119. Google ScholarDigital Library
- Dan Sheadel. 2018. MiniPID-Java: PID controller designed for quickly and easily implementing stable closed loop control. Retrieved April 4, 2018 from https://github.com/tekdemo/MiniPID-JavaGoogle Scholar
- Calle Sjöström. 2001. Using haptics in computer interfaces for blind people. CHI'01 extended abstracts on Human Factors in Computing Systems, ACM, 245--246. Google ScholarDigital Library
- Rajinder Sodhi, Ivan Poupyrev, Matthew Glisson, and Ali Israr. 2013. AIREAL: interactive tactile experiences in free air. ACM Transactions on Graphics (TOG) 32, 4: 134. Google ScholarDigital Library
- Naoyuki Takesue, Junji Furusho, and Yuuki Kiyota. 2004. Fast response MR-fluid actuator. JSME International Journal Series C Mechanical Systems, Machine Elements and Manufacturing 47, 3: 783--791.Google Scholar
- Dzmitry Tsetserukou, Shotaro Hosokawa, and Kazuhiko Terashima. 2014. LinkTouch: A wearable haptic device with five-bar linkage mechanism for presentation of two-DOF force feedback at the fingerpad. Haptics Symposium (HAPTICS), 2014 IEEE, IEEE, 307--312.Google Scholar
- S. Tung, J.-W. Kim, A. Malshe, C. C. Lee, and R. Pooran. 2003. A cellular motor driven microfluidic system. TRANSDUCERS, Solid-State Sensors, Actuators and Microsystems, 12th International Conference on, 2003, IEEE, 678--681.Google Scholar
- Marynel Vázquez, Eric Brockmeyer, Ruta Desai, Chris Harrison, and Scott E. Hudson. 2015. 3d printing pneumatic device controls with variable activation force capabilities. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 1295--1304. Google ScholarDigital Library
- George M. Whitesides. 2006. The origins and the future of microfluidics. Nature 442, 7101: 368.Google Scholar
- Lining Yao, Ryuma Niiyama, Jifei Ou, Sean Follmer, Clark Della Silva, and Hiroshi Ishii. 2013. PneUI: pneumatically actuated soft composite materials for shape changing interfaces. Proceedings of the 26th annual ACM symposium on User interface software and Technology, ACM, 13--22. Google ScholarDigital Library
- 2018. Drip chamber. Wikipedia. Retrieved April 4, 2018 from https://en.wikipedia.org/w/index.php?title=Drip_chamber&oldid=824568517Google Scholar
- Ford Pilots New Exoskeleton Technology to Help Lessen Chance of Worker Fatigue, Injury | Ford Media Center. Retrieved April 4, 2018 from https://media.ford.com/content/fordmedia/fna/us/en/news/2017/11/09/ford-exoskeleton-technology-pilot.htmlGoogle Scholar
- Solenoid Valve DC for Makeblock robot kit - STEM / DIY electronic robot Parts. Retrieved July 4, 2018 from https://store.makeblock.com/solenoid-valve-dc-12v-0520eGoogle Scholar
- SparkFun Pressure Sensor Breakout - MS5803--14BA - SEN-12909 - SparkFun Electronics. Retrieved July 5, 2018 from https://www.sparkfun.com/products/12909Google Scholar
- Digital Non-Contact Infrared Thermometer (MLX90614) #Melexis. Retrieved July 5, 2018 from https://www.melexis.com/en/product/MLX90614/Digital-Plug-Play-Infrared-Thermometer-TO-CanGoogle Scholar
- Force Sensitive Resistor - Small - SEN-09673 - SparkFun Electronics. Retrieved July 5, 2018 from https://www.sparkfun.com/products/9673Google Scholar
- Digital plug & play infrared thermometer in a TO-can. Melexis. Retrieved April 4, 2018 from https://www.melexis.com/en/product/mlx90614/digital-plug-play-infrared-thermometer-to-canGoogle Scholar
Index Terms
- HydroRing: Supporting Mixed Reality Haptics Using Liquid Flow
Recommendations
Adding Force Feedback to Mixed Reality Experiences and Games using Electrical Muscle Stimulation
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsWe present a mobile system that enhances mixed reality experiences and games with force feedback by means of electrical muscle stimulation (EMS). The benefit of our approach is that it adds physical forces while keeping the users' hands free to interact ...
Do you feel what you see? Multimodal perception in virtual reality
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and TechnologyThis paper discusses how different physically existing materials can be mapped on virtual textures in mixed reality environments by carrying out an explorative user study (n=101). For physical materials-in form of 3d trackable and moveable cubes-acrylic,...
AoEs: enhancing teleportation experience in immersive environment with mid-air haptics
SIGGRAPH '17: ACM SIGGRAPH 2017 Emerging TechnologiesTo alleviate cybersickness in the immersive virtual reality (VR), teleportation is a common method of moving around in virtual spaces. Although users can receive the visual and auditory feedbacks from their first-person perspective with the advances of ...
Comments