research-article

MoveVR: Enabling Multiform Force Feedback in Virtual Reality using Household Cleaning Robot

Authors:

Zichao (Tyson) Chen,

Tengxiang Zhang,

Yuanchun ShiAuthors Info & Claims

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 12

https://doi.org/10.1145/3313831.3376286

Published: 23 April 2020 Publication History

Abstract

Haptic feedback can significantly enhance the realism and immersiveness of virtual reality (VR) systems. In this paper, we propose MoveVR, a technique that enables realistic, multiform force feedback in VR leveraging commonplace cleaning robots. MoveVR can generate tension, resistance, impact and material rigidity force feedback with multiple levels of force intensity and directions. This is achieved by changing the robot's moving speed, rotation, position as well as the carried proxies. We demonstrated the feasibility and effectiveness of MoveVR through interactive VR gaming. In our quantitative and qualitative evaluation studies, participants found that MoveVR provides more realistic and enjoyable user experience when compared to commercially available haptic solutions such as vibrotactile haptic systems.

Supplemental Material

MP4 File

Download
58.10 MB

MP4 File

Preview video

Download
10.61 MB

MP4 File

Supplemental video

Download
55.34 MB

SRT File

Preview video captions

Download
.67 KB

ZIP File

Video figure captions

Download
2.23 KB

References

[1]

3dsystems. 2017. Touch X. https://www.3dsystems.com/haptics-devices/touch-x. (2017).

[2]

3dsystems. 2019. Phantom Premium Haptic Feedback Device. https://www.3dsystems.com/haptics-devices/ 3d-systems-phantom-premium. (2019).

[3]

Muhammad Abdullah, Minji Kim, Waseem Hassan, Yoshihiro Kuroda, and Seokhee Jeon. 2017. HapticDrone: An Encountered-Type Kinesthetic Haptic Interface with Controllable Force Feedback: Initial Example for 1D Haptic Feedback. In Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, NY, NY, USA, 115--117.

Digital Library

[4]

M. Abdullah, M. Kim, W. Hassan, Y. Kuroda, and S. Jeon. 2018. HapticDrone: An encountered-type kinesthetic haptic interface with controllable force feedback: Example of stiffness and weight rendering. In 2018 IEEE Haptics Symposium (HAPTICS). 334--339.

[5]

Parastoo Abtahi, Benoit Landry, Jackie (Junrui) Yang, Marco Pavone, Sean Follmer, and James A. Landay. 2019. Beyond The Force: Using Quadcopters to Appropriate Objects and the Environment for Haptics in Virtual Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Article 359, 13 pages.

Digital Library

[6]

Bruno Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake Charmer: Physically Enabling Virtual Objects. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, NY, NY, USA, 218--226.

Digital Library

[7]

Akash Badshah, Sidhant Gupta, Daniel Morris, Shwetak Patel, and Desney Tan. 2012. GyroTab: A Handheld Device That Provides Reactive Torque Feedback. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, NY, NY, USA, 3153--3156.

Digital Library

[8]

Grigore C. Burdea. 1996. Force and Touch Feedback for Virtual Reality. John Wiley & Sons, Inc., New York, NY, USA.

Digital Library

[9]

Inrak Choi, Heather Culbertson, Mark R. Miller, Alex Olwal, and Sean Follmer. 2017. Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, NY, NY, USA, 119--130.

Digital Library

[10]

I. Choi, E. W. Hawkes, D. L. Christensen, C. J. Ploch, and S. Follmer. 2016. Wolverine: A wearable haptic interface for grasping in virtual reality. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 986--993.

Digital Library

[11]

Inrak Choi, Eyal Ofek, Hrvoje Benko, Mike Sinclair, and Christian Holz. 2018. CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Article 654, 13 pages.

Digital Library

[12]

A. Frisoli, F. Rocchi, S. Marcheschi, A. Dettori, F. Salsedo, and M. Bergamasco. 2005. A new force-feedback arm exoskeleton for haptic interaction in virtual environments. In First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference. 195--201.

Digital Library

[13]

Antonio Gomes, Calvin Rubens, Sean Braley, and Roel Vertegaal. 2016. BitDrones: Towards Using 3D Nanocopter Displays As Interactive Self-Levitating Programmable Matter. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 770--780.

Digital Library

[14]

Jun Gong, Da-Yuan Huang, Teddy Seyed, Te Lin, Tao Hou, Xin Liu, Molin Yang, Boyu Yang, Yuhan Zhang, and Xing-Dong Yang. 2018. Jetto: Using Lateral Force Feedback for Smartwatch Interactions. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Article 426, 14 pages.

Digital Library

[15]

Xiaochi Gu, Yifei Zhang, Weize Sun, Yuanzhe Bian, Dao Zhou, and Per Ola Kristensson. 2016. Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 1991--1995.

Digital Library

[16]

Zhenyi He, Fengyuan Zhu, Aaron Gaudette, and Ken Perlin. 2017b. Robotic Haptic Proxies for Collaborative Virtual Reality. CoRR abs/1701.08879 (2017). http://arxiv.org/abs/1701.08879

[17]

Zhenyi He, Fengyuan Zhu, and Ken Perlin. 2017a. PhyShare: Sharing Physical Interaction in Virtual Reality. In Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, NY, NY, USA, 17--19.

Digital Library

[18]

Seongkook Heo, Christina Chung, Geehyuk Lee, and Daniel Wigdor. 2018. Thor's Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Article 525, 11 pages.

Digital Library

[19]

M. Hirose, K. Hirota, T. Ogi, H. Yano, N. Kakehi, M. Saito, and M. Nakashige. 2001. HapticGEAR: the development of a wearable force display system for immersive projection displays. In Proceedings IEEE Virtual Reality 2001. 123--129.

[20]

H. Iwata. 1993. Pen-based haptic virtual environment. In Proceedings of IEEE Virtual Reality Annual International Symposium. 287--292.

Digital Library

[21]

Seungzoo Jeong, Naoki Hashimoto, and Sato Makoto. 2004. A Novel Interaction System with Force Feedback Between Real - and Virtual Human: An Entertainment System: "Virtual Catch Ball". In Proceedings of the 2004 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (ACE '04). ACM, NY, NY, USA, 61--66.

Digital Library

[22]

G. Lee, S. Hur, and Y. Oh. 2017. High-Force Display Capability and Wide Workspace With a Novel Haptic Interface. IEEE/ASME Transactions on Mechatronics 22, 1 (Feb 2017), 138--148.

[23]

CyberGlove Systems LLC. 2017. CyberGrasp. http://www.cyberglovesystems.com/cybergrasp/. (2017).

[24]

Azumi Maekawa, Shota Takahashi, MHD Yamen Saraiji, Sohei Wakisaka, Hiroyasu Iwata, and Masahiko Inami. 2019. Naviarm: Augmenting the Learning of Motor Skills Using a Backpack-type Robotic Arm System. In Proceedings of the 10th Augmented Human International Conference 2019 (AH2019). ACM, NY, NY, USA, Article 38, 8 pages.

Digital Library

[25]

W. A. McNeely. 1993. Robotic graphics: a new approach to force feedback for virtual reality. In Proceedings of IEEE Virtual Reality Annual International Symposium. 336--341.

Digital Library

[26]

C. Pacchierotti, S. Sinclair, M. Solazzi, A. Frisoli, V. Hayward, and D. Prattichizzo. 2017. Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives. IEEE Transactions on Haptics 10, 4 (Oct 2017), 580--600.

Digital Library

[27]

Mathias Parger, Joerg H. Mueller, Dieter Schmalstieg, and Markus Steinberger. 2018. Human Upper-Body Inverse Kinematics for Increased Embodiment in Consumer-Grade Virtual Reality. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (VRST'18). Association for Computing Machinery, New York, NY, USA, Article Article 23, 10 pages.

Digital Library

[28]

Jake Rubin. 2017. What Is Haptics? https://haptx.com/what-is-haptics-really/. (2017).

[29]

Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Taiju Aoki, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2018. Transcalibur: Weight Moving VR Controller for Dynamic Rendering of 2D Shape Using Haptic Shape Illusion. In ACM SIGGRAPH 2018 Emerging Technologies (SIGGRAPH '18). ACM, NY, NY, USA, Article 19, 2 pages.

Digital Library

[30]

Alexa F. Siu, Eric J. Gonzalez, Shenli Yuan, Jason B. Ginsberg, and Sean Follmer. 2018. shapeShift: 2D Spatial Manipulation and Self-Actuation of Tabletop Shape Displays for Tangible and Haptic Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Article 291, 13 pages.

Digital Library

[31]

Statista. 2019. Robotic vacuum cleaner unit shipment worldwide from 2015 to 2025. https://www.statista.com/statistics/1022967/worldwide-robotic-vacuum-cleaner-shipment/. (2019).

[32]

Evan Strasnick, Christian Holz, Eyal Ofek, Mike Sinclair, and Hrvoje Benko. 2018. Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Article 644, 12 pages.

Digital Library

[33]

Yuqian Sun, Shigeo Yoshida, Takuji Narumi, and Michitaka Hirose. 2019. PaCaPa: A Handheld VR Device for Rendering Size, Shape, and Stiffness of Virtual Objects in Tool-based Interactions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Article 452, 12 pages.

Digital Library

[34]

Hsin-Ruey Tsai, Jun Rekimoto, and Bing-Yu Chen. 2019. ElasticVR: Providing Multilevel Continuously-Changing Resistive Force and Instant Impact Using Elasticity for VR. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Article 220, 10 pages.

Digital Library

[35]

Dzmitry Tsetserukou, Katsunari Sato, and Susumu Tachi. 2010. ExoInterfaces: Novel Exosceleton Haptic Interfaces for Virtual Reality, Augmented Sport and Rehabilitation. In Proceedings of the 1st Augmented Human International Conference (AH '10). ACM, NY, NY, USA, Article 1, 6 pages.

Digital Library

[36]

H. Yano, M. Yoshie, and H. Iwata. 2003. Development of a non-grounded haptic interface using the gyro effect. In 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings. 32--39.

[37]

Y. Yokokohji, J. Kinoshita, and T. Yoshikawa. 2001. Path planning for encountered-type haptic devices that render multiple objects in 3D space. In Proceedings IEEE Virtual Reality 2001. 271--278.

[38]

A. Zenner and A. KrÃijger. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4 (April 2017), 1285--1294.

Digital Library

Cited By

Gomi RSuzuki RTakashima KFujita KKitamura Y(2024)InflatableBots: Inflatable Shape-Changing Mobile Robots for Large-Scale Encountered-Type Haptics in VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642069(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642069
Hoshikawa YFujita KTakashima KFjeld MKitamura Y(2024)RedirectedDoors+: Door-Opening Redirection with Dynamic Haptics in Room-Scale VRIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337210530:5(2276-2286)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372105
Gao BShao TTu HMa QLiu ZHan T(2024)Exploring Bimanual Haptic Feedback for Spatial Search in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337204530:5(2422-2433)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372045
Show More Cited By

Index Terms

MoveVR: Enabling Multiform Force Feedback in Virtual Reality using Household Cleaning Robot
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Tactile and hand-based interfaces
      1. Haptic devices
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
    2. Interaction paradigms
      1. Virtual reality

Recommendations

Factors of Haptic Feedback in a VR Experience Using Virtual Tools: Evaluating the Impact of Visual and Force Presentation
Virtual, Augmented and Mixed Reality
Abstract
In this study, we explore the factors influencing the generation of haptic feedback during interactions with virtual objects using a rod-shaped tool within a virtual reality environment. Previously, we introduced a haptic feedback method involving ...
Virtual, Augmented, and Mixed Reality for Human-Robot Interaction (VAM-HRI)
HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

The 6th International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interaction (VAM-HRI) will bring together HRI, robotics, and mixed reality researchers to address challenges in mixed reality interactions between humans and robots. ...
Virtual, Augmented, and Mixed Reality for Human-Robot Interaction (VAM-HRI)
HRI '24: Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction

The 7th International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interaction (VAM-HRI) seeks to bring together researchers from human-robot interaction (HRI), robotics, and mixed reality (MR) to address the challenges related to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

10688 pages

ISBN:9781450367080

DOI:10.1145/3313831

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Natural Science Foundation of China
National Key R&D Program of China

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
1,310
Total Downloads

Downloads (Last 12 months)110
Downloads (Last 6 weeks)14

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gomi RSuzuki RTakashima KFujita KKitamura Y(2024)InflatableBots: Inflatable Shape-Changing Mobile Robots for Large-Scale Encountered-Type Haptics in VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642069(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642069
Hoshikawa YFujita KTakashima KFjeld MKitamura Y(2024)RedirectedDoors+: Door-Opening Redirection with Dynamic Haptics in Room-Scale VRIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337210530:5(2276-2286)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372105
Gao BShao TTu HMa QLiu ZHan T(2024)Exploring Bimanual Haptic Feedback for Spatial Search in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337204530:5(2422-2433)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372045
Lu YXu BWang JBu QLeach MSun J(2024)An Autonomous Household Robot for Object Detection and Grasping2024 29th International Conference on Automation and Computing (ICAC)10.1109/ICAC61394.2024.10718843(1-6)Online publication date: 28-Aug-2024
https://doi.org/10.1109/ICAC61394.2024.10718843
Gomi RTakashima KOnishi YFujita KKitamura Y(2023)UbiSurface: A Robotic Touch Surface for Supporting Mid-air Planar Interactions in Room-Scale VRProceedings of the ACM on Human-Computer Interaction10.1145/36264797:ISS(376-397)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626479
Fang CSuzuki RLeithinger D(2023)VR Haptics at Home: Repurposing Everyday Objects and Environment for Casual and On-Demand VR Haptic ExperiencesExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585871(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585871
Mortezapoor SVasylevska KVonach EKaufmann H(2023)CoboDeck: A Large-Scale Haptic VR System Using a Collaborative Mobile Robot2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00045(297-307)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00045
Zhang LLiu YBai HZou QChang ZHe WWang SBillinghurst M(2023)Robot-enabled tangible virtual assembly with coordinated midair object placementRobotics and Computer-Integrated Manufacturing10.1016/j.rcim.2022.10243479:COnline publication date: 1-Feb-2023
https://dl.acm.org/doi/10.1016/j.rcim.2022.102434
Grubert J(2023)Mixed Reality Interaction TechniquesSpringer Handbook of Augmented Reality10.1007/978-3-030-67822-7_5(109-129)Online publication date: 1-Jan-2023
https://doi.org/10.1007/978-3-030-67822-7_5
Mugisha SGuda VChevallereau CZoppi MMolfino RChablat D(2022)Improving Haptic Response for Contextual Human Robot InteractionSensors10.3390/s2205204022:5(2040)Online publication date: 5-Mar-2022
https://doi.org/10.3390/s22052040
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten