demonstration

Demonstrating HapticBots: Distributed Encountered-type Haptics for VR with Multiple Shape-changing Mobile Robots

Authors:

Daniel Leithinger,

Mar Gonzalez-FrancoAuthors Info & Claims

UIST '21 Adjunct: Adjunct Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology

Pages 131 - 133

https://doi.org/10.1145/3474349.3480202

Published: 10 October 2021 Publication History

Abstract

HapticBots introduces a novel encountered-type haptic approach for Virtual Reality (VR) based on multiple tabletop-size shape-changing robots. These robots move on a tabletop and change their height and orientation to haptically render various surfaces and objects on-demand. Compared to previous encountered-type haptic approaches like shape displays or robotic arms, our proposed approach has an advantage in deployability, scalability, and generalizability—these robots can be easily deployed due to their compact form factor. They can support multiple concurrent touch points in a large area thanks to the distributed nature of the robots. We propose and evaluate a novel set of interactions enabled by these robots which include: 1) rendering haptics for VR objects by providing just-in-time touch-points on the user’s hand, 2) simulating continuous surfaces with the concurrent height and position change, and 3) enabling the user to pick up and move VR objects through graspable proxy objects. Finally, we demonstrate HapticBots with various applications, including remote collaboration, education and training, design and 3D modeling, and gaming and entertainment.

References

[1]

Bruno Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake charmer: Physically enabling virtual objects. In Proceedings of the TEI’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. 218–226.

Digital Library

[2]

Zhenyi He, Fengyuan Zhu, and Ken Perlin. 2017. Physhare: Sharing physical interaction in virtual reality. In Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology. 17–19.

Digital Library

[3]

Hiroo Iwata, Hiroaki Yano, Fumitaka Nakaizumi, and Ryo Kawamura. 2001. Project FEELEX: adding haptic surface to graphics. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. 469–476.

Digital Library

[4]

William A McNeely. 1993. Robotic graphics: a new approach to force feedback for virtual reality. In Proceedings of IEEE Virtual Reality Annual International Symposium. IEEE, 336–341.

Digital Library

[5]

Ken Nakagaki, Daniel Fitzgerald, Zhiyao Ma, Luke Vink, Daniel Levine, and Hiroshi Ishii. 2019. inFORCE: Bi-directionalForce’Shape Display for Haptic Interaction. In Proceedings of the thirteenth international conference on tangible, embedded, and embodied interaction. 615–623.

Digital Library

[6]

Ken Nakagaki, Joanne Leong, Jordan L Tappa, João Wilbert, and Hiroshi Ishii. 2020. HERMITS: Dynamically Reconfiguring the Interactivity of Self-Propelled TUIs with Mechanical Shell Add-ons. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 882–896.

Digital Library

[7]

Alexa F Siu, Eric J Gonzalez, Shenli Yuan, Jason B Ginsberg, and Sean Follmer. 2018. Shapeshift: 2D spatial manipulation and self-actuation of tabletop shape displays for tangible and haptic interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[8]

Anthony Steed, Eyal Ofek, Mike Sinclair, and Mar Gonzalez Franco. 2021. A Mechatronic Shape Display based on Auxetic Materials. In Nature Communications.

[9]

Ryo Suzuki, Hooman Hedayati, Clement Zheng, James L Bohn, Daniel Szafir, Ellen Yi-Luen Do, Mark D Gross, and Daniel Leithinger. 2020. Roomshift: Room-scale dynamic haptics for vr with furniture-moving swarm robots. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–11.

Digital Library

[10]

Ryo Suzuki, Ryosuke Nakayama, Dan Liu, Yasuaki Kakehi, Mark D Gross, and Daniel Leithinger. 2020. LiftTiles: constructive building blocks for prototyping room-scale shape-changing interfaces. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction. 143–151.

Digital Library

[11]

Ryo Suzuki, Eyal Ofek, Mike Sinclair, Daniel Leithinger, and Mar Gonzalez Franco. 2021. HapticBots: Distributed Encountered-type Haptics for VR with Multiple Shape-changing Mobile Robots. In Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology.

Digital Library

[12]

Ryo Suzuki, Clement Zheng, Yasuaki Kakehi, Tom Yeh, Ellen Yi-Luen Do, Mark D Gross, and Daniel Leithinger. 2019. Shapebots: Shape-changing swarm robots. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 493–505.

Digital Library

[13]

Shan-Yuan Teng, Cheng-Lung Lin, Chi-huan Chiang, Tzu-Sheng Kuo, Liwei Chan, Da-Yuan Huang, and Bing-Yu Chen. 2019. Tilepop: Tile-type pop-up prop for virtual reality. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 639–649.

Digital Library

[14]

Emanuel Vonach, Clemens Gatterer, and Hannes Kaufmann. 2017. VRRobot: Robot actuated props in an infinite virtual environment. In 2017 IEEE Virtual Reality (VR). IEEE, 74–83.

[15]

Yasuyoshi Yokokohji, Nobuhiko Muramori, Yuji Sato, and Tsuneo Yoshikawa. 2005. Designing an encountered-type haptic display for multiple fingertip contacts based on the observation of human grasping behaviors. The International Journal of Robotics Research 24, 9 (2005), 717–729.

Digital Library

Cited By

Gomi RSuzuki RTakashima KFujita KKitamura Y(2024)InflatableBots: Inflatable Shape-Changing Mobile Robots for Large-Scale Encountered-Type Haptics in VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642069(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642069
Kuang LChinello FGiordano PMarchal MPacchierotti C(2023)Haptic Mushroom: a 3-DoF shape-changing encounter-type haptic device with interchangeable end-effectors2023 IEEE World Haptics Conference (WHC)10.1109/WHC56415.2023.10224373(467-473)Online publication date: 10-Jul-2023
https://doi.org/10.1109/WHC56415.2023.10224373
Mortezapoor SVasylevska KVonach EKaufmann H(2023)CoboDeck: A Large-Scale Haptic VR System Using a Collaborative Mobile Robot2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00045(297-307)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00045
Show More Cited By

Index Terms

Demonstrating HapticBots: Distributed Encountered-type Haptics for VR with Multiple Shape-changing Mobile Robots

Index terms have been assigned to the content through auto-classification.

Recommendations

HapticBots: Distributed Encountered-type Haptics for VR with Multiple Shape-changing Mobile Robots
UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology

HapticBots introduces a novel encountered-type haptic approach for Virtual Reality (VR) based on multiple tabletop-size shape-changing robots. These robots move on a tabletop and change their height and orientation to haptically render various surfaces ...
InflatableBots: Inflatable Shape-Changing Mobile Robots for Large-Scale Encountered-Type Haptics in VR
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

We introduce InflatableBots, shape-changing inflatable robots for large-scale encountered-type haptics in VR. Unlike traditional inflatable shape displays, which are immobile and limited in interaction areas, our approach combines mobile robots with fan-...
Demonstrating VRBox: A Virtual Reality Augmented Sandbox
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

We present VRBox--an interactive sandbox for playful and immersive terraforming that combines the approach of augmented sandboxes with virtual reality technology and mid-air gestures. Our interactive demonstration offers a virtual reality (VR) ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '21 Adjunct: Adjunct Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology

October 2021

182 pages

ISBN:9781450386555

DOI:10.1145/3474349

Editors:
Jeffrey Nichols
Apple, USA
,
Ranjitha Kumar
UIUC, USA
,
Michael Nebeling
University of Michigan, USA

Copyright © 2021 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2021

Check for updates

Author Tags

Qualifiers

Demonstration
Research
Refereed limited

Conference

UIST '21

Sponsor:

UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology

October 10 - 14, 2021

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 355 of 1,733 submissions, 20%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
265
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)2

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gomi RSuzuki RTakashima KFujita KKitamura Y(2024)InflatableBots: Inflatable Shape-Changing Mobile Robots for Large-Scale Encountered-Type Haptics in VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642069(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642069
Kuang LChinello FGiordano PMarchal MPacchierotti C(2023)Haptic Mushroom: a 3-DoF shape-changing encounter-type haptic device with interchangeable end-effectors2023 IEEE World Haptics Conference (WHC)10.1109/WHC56415.2023.10224373(467-473)Online publication date: 10-Jul-2023
https://doi.org/10.1109/WHC56415.2023.10224373
Mortezapoor SVasylevska KVonach EKaufmann H(2023)CoboDeck: A Large-Scale Haptic VR System Using a Collaborative Mobile Robot2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00045(297-307)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00045
Zhu LJiang XShen JZhang HMo YSong A(2022)TapeTouch: A Handheld Shape-changing Device for Haptic Display of Soft ObjectsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320308728:11(3928-3938)Online publication date: Nov-2022
https://doi.org/10.1109/TVCG.2022.3203087
Zamani NCulbertson H(2022)Combining Haptic Augmented Reality with a Stylus-Based Encountered-Type Display to Modify Perceived Hardness2022 IEEE Haptics Symposium (HAPTICS)10.1109/HAPTICS52432.2022.9765601(1-7)Online publication date: 21-Mar-2022
https://doi.org/10.1109/HAPTICS52432.2022.9765601

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten