ABSTRACT
Midair physical prop is a promising tool to facilitate intuitive human-computer interaction in a three-dimensional (3D) space. In such systems, it is challenging to guarantee safety and comfort during interaction with real objects in high-speed 3D motion. In this paper, we propose a balloon interface, a midair physical prop that affords direct single-handed manipulation in a safe manner. The system uses a spherical helium-filled balloon controlled by surrounding ultrasound phased array transducers as a physical prop. It is safe to collide even when it is moving fast because it has an elastic body and does not have any mechanical parts. Fast switching of driving transducer units and closed-loop control based on a high-speed measurement system result in the 3D control of an object of a size that affords a spherical grasp, e.g., a spherical balloon of 10-cm diameter.
Supplemental Material
- Parastoo Abtahi, David Y. Zhao, Jane L. E., and James A. Landay. 2017. Drone Near Me: Exploring Touch-Based Human-Drone Interaction. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 34 (Sept. 2017), 8 pages. https://doi.org/10.1145/3130899Google ScholarDigital Library
- Marco A. B. Andrade, Asier Marzo, and Julio C. Adamowski. 2020. Acoustic levitation in mid-air: Recent advances, challenges, and future perspectives. Applied Physics Letters 116, 25 (2020), 250501. https://doi.org/10.1063/5.0012660 arXiv:https://doi.org/10.1063/5.0012660Google ScholarCross Ref
- Takuro Furumoto, Keisuke Hasegawa, Yasutoshi Makino, and Hiroyuki Shinoda. 2019. Three-Dimensional Manipulation of a Spherical Object Using Ultrasound Plane Waves. IEEE Robotics and Automation Letters 4, 1 (2019), 81–88.Google ScholarCross Ref
- Takuro Furumoto, Mitsuru Ito, Masahiro Fujiwara, Yasutoshi Makino, Hiroyuki Shinoda, and Takaaki Kamigaki. 2019. Three-Dimensional Interaction Technique Using an Acoustically Manipulated Balloon. In SIGGRAPH Asia 2019 Emerging Technologies (Brisbane, QLD, Australia) (SA ’19). Association for Computing Machinery, New York, NY, USA, 51–52. https://doi.org/10.1145/3355049.3360536Google ScholarDigital Library
- Antonio Gomes, Calvin Rubens, Sean Braley, and Roel Vertegaal. 2016. BitDrones: Towards Using 3D Nanocopter Displays as Interactive Self-Levitating Programmable Matter. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 770–780. https://doi.org/10.1145/2858036.2858519Google ScholarDigital Library
- Seki Inoue, Yasutoshi Makino, and Hiroyuki Shinoda. 2016. Scalable Architecture for Airborne Ultrasound Tactile Display. In AsiaHaptics(Lecture Notes in Electrical Engineering). Springer, Singapure, 2035–2040. https://doi.org/10.1007/978-981-10-4157-0_17Google Scholar
- Jinha Lee, Rehmi Post, and Hiroshi Ishii. 2011. ZeroN: Mid-air Tangible Interaction Enabled by Computer Controlled Magnetic Levitation. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology(UIST ’11). ACM, New York, NY, USA, 327–336. https://doi.org/10.1145/2047196.2047239Google ScholarDigital Library
- Michael J. Swain and Dana H. Ballard. 1992. Indexing via Color Histograms. In Active Perception and Robot Vision, Arun K. Sood and Harry Wechsler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 261–273.Google Scholar
- Wataru Yamada, Hiroyuki Manabe, and Daizo Ikeda. 2019. ZeRONE: Safety Drone with Blade-Free Propulsion. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). ACM, New York, NY, USA, Article 365, 8 pages. https://doi.org/10.1145/3290605.3300595Google ScholarDigital Library
Recommendations
Midair Balloon Interface: A Soft and Lightweight Midair Object for Proximate Interactions
UIST '21: The 34th Annual ACM Symposium on User Interface Software and TechnologyThis paper introduces a midair balloon interface, a fast and soft interactive object in mid-air. Our approach tackles the trade-off between safety and speed by controlling a soft helium-filled balloon with external actuators and sensors. We developed a ...
User engagement for mid-air haptic interactions with digital signage
PerDis '19: Proceedings of the 8th ACM International Symposium on Pervasive DisplaysInteractive digital signage is increasingly deployed in urban environments, from airports and train stations, to cinemas and shopping malls, whilst their integration into public spaces introduces new possibilities in multimedia presentation. In this ...
Midair Displays: Concept and First Experiences with Free-Floating Pervasive Displays
PerDis '14: Proceedings of The International Symposium on Pervasive DisplaysDue to advances in technology, displays could replace literally any surface in the future, including walls, windows, and ceilings. At the same time, midair remains a relatively unexplored domain for the use of displays as of today, particularly in ...
Comments