Motohiro Makiguchi
ABSTRACT
Many methods have been proposed for presenting digital information in mirror space. However, most existing methods can only display digital information in mirror space. Therefore, we study the concept of MiTAI (Mirror-Transcending Aerial Imaging), which allows for the continuous movement of digital information between mirrors and physical space. MiTAI provides a novel interactive experience combining mirrors, physical space, and digital information. In this paper, we present the first systemization of MiTAI that users can experience, as well as an initial study toward a concept evaluation of MiTAI. We describe an implementation of the system in detail, including an optical follow-up of the previous study, the design of the control system, the presentation of content, and a method for interacting with the aerial image. The implemented system provided a MiTAI viewing experience for approximately 150 attendees through a hands-on demonstration exhibit and had a strong impact on them. We also report on user feedback from the exhibition and future improvements.
Supplemental Material
- 1991. Beauty and the Beast.Google Scholar
- Hrvoje Benko and Andrew D. Wilson. 2010. Pinch-the-Sky Dome: Freehand Multi-Point Interactions with Immersive Omni-Directional Data. In CHI ’10 Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI EA ’10). Association for Computing Machinery, New York, NY, USA, 3045–3050. https://doi.org/10.1145/1753846.1753915Google ScholarDigital Library
- Lewis Carroll. 2010. Through the looking glass and what Alice found there. Penguin UK.Google Scholar
- Kaori Fujinami, Fahim Kawsar, and Tatsuo Nakajima. 2005. AwareMirror: A Personalized Display Using a Mirror. In Pervasive Computing, Hans W. Gellersen, Roy Want, and Albrecht Schmidt (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 315–332.Google Scholar
- Jacob Grimm and Wilhelm K Grimm. 1991. Snow white. Andrews McMeel Publishing.Google Scholar
- Fatma Ben Guefrech, Florent Berthaut, Patricia Plénacoste, Yvan Peter, and Laurent Grisoni. 2021. Revealable Volume Displays: 3D Exploration of Mixed-Reality Public Exhibitions. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 31–39. https://doi.org/10.1109/VR50410.2021.00023Google ScholarCross Ref
- Takayuki Hoshi, Masafumi Takahashi, Kei Nakatsuma, and Hiroyuki Shinoda. 2009. Touchable Holography. In ACM SIGGRAPH 2009 Emerging Technologies (New Orleans, Louisiana) (SIGGRAPH ’09). Association for Computing Machinery, New York, NY, USA, Article 23, 1 pages. https://doi.org/10.1145/1597956.1597979Google ScholarDigital Library
- Rachel Jacobs, Holger Schnädelbach, Nils Jäger, Silvia Leal, Robin Shackford, Steve Benford, and Roma Patel. 2019. The Performative Mirror Space. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300630Google ScholarDigital Library
- Norio Kato and Takeshi Naemura. 2006. Mixed Reality Environment with a Mirror. In ACM SIGGRAPH 2006 Research Posters (Boston, Massachusetts) (SIGGRAPH ’06). Association for Computing Machinery, New York, NY, USA, 155–es. https://doi.org/10.1145/1179622.1179801Google ScholarDigital Library
- Hajime Katsumoto, Hajime Kajita, Naoya Koizumi, and Takeshi Naemura. 2016. HoVerTable PONG: Playing Face-to-Face Game on Horizontal Tabletop with Moving Vertical Mid-Air Image. In Proceedings of the 13th International Conference on Advances in Computer Entertainment Technology (Osaka, Japan) (ACE ’16). Association for Computing Machinery, New York, NY, USA, Article 50, 6 pages. https://doi.org/10.1145/3001773.3001820Google ScholarDigital Library
- Hanyuool Kim, Issei Takahashi, Hiroki Yamamoto, Satoshi Maekawa, and Takeshi Naemura. 2014. MARIO: Mid-air Augmented Reality Interaction with Objects. Entertainment Computing 5, 4 (2014), 233–241. https://doi.org/10.1016/j.entcom.2014.10.008Google ScholarCross Ref
- Makiko Kouchi and Masaaki Mochimaru. 2001. Anthropometric Database of Japanese Head 2001. https://www.airc.aist.go.jp/dhrt/head/ INational Institute of Advanced Industrial Science and Technology, H16PRO-212..Google Scholar
- Makiko Kouchi and Masaaki Mochimaru. 2003. Japanese 3-D body shape and dimensions data 2003. https://www.airc.aist.go.jp/dhrt/fbodydb/index.html Institute of Advanced Industrial Science and Technology, H18PRO-503..Google Scholar
- Gun A. Lee, Hye Sun Park, and Mark Billinghurst. 2019. Optical-Reflection Type 3D Augmented Reality Mirrors. In Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology (Parramatta, NSW, Australia) (VRST ’19). Association for Computing Machinery, New York, NY, USA, Article 82, 2 pages. https://doi.org/10.1145/3359996.3364782Google ScholarDigital Library
- Satoshi Maekawa, Kouichi Nitta, and Osamu Matoba. 2006. Transmissive optical imaging device with micromirror array. In Three-Dimensional TV, Video, and Display V, Bahram Javidi, Fumio Okano, and Jung-Young Son (Eds.). Vol. 6392. International Society for Optics and Photonics, SPIE, 63920E. https://doi.org/10.1117/12.690574Google ScholarCross Ref
- Motohiro Makiguchi, Daisuke Sakamoto, Hideaki Takada, Kengo Honda, and Tetsuo Ono. 2019. Interactive 360-Degree Glasses-Free Tabletop 3D Display. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 625–637. https://doi.org/10.1145/3332165.3347948Google ScholarDigital Library
- Diego Martinez Plasencia, Florent Berthaut, Abhijit Karnik, and Sriram Subramanian. 2014. Through the Combining Glass. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 341–350. https://doi.org/10.1145/2642918.2647351Google ScholarDigital Library
- Mark R. Mine. 1995. Virtual Environment Interaction Techniques. Technical Report. USA.Google Scholar
- Yasuaki Monnai, Keisuke Hasegawa, Masahiro Fujiwara, Kazuma Yoshino, Seki Inoue, and Hiroyuki Shinoda. 2014. HaptoMime: Mid-Air Haptic Interaction with a Floating Virtual Screen. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 663–667. https://doi.org/10.1145/2642918.2647407Google ScholarDigital Library
- M.Otsubo. 2014. Optical imaging method using the same. U.S. Patent No.8,702,252.Google Scholar
- Yui Osato and Naoya Koizumi. 2020. Compact optical system displaying mid-air images movable in depth by rotating light source and mirror. Computers & Graphics 91 (2020), 290–300. https://doi.org/10.1016/j.cag.2020.08.006Google ScholarCross Ref
- Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The Go-Go Interaction Technique: Non-Linear Mapping for Direct Manipulation in VR. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology (Seattle, Washington, USA) (UIST ’96). Association for Computing Machinery, New York, NY, USA, 79–80. https://doi.org/10.1145/237091.237102Google ScholarDigital Library
- Nina Rajcic and Jon McCormack. 2020. Mirror Ritual: An Affective Interface for Emotional Self-Reflection. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376625Google ScholarDigital Library
- Joanne K Rowling. 2015. Harry Potter and the philosopher’s stone. Vol. 1. Bloomsbury Publishing.Google Scholar
- Ayaka Sano, Motohiro Makiguchi, Takahiro Matsumoto, Hisashi Matsukawa, and Ryuji Yamamoto. 2023. Mirror-Transcending Aerial Imaging (MiTAi): An optical system that freely crosses the boundary between mirrored and real spaces. Journal of the Society for Information Display 31, 5 (2023), 220–229. https://doi.org/10.1002/jsid.1221 arXiv:https://sid.onlinelibrary.wiley.com/doi/pdf/10.1002/jsid.1221Google ScholarCross Ref
- Yutaka Tokuda, Atsushi Hiyama, Michitaka Hirose, and Tim Large. 2014. Comparison of material combinations for bright and clear floating image by retro-reflective re-imaging technique. In Proc. IDW, Vol. 14. 818–819.Google Scholar
- Hiroki Uchida, Tadashi Ebihara, Naoto Wakatsuki, and Keiichi Zempo. 2021. ALiSE: Through the Mirrored Space, and What User Interacts with Avatars Naturally. In Companion Proceedings of the 2021 Conference on Interactive Surfaces and Spaces (Lodz, Poland) (ISS ’21). Association for Computing Machinery, New York, NY, USA, 29–32. https://doi.org/10.1145/3447932.3490678Google ScholarDigital Library
- Hiroki Yamamoto, Hajime Kajita, Naoya Koizumi, and Takeshi Naemura. 2015. EnchanTable: Displaying a Vertically Standing Mid-Air Image on a Table Surface Using Reflection. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (Madeira, Portugal) (ITS ’15). Association for Computing Machinery, New York, NY, USA, 397–400. https://doi.org/10.1145/2817721.2823476Google ScholarDigital Library
- Hirotsugu Yamamoto, Yuka Tomiyama, and Shiro Suyama. 2014. Floating aerial LED signage based on aerial imaging by retro-reflection (AIRR). Opt. Express 22, 22 (Nov 2014), 26919–26924. https://doi.org/10.1364/OE.22.026919Google ScholarCross Ref
- Qiushi Zhou, Andrew Irlitti, Difeng Yu, Jorge Goncalves, and Eduardo Velloso. 2022. Movement Guidance Using a Mixed Reality Mirror. In Designing Interactive Systems Conference (Virtual Event, Australia) (DIS ’22). Association for Computing Machinery, New York, NY, USA, 821–834. https://doi.org/10.1145/3532106.3533466Google ScholarDigital Library
Index Terms
- Implementation of Interactive Mirror-Transcending Aerial Imaging System
Recommendations
Vertical Aerial Imaging on the Display
SUI '23: Proceedings of the 2023 ACM Symposium on Spatial User InteractionWe propose a new optical system that can present a vertical aerial image on the display. By presenting the shadow image of the aerial image at the display, the three-dimensionality and depth perception of the aerial image can be reinforced. The proposed ...
Aerial 3D Imaging by Retroreflective Mirror Array
ISS '18 Companion: Proceedings of the 2018 ACM Companion International Conference on Interactive Surfaces and SpacesWe have developed a new optical device and aerial imaging display with the device. The technology features that the pop-out distance of the aerial image is long and there is no need for a space having We have developed an aerial imaging display with ...
Aerial 3D display using a symmetrical mirror structure
SIGGRAPH '18: ACM SIGGRAPH 2018 PostersIn the present study, we propose a new wide-viewing-angle aerial imaging display that can display aerial three-dimensional images to the surroundings. Aerial imaging has a strong visual impact, and significant efforts have been made to realize aerial ...
Comments