skip to main content
10.1145/3607822.3614536acmconferencesArticle/Chapter ViewAbstractPublication PagessuiConference Proceedingsconference-collections
research-article

Implementation of Interactive Mirror-Transcending Aerial Imaging System

Published: 13 October 2023 Publication History

Abstract

Many methods have been proposed for presenting digital information in mirror space. However, most existing methods can only display digital information in mirror space. Therefore, we study the concept of MiTAI (Mirror-Transcending Aerial Imaging), which allows for the continuous movement of digital information between mirrors and physical space. MiTAI provides a novel interactive experience combining mirrors, physical space, and digital information. In this paper, we present the first systemization of MiTAI that users can experience, as well as an initial study toward a concept evaluation of MiTAI. We describe an implementation of the system in detail, including an optical follow-up of the previous study, the design of the control system, the presentation of content, and a method for interacting with the aerial image. The implemented system provided a MiTAI viewing experience for approximately 150 attendees through a hands-on demonstration exhibit and had a strong impact on them. We also report on user feedback from the exhibition and future improvements.

Supplemental Material

MP4 File
Presentation video

References

[1]
1991. Beauty and the Beast.
[2]
Hrvoje Benko and Andrew D. Wilson. 2010. Pinch-the-Sky Dome: Freehand Multi-Point Interactions with Immersive Omni-Directional Data. In CHI ’10 Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI EA ’10). Association for Computing Machinery, New York, NY, USA, 3045–3050. https://doi.org/10.1145/1753846.1753915
[3]
Lewis Carroll. 2010. Through the looking glass and what Alice found there. Penguin UK.
[4]
Kaori Fujinami, Fahim Kawsar, and Tatsuo Nakajima. 2005. AwareMirror: A Personalized Display Using a Mirror. In Pervasive Computing, Hans W. Gellersen, Roy Want, and Albrecht Schmidt (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 315–332.
[5]
Jacob Grimm and Wilhelm K Grimm. 1991. Snow white. Andrews McMeel Publishing.
[6]
Fatma Ben Guefrech, Florent Berthaut, Patricia Plénacoste, Yvan Peter, and Laurent Grisoni. 2021. Revealable Volume Displays: 3D Exploration of Mixed-Reality Public Exhibitions. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 31–39. https://doi.org/10.1109/VR50410.2021.00023
[7]
Takayuki Hoshi, Masafumi Takahashi, Kei Nakatsuma, and Hiroyuki Shinoda. 2009. Touchable Holography. In ACM SIGGRAPH 2009 Emerging Technologies (New Orleans, Louisiana) (SIGGRAPH ’09). Association for Computing Machinery, New York, NY, USA, Article 23, 1 pages. https://doi.org/10.1145/1597956.1597979
[8]
Rachel Jacobs, Holger Schnädelbach, Nils Jäger, Silvia Leal, Robin Shackford, Steve Benford, and Roma Patel. 2019. The Performative Mirror Space. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300630
[9]
Norio Kato and Takeshi Naemura. 2006. Mixed Reality Environment with a Mirror. In ACM SIGGRAPH 2006 Research Posters (Boston, Massachusetts) (SIGGRAPH ’06). Association for Computing Machinery, New York, NY, USA, 155–es. https://doi.org/10.1145/1179622.1179801
[10]
Hajime Katsumoto, Hajime Kajita, Naoya Koizumi, and Takeshi Naemura. 2016. HoVerTable PONG: Playing Face-to-Face Game on Horizontal Tabletop with Moving Vertical Mid-Air Image. In Proceedings of the 13th International Conference on Advances in Computer Entertainment Technology (Osaka, Japan) (ACE ’16). Association for Computing Machinery, New York, NY, USA, Article 50, 6 pages. https://doi.org/10.1145/3001773.3001820
[11]
Hanyuool Kim, Issei Takahashi, Hiroki Yamamoto, Satoshi Maekawa, and Takeshi Naemura. 2014. MARIO: Mid-air Augmented Reality Interaction with Objects. Entertainment Computing 5, 4 (2014), 233–241. https://doi.org/10.1016/j.entcom.2014.10.008
[12]
Makiko Kouchi and Masaaki Mochimaru. 2001. Anthropometric Database of Japanese Head 2001. https://www.airc.aist.go.jp/dhrt/head/ INational Institute of Advanced Industrial Science and Technology, H16PRO-212.
[13]
Makiko Kouchi and Masaaki Mochimaru. 2003. Japanese 3-D body shape and dimensions data 2003. https://www.airc.aist.go.jp/dhrt/fbodydb/index.html Institute of Advanced Industrial Science and Technology, H18PRO-503.
[14]
Gun A. Lee, Hye Sun Park, and Mark Billinghurst. 2019. Optical-Reflection Type 3D Augmented Reality Mirrors. In Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology (Parramatta, NSW, Australia) (VRST ’19). Association for Computing Machinery, New York, NY, USA, Article 82, 2 pages. https://doi.org/10.1145/3359996.3364782
[15]
Satoshi Maekawa, Kouichi Nitta, and Osamu Matoba. 2006. Transmissive optical imaging device with micromirror array. In Three-Dimensional TV, Video, and Display V, Bahram Javidi, Fumio Okano, and Jung-Young Son (Eds.). Vol. 6392. International Society for Optics and Photonics, SPIE, 63920E. https://doi.org/10.1117/12.690574
[16]
Motohiro Makiguchi, Daisuke Sakamoto, Hideaki Takada, Kengo Honda, and Tetsuo Ono. 2019. Interactive 360-Degree Glasses-Free Tabletop 3D Display. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 625–637. https://doi.org/10.1145/3332165.3347948
[17]
Diego Martinez Plasencia, Florent Berthaut, Abhijit Karnik, and Sriram Subramanian. 2014. Through the Combining Glass. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 341–350. https://doi.org/10.1145/2642918.2647351
[18]
Mark R. Mine. 1995. Virtual Environment Interaction Techniques. Technical Report. USA.
[19]
Yasuaki Monnai, Keisuke Hasegawa, Masahiro Fujiwara, Kazuma Yoshino, Seki Inoue, and Hiroyuki Shinoda. 2014. HaptoMime: Mid-Air Haptic Interaction with a Floating Virtual Screen. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 663–667. https://doi.org/10.1145/2642918.2647407
[20]
M.Otsubo. 2014. Optical imaging method using the same. U.S. Patent No.8,702,252.
[21]
Yui Osato and Naoya Koizumi. 2020. Compact optical system displaying mid-air images movable in depth by rotating light source and mirror. Computers & Graphics 91 (2020), 290–300. https://doi.org/10.1016/j.cag.2020.08.006
[22]
Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The Go-Go Interaction Technique: Non-Linear Mapping for Direct Manipulation in VR. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology (Seattle, Washington, USA) (UIST ’96). Association for Computing Machinery, New York, NY, USA, 79–80. https://doi.org/10.1145/237091.237102
[23]
Nina Rajcic and Jon McCormack. 2020. Mirror Ritual: An Affective Interface for Emotional Self-Reflection. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376625
[24]
Joanne K Rowling. 2015. Harry Potter and the philosopher’s stone. Vol. 1. Bloomsbury Publishing.
[25]
Ayaka Sano, Motohiro Makiguchi, Takahiro Matsumoto, Hisashi Matsukawa, and Ryuji Yamamoto. 2023. Mirror-Transcending Aerial Imaging (MiTAi): An optical system that freely crosses the boundary between mirrored and real spaces. Journal of the Society for Information Display 31, 5 (2023), 220–229. https://doi.org/10.1002/jsid.1221 arXiv:https://sid.onlinelibrary.wiley.com/doi/pdf/10.1002/jsid.1221
[26]
Yutaka Tokuda, Atsushi Hiyama, Michitaka Hirose, and Tim Large. 2014. Comparison of material combinations for bright and clear floating image by retro-reflective re-imaging technique. In Proc. IDW, Vol. 14. 818–819.
[27]
Hiroki Uchida, Tadashi Ebihara, Naoto Wakatsuki, and Keiichi Zempo. 2021. ALiSE: Through the Mirrored Space, and What User Interacts with Avatars Naturally. In Companion Proceedings of the 2021 Conference on Interactive Surfaces and Spaces (Lodz, Poland) (ISS ’21). Association for Computing Machinery, New York, NY, USA, 29–32. https://doi.org/10.1145/3447932.3490678
[28]
Hiroki Yamamoto, Hajime Kajita, Naoya Koizumi, and Takeshi Naemura. 2015. EnchanTable: Displaying a Vertically Standing Mid-Air Image on a Table Surface Using Reflection. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (Madeira, Portugal) (ITS ’15). Association for Computing Machinery, New York, NY, USA, 397–400. https://doi.org/10.1145/2817721.2823476
[29]
Hirotsugu Yamamoto, Yuka Tomiyama, and Shiro Suyama. 2014. Floating aerial LED signage based on aerial imaging by retro-reflection (AIRR). Opt. Express 22, 22 (Nov 2014), 26919–26924. https://doi.org/10.1364/OE.22.026919
[30]
Qiushi Zhou, Andrew Irlitti, Difeng Yu, Jorge Goncalves, and Eduardo Velloso. 2022. Movement Guidance Using a Mixed Reality Mirror. In Designing Interactive Systems Conference (Virtual Event, Australia) (DIS ’22). Association for Computing Machinery, New York, NY, USA, 821–834. https://doi.org/10.1145/3532106.3533466

Cited By

View all
  • (2024)Mirror-Transcending Aerial Imaging System for Multiple UsersACM SIGGRAPH 2024 Emerging Technologies10.1145/3641517.3664380(1-2)Online publication date: 13-Jul-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SUI '23: Proceedings of the 2023 ACM Symposium on Spatial User Interaction
October 2023
505 pages
ISBN:9798400702815
DOI:10.1145/3607822
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 October 2023

Permissions

Request permissions for this article.

Check for updates

Badges

  • Best Paper

Author Tags

  1. Aerial imaging
  2. Interactive mirror
  3. Mirror display

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

SUI '23
SUI '23: ACM Symposium on Spatial User Interaction
October 13 - 15, 2023
NSW, Sydney, Australia

Acceptance Rates

Overall Acceptance Rate 86 of 279 submissions, 31%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)123
  • Downloads (Last 6 weeks)8
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Mirror-Transcending Aerial Imaging System for Multiple UsersACM SIGGRAPH 2024 Emerging Technologies10.1145/3641517.3664380(1-2)Online publication date: 13-Jul-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media