Carolin Reichherzer
ABSTRACT
This paper describes a modular framework developed to facilitate the design space exploration of cross-device Augmented Reality (AR) interfaces that combine an AR head-mounted display (HMD) with a smartphone. Currently, there is a growing interest in how AR HMDs can be used with smartphones to improve the user’s AR experience. In this work, we describe a framework that enables rapid prototyping and evaluation of an interface. Our system enables different modes of interaction, content placement, and simulated AR HMD field of view to assess which combination is best suited to inform future researchers on design recommendations. We provide examples of how the framework could be used to create sample applications, the types of the studies which could be supported, and example results from a simple pilot study.
- Dreamworld AR. 2021. Home. https://www.dreamworldvision.com/Google Scholar
- Sunyoung Bang, Hyunjin Lee, and Woontack Woo. 2020. Effects of Augmented Content’s Placement and Size on User’s Search Experience in Extended Displays. In 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, New York, USA, 184–188. https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00056Google ScholarCross Ref
- Jonas Blattgerste, Patrick Renner, and Thies Pfeiffer. 2018. Advantages of Eye-Gaze over Head-Gaze-Based Selection in Virtual and Augmented Reality under Varying Field of Views. In Proceedings of the Workshop on Communication by Gaze Interaction (Warsaw, Poland) (COGAIN ’18). Association for Computing Machinery, New York, NY, USA, Article 1, 9 pages. https://doi.org/10.1145/3206343.3206349Google ScholarDigital Library
- Frederik Brudy, Christian Holz, Roman Rädle, Chi-Jui Wu, Steven Houben, Clemens Nylandsted Klokmose, and Nicolai Marquardt. 2019. Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–28. https://doi.org/10.1145/3290605.3300792Google ScholarDigital Library
- Rahul Budhiraja, Gun A Lee, and Mark Billinghurst. 2013. Using a HHD with a HMD for mobile AR interaction. In 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, New Jersey, United States, 1–6. https://doi.org/10.1109/ISMAR.2013.6671837Google ScholarCross Ref
- Ozan Cakmakci and Jannick Rolland. 2006. Head-worn displays: a review. Journal of Display Technology 2, 3 (2006), 199–216. https://doi.org/10.1109/JDT.2006.879846Google ScholarCross Ref
- Nicko R Caluya, Alexander Plopski, Jayzon F Ty, Christian Sandor, Takafumi Taketomi, and Hirokazu Kato. 2018. Transferability of Spatial Maps: Augmented Versus Virtual Reality Training. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, New York, USA, 387–393.Google Scholar
- Jens Grubert, Matthias Heinisch, Aaron Quigley, and Dieter Schmalstieg. 2015. MultiFi: Multi Fidelity Interaction with Displays On and Around the Body. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3933–3942. https://doi.org/10.1145/2702123.2702331Google ScholarDigital Library
- Meta View Inc. 2021. Meta View. https://www.metavision.com/Google Scholar
- Naohiro Kishishita, Kiyoshi Kiyokawa, Jason Orlosky, Tomohiro Mashita, Haruo Takemura, and Ernst Kruijff. 2014. Analysing the effects of a wide field of view augmented reality display on search performance in divided attention tasks. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, New York, USA, 177–186.Google ScholarCross Ref
- Simon Moosburner, Christopher Remde, Peter Tang, Moritz Queisner, Nils Haep, Johann Pratschke, and Igor M. Sauer. 2019. Real world usability analysis of two augmented reality headsets in visceral surgery. Artificial Organs 43, 7 (2019), 694–698. https://doi.org/10.1111/aor.13396 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/aor.13396Google ScholarCross Ref
- [12] Mirror Networking.2021. https://mirror-networking.com/Google Scholar
- Erwan Normand and Michael J. McGuffin. 2018. Enlarging a Smartphone with AR to Create a Handheld VESAD (Virtually Extended Screen-Aligned Display). In 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, New York, USA, 123–133. https://doi.org/10.1109/ISMAR.2018.00043Google ScholarCross Ref
- OptiTrack. 2021. OptiTrack – Motion Capture Systems. https://optitrack.com/Google Scholar
- Patrick Reipschläger and Raimund Dachselt. 2019. DesignAR: Immersive 3D-Modeling Combining Augmented Reality with Interactive Displays. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces(Daejeon, Republic of Korea) (ISS ’19). Association for Computing Machinery, New York, NY, USA, 29–41. https://doi.org/10.1145/3343055.3359718Google ScholarDigital Library
- Donghao Ren, Tibor Goldschwendt, YunSuk Chang, and Tobias Höllerer. 2016. Evaluating wide-field-of-view augmented reality with mixed reality simulation. In 2016 IEEE Virtual Reality (VR). IEEE, New York, USA, 93–102.Google Scholar
- Jie Ren, Yueting Weng, Chengchi Zhou, Chun Yu, and Yuanchun Shi. 2020. Understanding Window Management Interactions in AR Headset + Smartphone Interface. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3334480.3382812Google ScholarDigital Library
- Project North Star. 2021. Project North Star. https://project-north-star.gitbook.io/project-north-star/Google Scholar
- Fengyuan Zhu and Tovi Grossman. 2020. BISHARE: Exploring Bidirectional Interactions Between Smartphones and Head-Mounted Augmented Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376233Google ScholarDigital Library
Index Terms
- SecondSight: A Framework for Cross-Device Augmented Reality Interfaces
Recommendations
SecondSight: Demonstrating Cross-Device Augmented Reality
SIGGRAPH '21: ACM SIGGRAPH 2021 Immersive PavilionSecondSight is a framework for rapid prototyping of cross-device interfaces that combine an optical see-through Augmented Reality (AR) head-mounted display (HMD) with a smartphone. SecondSight contains code for simulating AR HMDs with different Fields ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Development of an Inexpensive Augmented Reality (AR) Headset
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing SystemsWe outline our work in developing an Augmented Reality (AR) headset with low purchase and maintenance costs. Similar to Google Cardboard, the headset uses a smartphone to provide the compute power, connectivity and display. Unlike Google Cardboard, our ...
Comments