skip to main content
10.1145/2807442.2807493acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

FoveAR: Combining an Optically See-Through Near-Eye Display with Projector-Based Spatial Augmented Reality

Published: 05 November 2015 Publication History

Abstract

Optically see-through (OST) augmented reality glasses can overlay spatially-registered computer-generated content onto the real world. However, current optical designs and weight considerations limit their diagonal field of view to less than 40 degrees, making it difficult to create a sense of immersion or give the viewer an overview of the augmented reality space. We combine OST glasses with a projection-based spatial augmented reality display to achieve a novel display hybrid, called FoveAR, capable of greater than 100 degrees field of view, view dependent graphics, extended brightness and color, as well as interesting combinations of public and personal data display. We contribute details of our prototype implementation and an analysis of the interactive design space that our system enables. We also contribute four prototype experiences showcasing the capabilities of FoveAR as well as preliminary user feedback providing insights for enhancing future FoveAR experiences.

Supplementary Material

MP4 File (p129.mp4)

References

[1]
Baudisch, P., Good, N., and Stewart, P. Focus plus Context Screens: Combining Display Technology with Visualization Techniques. In Proc. of ACM UIST 2001.
[2]
Benko, H., Wilson, A. D., and Zannier, F. Dyadic projected spatial augmented reality. In Proc. of ACM UIST 2014.
[3]
Benko, H., Jota, R. and Wilson, A. D. MirageTable: Freehand Interaction on a Projected Augmented Reality Tabletop. In Proc. of ACM SIGCHI 2012. 199--208.
[4]
Bimber, O. and Raskar, R. Spatial augmented reality: Merging real and virtual worlds. AK Peters Ltd. 2005.
[5]
Bimber, O. and Frohlich, B. Occlusion Shadows: Using projected light to generate realistic occlusion effects for view-dependent optical see-through displays. In Proc. of IEEE ISMAR 2002.
[6]
Cheng, D., Wang, Y., Hua, H., and Sasian. J. Design of a wide-angle, lightweight head-mounted display using free-form optics tiling. Opt. Lett., 36(11):2098--2100, Jun 2011.
[7]
Feiner, S. and Shamash, A. Hybrid user interfaces: breeding virtually bigger interfaces for physically smaller computers. In Proc. of ACM UIST 1991. 9--17.
[8]
Genc, Y., Tuceryan, M., and Navab, N. Practical Solutions for Calibration of Optical See-Through Displays. In Proc. of IEEE ISMAR 2002. 169--175.
[9]
Harrison, C., Benko, H., and Wilson, A.D. OmniTouch: wearable multitouch interaction everywhere. In Proc. of ACM UIST 2011. 441--450.
[10]
Hou, J., Nam, Y., Peng, W., and Lee, K.M. Effects of screen size, viewing angle, and players' immersion tendencies on game experience. Comp. in Human Behavior, 28(2). 2012. 617--623.
[11]
Hua, H., Brown, L., and Gao, C. Scape: Supporting stereoscopic collaboration in augmented and projective environments. IEEE Comp. Graph. Appl. 24, 1 2004. 66--75.
[12]
Itoh, Y. and Klinker, G. Interaction-free calibration for optical see-through head-mounted displays based on 3D eye localization. In Proc. of IEEE 3D User Interfaces (3DUI), 2014. 75--82.
[13]
Jones, B., Benko, H., Ofek, E., and Wilson, A. D. IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. In Proc. of ACM SIGCHI 2013.
[14]
Jones, B., Sodhi, R., Murdock, M., Mehra, R., Benko, H., Wilson, A., Ofek, E., MacIntryre, B., Raghuvanshi, N., and Shapira, L. RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-Camera Units. In Proc. of ACM UIST 2014.
[15]
Jones, J. A., Swan II, J. E., Bolas, M. Peripheral Stimulation and its Effect on Perceived Spatial Scale in Virtual Environments. TVCG, May 2013.
[16]
Kress, B. and Starner, T. A review of head-mounted displays (HMD) technologies and applications for consumer electronics. In Proc. SPIE, vol. 8720. 2013.
[17]
Lanman, D. and Luebke, D. Near-eye light field displays. ACM Trans. Graphics. 32, 6 (Nov.) 220:1220:10. 2013.
[18]
Livingston, M., Gabbard, J. L., Swan II, J. E., Sibley, C.M., and Barrow, J. Basic perception in head-worn augmented reality displays. Human Factors in Augmented Reality Environments. Springer 2013. 35--65.
[19]
Maimone, A. and Fuchs, H. Computational Augmented Reality Eyeglasses. In Proc. of IEEE ISMAR 2013.
[20]
Maimone, A., Lanman D., Rathinavel, K., Keller, K., Luebke, D., and Fuchs, H. Pinlight Displays: Wide Field of View Augmented Reality Eyeglasses Using Defocused Point Light Sources. In Proc. of ACM SIGGRAPH 2014.
[21]
Maimone, A., Yang, X., Dierk, N., State, A., Dou, M., and Fuchs, H. General-Purpose Telepresence with Head-Worn Optical See-Through Displays and Projector-Based Lighting. In Proc. of IEEE VR 2013.
[22]
Olwal A. and Feiner S. Spatially aware handhelds for high-precision tangible interaction with large displays. In Proc. of TEI 2009. Pp 181--188.
[23]
Pinhanez, C. The Everywhere Display projector: A device to create ubiquitous graphical interfaces. In Proc. ACM Ubicomp 2001.
[24]
Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., and Fuchs, H. The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays. In Proc. of ACM SIGGRAPH '98.
[25]
Raskar, R., Welch, G., Low, K.-L., and Bandyopadhyay, D. Shader Lamps: Animating real objects with imagebased illumination. In Proc. of the Eurographics Workshop on Rendering Techniques. 2001. 89--102.
[26]
Slater, M., Linakis, V., Usoh, M., and Kooper, R. Immersion, presence and performance in virtual environments: An experiment with tri-dimensional chess. In Proc. of ACM VRST 1996. 163--172.
[27]
Tuceryan, M., Genc, Y., and Navab, N. Single-point active alignment method (SPAAM) for optical seethrough HMD calibration for augmented reality. Presence: Teleoper. Virt. Environ. 11, 3. 2002. 259--276.
[28]
Wetzstein, G. and Bimber, O. Radiometric Compensation through Inverse Light Transport. In Proc. of Pacific Graphics, 2007. 391--399.
[29]
Wilson A. and Benko H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proc. of ACM UIST 2010. 273--282.
[30]
Wilson, A. D., Benko, H., Izadi, S., and Hilliges, O. Steerable Augmented Reality with the Beamatron. In Proc. of ACM UIST 2012. 413--422.
[31]
Zhou, J., Lee, I., Thomas, B., Menassa, R., Farrant, A., and Sansome. A. In-Situ Support for Automotive Manufacturing Using Spatial Augmented Reality. Intern. Journal of Virtual Reality (IJVR 2012) 11, 1.

Cited By

View all
  • (2024)The Impact of Variable Focal Lengths in Head Mounted Display2024 International Conference on Recent Advances in Electrical, Electronics, Ubiquitous Communication, and Computational Intelligence (RAEEUCCI)10.1109/RAEEUCCI61380.2024.10547764(1-7)Online publication date: 17-Apr-2024
  • (2024)Forging the Industrial Metaverse for Industry 5.0: Where Extended Reality, IIoT, Opportunistic Edge Computing, and Digital Twins MeetIEEE Access10.1109/ACCESS.2024.342210912(95778-95819)Online publication date: 2024
  • (2023)Affordance-Based and User-Defined Gestures for Spatial Tangible InteractionProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596032(1500-1514)Online publication date: 10-Jul-2023
  • Show More Cited By

Index Terms

  1. FoveAR: Combining an Optically See-Through Near-Eye Display with Projector-Based Spatial Augmented Reality

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology
    November 2015
    686 pages
    ISBN:9781450337793
    DOI:10.1145/2807442
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 05 November 2015

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. augmented reality
    2. focus+context
    3. head-mounted displays
    4. procam
    5. projector camera system
    6. see-through displays

    Qualifiers

    • Research-article

    Conference

    UIST '15

    Acceptance Rates

    UIST '15 Paper Acceptance Rate 70 of 297 submissions, 24%;
    Overall Acceptance Rate 561 of 2,567 submissions, 22%

    Upcoming Conference

    UIST '25
    The 38th Annual ACM Symposium on User Interface Software and Technology
    September 28 - October 1, 2025
    Busan , Republic of Korea

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)58
    • Downloads (Last 6 weeks)5
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)The Impact of Variable Focal Lengths in Head Mounted Display2024 International Conference on Recent Advances in Electrical, Electronics, Ubiquitous Communication, and Computational Intelligence (RAEEUCCI)10.1109/RAEEUCCI61380.2024.10547764(1-7)Online publication date: 17-Apr-2024
    • (2024)Forging the Industrial Metaverse for Industry 5.0: Where Extended Reality, IIoT, Opportunistic Edge Computing, and Digital Twins MeetIEEE Access10.1109/ACCESS.2024.342210912(95778-95819)Online publication date: 2024
    • (2023)Affordance-Based and User-Defined Gestures for Spatial Tangible InteractionProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596032(1500-1514)Online publication date: 10-Jul-2023
    • (2023)Reality Distortion Room: A Study of User Locomotion Responses to Spatial Augmented Reality Effects2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00137(1201-1210)Online publication date: 16-Oct-2023
    • (2022)ARSlice: Head-Mounted Display Augmented with Dynamic Tracking and ProjectionJournal of Computer Science and Technology10.1007/s11390-022-2173-y37:3(666-679)Online publication date: 31-May-2022
    • (2021)A Projector-Based Augmented Reality Navigation System for Computer-Assisted SurgerySensors10.3390/s2109293121:9(2931)Online publication date: 22-Apr-2021
    • (2021)HoloBar: Rapid Command Execution for Head-Worn AR Exploiting Around the Field-of-View InteractionProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445255(1-17)Online publication date: 6-May-2021
    • (2021)Beaming DisplaysIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.306776427:5(2659-2668)Online publication date: May-2021
    • (2020)Switchable Glass Enabled Contextualization for a Cyber-Physical Safe and Interactive Spatial Augmented Reality PCBA Manufacturing Inspection SystemSensors10.3390/s2015428620:15(4286)Online publication date: 31-Jul-2020
    • (2020)HMD Light: Sharing In-VR Experience via Head-Mounted Projector for Asymmetric InteractionProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415847(472-486)Online publication date: 20-Oct-2020
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media