skip to main content
10.1145/3308557.3308678acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
short-paper

Adaptive projection augmented reality with object recognition based on deep learning

Published: 16 March 2019 Publication History

Abstract

This study describes an Adaptive Projection Augmented Reality (AR) system that can provide information in real-time using object recognition. This approach is based on deep-learning through the construction of a 3D space from the real world. Through single system, a projector-camera unit with pan-tilt mechanism, the 360-degree space of user surroundings can be built into a 3-dimensional space and accomplish object and user recognition. a projection AR environment can be generated instantaneously. Information relevant to real-world objects can be provided through real-time interactions between the user and objects. Using spatial interaction, it also allows for achieving intuitive interactions with projection information, user interface (UI), and contents without touch sensors. Several scenarios for the use of this system are described below.

References

[1]
Andreas Rene Fender, Hrvoje Benko, and Andy Wilson. 2017. MeetAlive: Room-Scale Omni-Directional Display System for Multi-User Content and Control Sharing. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. ACM, 106--115.
[2]
Willow Garage. 2017. Ork: Object recognition kitchen. https://wg-perception.github.io/object_recognition_core/
[3]
Joseph Redmon and Ali Farhadi. 2018. YOLOv3: An Incremental Improvement. arXiv (2018).
[4]
Thomas Whelan, Michael Kaess, Hordur Johannsson, Maurice Fallon, John J Leonard, and John McDonald. 2015. Real-time large-scale dense RGB-D SLAM with volumetric fusion. The International Journal of Robotics Research 34, 4--5 (2015), 598--626.
[5]
Andrew Wilson, Hrvoje Benko, Shahram Izadi, and Otmar Hilliges. 2012. Steerable augmented reality with the beamatron. In Proceedings of the 25th annual ACM symposium on User interface software and technology. ACM, 413--422.
[6]
Andrew D Wilson. 2010. Using a depth camera as a touch sensor. In ACM international conference on interactive tabletops and surfaces. ACM, 69--72.

Cited By

View all
  • (2023)Toward Trustworthy Metaverse: Advancements and ChallengesIEEE Access10.1109/ACCESS.2023.332625811(118318-118347)Online publication date: 2023
  • (2022)Integrating in-hand physical objects in mixed reality interactionsCompanion Proceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490100.3516476(129-133)Online publication date: 22-Mar-2022
  • (2021)Fast 3D point-cloud segmentation for interactive surfacesCompanion Proceedings of the 2021 Conference on Interactive Surfaces and Spaces10.1145/3447932.3491141(33-37)Online publication date: 14-Nov-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
IUI '19 Companion: Companion Proceedings of the 24th International Conference on Intelligent User Interfaces
March 2019
173 pages
ISBN:9781450366731
DOI:10.1145/3308557
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 March 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. deep learning
  2. object recognition
  3. projection augmented reality
  4. spatial user interaction

Qualifiers

  • Short-paper

Funding Sources

  • Korea government (MSIP)

Conference

IUI '19
Sponsor:

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Toward Trustworthy Metaverse: Advancements and ChallengesIEEE Access10.1109/ACCESS.2023.332625811(118318-118347)Online publication date: 2023
  • (2022)Integrating in-hand physical objects in mixed reality interactionsCompanion Proceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490100.3516476(129-133)Online publication date: 22-Mar-2022
  • (2021)Fast 3D point-cloud segmentation for interactive surfacesCompanion Proceedings of the 2021 Conference on Interactive Surfaces and Spaces10.1145/3447932.3491141(33-37)Online publication date: 14-Nov-2021
  • (2021)Artefact: A UML-based framework for model-driven development of interactive surface prototypesCompanion Proceedings of the 2021 Conference on Interactive Surfaces and Spaces10.1145/3447932.3490523(16-20)Online publication date: 14-Nov-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media