skip to main content
10.1145/2815585.2815735acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
poster

Juggling the Effects of Latency: Software Approaches to Minimizing Latency in Dynamic Projector-Camera Systems

Published: 06 November 2015 Publication History

Abstract

Projector-camera (pro-cam) systems afford a wide range of interactive possibilities, combining both natural and mixed-reality 3D interaction. However, the latency inherent within these systems can cause the projection to ?slip? from any moving target, so pro-cam systems have typically shied away from truly dynamic scenarios. We explore software-only techniques to reduce latency; considering the best achievable results with widely adopted commodity devices (e.g. 30Hz depth cameras and 60Hz projectors). We achieve 50% projection alignment on objects in free flight (a 34% improvement) and 69% alignment on dynamic human movement (a 40% improvement).

References

[1]
Harrison, C. et al. OmniTouch: Wearable Multitouch Interaction Everywhere. UIST ?11, ACM (2011).
[2]
Khoshelham, K. Accuracy analysis of kinect depth data, in archive of ISPRS, (2011), 133--138.
[3]
Kitani, K. et al. BallCam!: Dynamic View Synthesis from Spinning Cameras. UIST Adjunct ?12, ACM (2012), 87--88.
[4]
Koike, H. et al. LumoSpheres: Real-time Tracking of Flying Objects and Image Projection for a Volumetric Display. AH ?15, ACM (2015), 93--96.
[5]
Okumura, K. et al. Lumipen: Projection-Based Mixed Reality for Dynamic Objects. (2012), 699--704.
[6]
Sodhi, R. et al. LightGuide: Projected Visualizations for Hand Movement Guidance. CHI ?12, ACM (2012).
[7]
Coupled Oscillators and Biological Synchronization. http://www.scientificamerican.com/article/coupledoscillators-and-biological/.

Cited By

View all
  • (2024)Real-Time Radiometric Compensation on Deforming Non-Rigid Surfaces using Motion Prediction in Projection Mappingプロジェクションマッピングにおける動き予測を用いた変形する非剛体への実時間光学的補正The Journal of The Institute of Image Information and Television Engineers10.3169/itej.78.34878:3(348-354)Online publication date: 2024
  • (2023)OpenMPD: A Low-Level Presentation Engine for Multimodal Particle-Based DisplaysACM Transactions on Graphics10.1145/357289642:2(1-13)Online publication date: 11-Apr-2023
  • (2023)Enhancing Safety using AR Headsets with Motion Prediction Visualization2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW58643.2023.00120(545-546)Online publication date: Mar-2023
  • Show More Cited By

Index Terms

  1. Juggling the Effects of Latency: Software Approaches to Minimizing Latency in Dynamic Projector-Camera Systems

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '15 Adjunct: Adjunct Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology
    November 2015
    124 pages
    ISBN:9781450337809
    DOI:10.1145/2815585
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 06 November 2015

    Check for updates

    Author Tags

    1. latency
    2. prediction
    3. projection lag
    4. projector-camera systems

    Qualifiers

    • Poster

    Conference

    UIST '15
    UIST '15: The 28th Annual ACM Symposium on User Interface Software and Technology
    November 8 - 11, 2015
    Kyungpook, Daegu, Republic of Korea

    Acceptance Rates

    Overall Acceptance Rate 355 of 1,733 submissions, 20%

    Upcoming Conference

    UIST '25
    The 38th Annual ACM Symposium on User Interface Software and Technology
    September 28 - October 1, 2025
    Busan , Republic of Korea

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)10
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Real-Time Radiometric Compensation on Deforming Non-Rigid Surfaces using Motion Prediction in Projection Mappingプロジェクションマッピングにおける動き予測を用いた変形する非剛体への実時間光学的補正The Journal of The Institute of Image Information and Television Engineers10.3169/itej.78.34878:3(348-354)Online publication date: 2024
    • (2023)OpenMPD: A Low-Level Presentation Engine for Multimodal Particle-Based DisplaysACM Transactions on Graphics10.1145/357289642:2(1-13)Online publication date: 11-Apr-2023
    • (2023)Enhancing Safety using AR Headsets with Motion Prediction Visualization2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW58643.2023.00120(545-546)Online publication date: Mar-2023
    • (2022)Real-time tunnel projection from a moving subway trainThe Visual Computer10.1007/s00371-022-02487-139:7(2711-2724)Online publication date: 27-Apr-2022
    • (2020)MirAIProjectionProceedings of the 2020 International Conference on Advanced Visual Interfaces10.1145/3399715.3399839(1-5)Online publication date: 28-Sep-2020
    • (2020)FuturePong: Real-time Table Tennis Trajectory Forecasting using Pose Prediction NetworkExtended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3334480.3382853(1-8)Online publication date: 25-Apr-2020
    • (2020)Small Marker Tracking with Low-Cost, Unsynchronized, Movable Consumer Cameras For Augmented Reality Surgical Training2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct51615.2020.00038(90-95)Online publication date: Nov-2020
    • (2019)Prediction of Volleyball Trajectory Using Skeletal Motions of Setter PlayerProceedings of the 10th Augmented Human International Conference 201910.1145/3311823.3311844(1-8)Online publication date: 11-Mar-2019
    • (2019)Geometrically Compensating Effect of End-to-End Latency in Moving-Target Selection GamesProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300790(1-12)Online publication date: 2-May-2019
    • (2018)Using High Frequency Accelerometer and Mouse to Compensate for End-to-end Latency in Indirect InteractionProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174183(1-11)Online publication date: 21-Apr-2018
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media