skip to main content
10.1145/1095034.1095047acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
Article

PlayAnywhere: a compact interactive tabletop projection-vision system

Published: 23 October 2005 Publication History

Abstract

We introduce PlayAnywhere, a front-projected computer vision-based interactive table system which uses a new commercially available projection technology to obtain a compact, self-contained form factor. PlayAnywhere's configuration addresses installation, calibration, and portability issues that are typical of most vision-based table systems, and thereby is particularly motivated in consumer applications. PlayAnywhere also makes a number of contributions related to image processing techniques for front-projected vision-based table systems, including a shadow-based touch detection algorithm, a fast, simple visual bar code scheme tailored to projection-vision table systems, the ability to continuously track sheets of paper, and an optical flow-based algorithm for the manipulation of onscreen objects that does not rely on fragile tracking algorithms.

References

[1]
Ballard, D., and C. Brown Computer Vision. Prentice-Hall, 1982.
[2]
Barron, J., D. Fleet, S. Beauchemin, and T. Burkitt, Performance of Optical Flow Techniques. in Computer Vision and Pattern Recognition, (1992), 236--242.
[3]
Berard, F., The Magic Table: Computer Vision Based Augmentation of a Whiteboard for Creative Meetings. in IEEE International Conference in Computer Vision, Workshop on Projector-Camera Systems (PROCAMS'03), (2003).
[4]
Buxton, W. Projection-Vision Systems: Towards a Human-Centric Taxonomy Unpublished Manuscript, Toronto: Buxton Design, 2005.
[5]
Corso, J., D. Burschka and G. Hager, The 4D Touchpad: Unencumbered HCI with VICs. in Proceedings of the CVPR-HCI Workshop, (2003).
[6]
Dietz, P.H., and D. L. Leigh, DiamondTouch: A Multi-User Touch Technology. in ACM Symposium on User Interface Software and Technology, (2001), 219--226.
[7]
Fiala, M. ARTag Revision 1, A Fiducial Marker System Using Digital Techniques NRC Technical Report (NRC 47419), National Research Council of Canada, 2004.
[8]
Gonzalez, R., and R. Woods Digital Image Processing: Second Edition. Prentice-Hall, 2002.
[9]
Horn, B.K.P. Closed Form Solution of Absolute Orientation Using Unit Quaternions. Journal of the Optical Society, 4 (4). 629--642.
[10]
Kang, S.B. Radial Distortion Snakes. IEICE Transactions on Information and Systems, E84-D (12). 1603--1611.
[11]
Kato, H., M. Billinghurst, I. Poupyrev, K. Imamoto, K. Tachibana, Virtual Object Manipulation on a Table-Top AR Environment. in Proceedings of ISAR 2000, (2000).
[12]
Kim, J., S. Seitz, and M. Agrawala, Video-based Document Tracking: Unifying Your Physical and Electronic Desktops. in Proceedings of ACM Symposium on User Interface Software and Technology, (2004), 99--107.
[13]
Kjeldsen, R., C. Pinhanez, G. Pingali, and J. Hartman, Interacting with Steerable Projected Displays. in International Conference on Automatic Face and Gesture Recognition, (2002).
[14]
Klemmer, S.R., M. W. Newman, R. Farrell, M. Bilezikjian, J. A. Landay, The Designer's Output: A Tangible Interface for Collaborative Web Site Design. in ACM Symposium on User Interface Software and Technology, (2001), 1--10.
[15]
Koike, H., and Y. Sato, Y. Kobayashi Integrating Paper and Digital Information on EnhancedDesk: a Method for Realtime Finger Tracking on an Augmented Desk System. ACM Transactions on Computer-Human Interaction (TOCHI), 8 (4). 307--322.
[16]
Leibe, B., T. Starner, W. Ribarsky, Z. Wartell, D. Krum, J. Weeks, B. Singletary, and L. Hodges. Toward Spontaneous Interaction with the Perceptive Workbench. IEEE Computer Graphics and Applications, 20 (6). 54--65.
[17]
Letessier, J., and F. Berard, Visual Tracking of Bare Fingers for Interactive Surfaces. in ACM Symposium on User Interface Software and Technology, (2004).
[18]
Lowe, D. Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision, 60 (2). 91--110.
[19]
Malik, S., and J. Laszlo, Visual Touchpad: A Two-Handed Gestural Input Device. in Proceedings of the International Conference on Multimodal Interfaces, (2004), 289--296.
[20]
Matsushita, N., J. Rekimoto, HoloWall: Designing a Finger, Hand, Body and Object Sensitive Wall. in ACM Symposium on User Interface Software and Technology (UIST), (1997).
[21]
Newman, W., and P. Wellner, A Desk Supporting Computer-based Interaction with Paper Documents. in CHI '92, (1992).
[22]
Owen, C., F. Xiao, and P. Middlin, What is the Best Fiducial? in Augmented Reality Toolkit, the First IEEE International Workshop, (2002).
[23]
Patten, J., H. Ishii, J. Hines, G. Pangaro, Sensetable: A Wireless Object Tracking Platform for Tangible User Interfaces. in Proceedings of CHI 2001, (2001), 253--260.
[24]
Rekimoto, J., SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces. in Proc. CHI 2002, (2002), 113--120.
[25]
Rekimoto, J., and M. Saitoh, Augmented Surfaces: A Spatially Continuous Workspace for Hybrid Computing Environments. in Proceedings of CHI 99, (1999), 378-385.
[26]
Rekimoto, J., and Y. Ayatsuka, CyberCode: Designing Augmented Reality Environments with Visual Tags. in Designing Augmented Reality Environments (DARE 2000), (2000).
[27]
Robinson, J., and C. Robertson, The LivePaper System: Augmenting Paper on and Enhanced Tabletop. in Computers and Graphics, (2001), 731--743.
[28]
Segen, J., and S. Kumar, Shadow Gestures: 3D Hand Pose Estimation Using a Single Camera. in Proceedings of Computer Vision and Pattern Recognition, (1999), 479--485.
[29]
Tomasi, C., A. Rafii, and I. Torunoglu Full-size Projection Keyboard for Handheld Devices. Communications of the ACM, 46 (7). 70--75.
[30]
Ukita, N., and M. Kidode, Wearable Virtual Tablet: Fingertip Drawing on a Portable Plane-object Using An Active-Infrared Camera. in Proceedings of Intelligent User Interfaces, (2004), 169--176.
[31]
Ullmer, B., H. Ishii, The metaDESK: Models and Prototypes for Tangible User Interfaces. in ACM Symposium on User Interface Software and Technology, (1997), 223--232.
[32]
Underkoffler, J., and H. Ishii, Illuminating Light: An Optical Design Tool with a Luminous-Tangible Interface. in Proceedings of the ACM CHI 98 Human Factors in Computing Systems Conference, (1998), 542--549.
[33]
Wellner, P. Interacting with Paper on the DigitalDesk. Communications of the ACM, 36 (7). 86--97.
[34]
Wilson, A., FlowMouse: A Computer Vision-Based Pointing and Gesture Input Device. in Interact '05 (to appear), (2005).
[35]
Wilson, A., TouchLight: An Imaging Touch Screen and Display for Gesture-Based Interaction. in International Conference on Multimodal Interfaces, (2004).
[36]
Wren, C.R., Y. A. Ivanov, Volumetric Operations with Surface Margins. in Computer Vision and Pattern Recognition: Technical Sketches, (2001).
[37]
Wu, M., and R. Balakrishnan, Multi-finger and Whole Hand Gestural Interaction Techniques for Multi-User Tabletop Displays. in ACM Symposium on User Interface Software and Technology, (2003), 193--202.
[38]
Zhang, Z., Y. Wu, Y. Shan, and S. Shafer, Visual Panel: Virtual Mouse, Keyboard and 3D Controller with an Ordinary Piece of Paper. in Workshop on Perceptual User Interfaces (PUI 2001), (2001).

Cited By

View all
  • (2025)Touch Table Interfaces in Therapeutic Rehabilitation: A Systematic ReviewInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2422677(1-15)Online publication date: 17-Jan-2025
  • (2024)The FlexiBoard: Tangible and Tactile Graphics for People with Vision ImpairmentsMultimodal Technologies and Interaction10.3390/mti80300178:3(17)Online publication date: 27-Feb-2024
  • (2024)EgoTouch: On-Body Touch Input Using AR/VR Headset CamerasProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676455(1-11)Online publication date: 13-Oct-2024
  • Show More Cited By

Index Terms

  1. PlayAnywhere: a compact interactive tabletop projection-vision system

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology
    October 2005
    270 pages
    ISBN:1595932712
    DOI:10.1145/1095034
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 23 October 2005

    Permissions

    Request permissions for this article.

    Check for updates

    Qualifiers

    • Article

    Conference

    UIST05

    Acceptance Rates

    UIST '05 Paper Acceptance Rate 31 of 159 submissions, 19%;
    Overall Acceptance Rate 561 of 2,567 submissions, 22%

    Upcoming Conference

    UIST '25
    The 38th Annual ACM Symposium on User Interface Software and Technology
    September 28 - October 1, 2025
    Busan , Republic of Korea

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)78
    • Downloads (Last 6 weeks)11
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Touch Table Interfaces in Therapeutic Rehabilitation: A Systematic ReviewInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2422677(1-15)Online publication date: 17-Jan-2025
    • (2024)The FlexiBoard: Tangible and Tactile Graphics for People with Vision ImpairmentsMultimodal Technologies and Interaction10.3390/mti80300178:3(17)Online publication date: 27-Feb-2024
    • (2024)EgoTouch: On-Body Touch Input Using AR/VR Headset CamerasProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676455(1-11)Online publication date: 13-Oct-2024
    • (2024)RFTIRTouch: Touch Sensing Device for Dual-sided Transparent Plane Based on Repropagated Frustrated Total Internal ReflectionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676428(1-10)Online publication date: 13-Oct-2024
    • (2024)TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676330(1-16)Online publication date: 13-Oct-2024
    • (2024)Investigating the Design of Augmented Narrative Spaces Through Virtual-Real Connections: A Systematic Literature ReviewProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642819(1-18)Online publication date: 11-May-2024
    • (2024)Screenless Interactive Tabletop Gaming with Capacitive Surface SensingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642654(1-10)Online publication date: 11-May-2024
    • (2023)Contactless Interface Using Exhaled Breath and Thermal ImagingSensors10.3390/s2307360123:7(3601)Online publication date: 30-Mar-2023
    • (2023)SurfaceCast: Ubiquitous, Cross-Device Surface SharingProceedings of the ACM on Human-Computer Interaction10.1145/36264757:ISS(286-308)Online publication date: 1-Nov-2023
    • (2023)ShadowTouch: Enabling Free-Form Touch-Based Hand-to-Surface Interaction with Wrist-Mounted Illuminant by Shadow ProjectionProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606785(1-14)Online publication date: 29-Oct-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media