skip to main content
10.1145/2396636.2396674acmconferencesArticle/Chapter ViewAbstractPublication PagesissConference Proceedingsconference-collections
research-article

Use your head: tangible windows for 3D information spaces in a tabletop environment

Published: 11 November 2012 Publication History

Abstract

Tangible Windows are a novel concept for interacting with virtual 3D information spaces in a workbench-like multi-display environment. They allow for performing common 3D interaction tasks in a more accessible manner by combining principles of tangible interaction, head-coupled perspective, and multi-touch techniques. Tangible Windows unify the interaction and representation space in a single device. They either act as physical peepholes into a virtual 3D world or as physical containers for parts of that world and are well-suited for the collaborative exploration and manipulation of such information spaces. One important feature of Tangible Windows is that the use of obtrusive hardware, such as HMDs, is strictly avoided. Instead, lightweight paper-based displays are used. We present different techniques for canonical 3D interaction tasks such as viewport control or object selection and manipulation, based on the combination of independent input modalities. We tested these techniques on a self-developed prototype system and received promising early user feedback.

Supplementary Material

suppl.mov (its0147-file3.wmv)
Supplemental video

References

[1]
Agrawala,M.,Beers,A.C.,McDowall,I.,Fröhlich,B.,Bolas,M.,and Hanrahan, P. The Two-user Responsive Workbench: Support for Collaboration through Individual Views of a Shared Space. In Proc. of SIGGRAPH, ACM Press (1997), 327--332.
[2]
Bell,B.,Höllerer,T.,andFeiner,S.Anannotatedsituation-awarenessaid for augmented reality. In Proc. of UIST, ACM Press (2002), 213--216.
[3]
Benko, H., and Feiner, S. Balloon Selection: A Multi-Finger Technique for Accurate Low-Fatigue 3D Selection. In Proc. of 3DUI (2007), 79--86.
[4]
Benko, H., Jota, R., and Wilson, A. MirageTable: Freehand Interaction on a Projected Augmented Reality Tabletop. In Proc. of CHI, ACM Press (2012), 199--208.
[5]
Bier,E.A.,Stone,M.C.,Pier,K.,Buxton,W.,andDeRose,T.D. Toolglass and Magic Lenses: The See-through Interface. In Proc. of SIGGRAPH, ACM Press (1993), 73--80.
[6]
Bowman,D.A.,Kruijff,E.,LaViola,J.J.,andPoupyrev,I.3DUser Interfaces: Theory and Practice. Addison Wesley Longman Publishing Co., Inc., 2004.
[7]
Brown,L.D.,Hua,H.,andGao,C.AWidgetFrameworkforAugmen- ted Interaction in SCAPE. In Proc. of UIST, ACM Press (2003), 1--10.
[8]
Chan,C.,Lai,S.,andZhan,Y.EvaluationOfAHeadTracked3-D Document Visualization. In Proc. of Human Interface Technologies Conference (2006).
[9]
Chan,L.-W.,Wu,H.-T.,Kao,H.-S.,Ko,J.-C.,Lin,H.-R.,Chen,M.Y., Hsu, J., and Hung, Y.-P. Enabling beyond-surface interactions for interactive surface with an invisible projection. In Proc. of UIST, ACM Press (2010), 263--272.
[10]
deAlmeida,R.A.,Pillias,C.,Pietriga,E.,andCubaud,P.Looking behind bezels: French windows for wall displays. In Proc. of AVI, ACM Press (2012), 124--131.
[11]
Downing,E.,Hesselink,L.,Ralston,J.,andMacfarlane,R.A Three-Color, Solid-State, Three-Dimensional Display. Science 273, 5279 (1996), 1185--1189.
[12]
Favalora,G.Volumetric3DDisplaysandApplicationInfrastructure. Computer 38, 8 (2005), 37--44.
[13]
Fitzmaurice,G.,Zhai,S.,andChignell,M.VirtualRealityforPalmtop Computers. Trans. Inf. Syst. 11, 3 (1993), 197--218.
[14]
Francone,J.,andNigay,L.UsingtheUser'sPointofViewfor Interaction on Mobile Devices. In Actes de la Conference francophone sur l'Interaction Homme-Machine (IHM), ACM Press (2011), 25--31.
[15]
Grossman,T.,andWigdor,D.GoingDeeper:ATaxonomyof3Donthe Tabletop. In Proc. of Tabletop, IEEE (2007), 137--144.
[16]
Hancock,M.,Carpendale,S.,andCockburn,A.Shallow-Depth3D Interaction: Design and Evaluation of One-, Two- and Three-Touch Techniques. In Proc. of CHI, ACM Press (2007), 1147--1156.
[17]
Hancock, M., Nacenta, M., Gutwin, C., and Carpendale, S. The Effects of Changing Projection Geometry on the Interpretation of 3D Orientation on Tabletops. In Proc. of ITS, ACM Press (2009), 175--182.
[18]
Hancock, M., ten Cate, T., and Carpendale, S. Sticky Tools: Full 6DOF Force-based Interaction for Multi-touch Tables. In Proc. of ITS, ACM Press (2009), 133--140.
[19]
Hancock, M. S., and Carpendale, S. Supporting Multiple Off-Axis Viewpoints at a Tabletop Display. In Proc. of Tabletop, IEEE (2007), 171--178.
[20]
Harrison, C., and Dey, A. K. Lean and Zoom: Proximity-aware User Interface and Content Magnification. In Proc. of CHI, ACM Press (2008), 507--510.
[21]
Hilliges, O., Izadi, S., Wilson, A. D., Hodges, S., Garcia-Mendoza, A., and Butz, A. Interactions in the air: Adding further depth to interactive tabletops. In Proc. of UIST, ACM Press (2009), 139--148.
[22]
Holman, D., Vertegaal, R., Altosaar, M., Troje, N., and Johns, D. Paper Windows: Interaction Techniques for Digital Paper. In Proc. of CHI, ACM Press (2005), 591--599.
[23]
Izadi,S.,Hodges,S.,Taylor,S.,Rosenfeld,D.,Villar,N.,Butler,A.,and Westhues, J. Going Beyond the Display: A Surface Technology with an Electronically Switchable Diffuser. In Proc. of UIST, ACM Press (2008), 269--278.
[24]
Kjeldsen, R. Head Gestures for Computer Control. In Proc. of ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, IEEE (2001), 61--68.
[25]
Krüger, W., Bohn, C., Fröhlich, B., Schu th, H., Strauss, W., and Wesche, G. The Responsive Workbench: A Virtual Work Environment. Computer 28, 7 (1995), 42--48.
[26]
Lee,J.HackingtheNintendoWiiRemote.PervasiveComputing 7,3 (2008), 39--45.
[27]
Molyneaux, D., Izadi, S., Kim, D., Hilliges, O., Hodges, S., Cao, X., Butler, A., and Gellersen, H. Interactive environment-aware handheld projectors for pervasive computing spaces. In Pervasive, vol. 7319 of Lecture Notes in Computer Science, Springer (2012), 197--215.
[28]
Nacenta,M.A.,Sakurai,S.,Yamaguchi,T.,Miki,Y.,Itoh,Y.,Kitamura, Y., Subramanian, S., and Gutwin, C. E-conic: A Perspective-aware Interface for Multi-Display Environments. In Proc. of UIST, ACM Press (2007), 279--288.
[29]
Reisman,J.L.,Davidson,P.L.,andHan,J.Y.AScreen-Space Formulation for 2D and 3D Direct Manipulation. In Proc. of UIST, ACM Press (2009), 69--78.
[30]
Spindler, M., Stellmach, S., and Dachselt, R. PaperLens: Advanced Magic Lens Interaction Above the Tabletop. In Proc. of ITS, ACM Press (2009), 77--84.
[31]
Spindler, M., Tominski, C., Schumann, H., and Dachselt, R. Tangible Views for Information Visualization. In Proc. of ITS, ACM Press (2010), 157--166.
[32]
Stoakley, R., Conway, M. J., and Pausch, R. Virtual Reality on a WIM: Interactive Worlds in Miniature. In Proc. of CHI, ACM Press (1995), 265--272.
[33]
Szalavri, Z., and Gervautz, M. The Personal Interaction Panel - A Two-Handed Interface for Augmented Reality. In Proc. of EUROGRAPHICS, ACM Press (1997), 335--346.
[34]
Tan, D. S., Pausch, R., Stefanucci, J. K., and Proffitt, D. R. Kinesthetic cues aid spatial memory. In Proc. of CHI Extended Abstracts, ACM Press (2002), 806--807.
[35]
Tsang,M.,Fitzmaurice,G.,Kurtenbach,G.,Khan,A.,andBuxton,B. Boom Chameleon: Simultaneous Capture of 3D Viewpoint, Voice and Gesture Annotations on a Spatially-aware Display. In Proc. of UIST, ACM Press (2002), 111--120.
[36]
Ullmer, B., and Ishii, H. The metaDESK: models and prototypes for tangible user interfaces. In Proc. of UIST, ACM Press (1997), 223--232.
[37]
Viega, J., Conway, M. J., Williams, G., and Pausch, R. 3D Magic Lenses. In Proc. of UIST, ACM Press (1996), 51--58.
[38]
Ware, C., Arthur, K., and Booth, K. Fish Tank Virtual Reality. In Proc. of INTERACT and CHI, ACM Press (1993), 37--42.
[39]
Ware,C.,andOsborne,S.ExplorationandVirtualCameraControlin Virtual Three Dimensional Environments. SIGGRAPH Comput. Graph. 24 (February 1990), 175--183.
[40]
Wilson,A.D.,andBenko,H.Combiningmultipledepthcamerasand projectors for interactions on, above and between surfaces. In Proc. of UIST, UIST '10, ACM (New York, NY, USA, 2010), 273--282.
[41]
Yee, K. Peephole Displays: Pen Interaction on Spatially Aware Handheld Computers. In Proc. of CHI, ACM Press (2003), 1--8.

Cited By

View all
  • (2023)A Design Space of Multi-Display Spatial Interactions for Visualization TasksProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614516(1-13)Online publication date: 13-Oct-2023
  • (2023)Stereoscopic Viewing and Monoscopic Touching: Selecting Distant Objects in VR Through a Mobile DeviceProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606809(1-7)Online publication date: 29-Oct-2023
  • (2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
  • Show More Cited By

Index Terms

  1. Use your head: tangible windows for 3D information spaces in a tabletop environment

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
    November 2012
    430 pages
    ISBN:9781450312097
    DOI:10.1145/2396636
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 11 November 2012

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. 3d interaction
    2. fish tank virtual reality
    3. head interaction
    4. head tracking
    5. head-coupled perspective
    6. magic lenses
    7. multi-surface user interfaces
    8. multiple views
    9. tabletop displays
    10. tangible windows

    Qualifiers

    • Research-article

    Conference

    ITS'12
    Sponsor:
    ITS'12: Interactive Tabletops and Surfaces
    November 11 - 14, 2012
    Massachusetts, Cambridge, USA

    Acceptance Rates

    ITS '12 Paper Acceptance Rate 24 of 63 submissions, 38%;
    Overall Acceptance Rate 119 of 418 submissions, 28%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)39
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)A Design Space of Multi-Display Spatial Interactions for Visualization TasksProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614516(1-13)Online publication date: 13-Oct-2023
    • (2023)Stereoscopic Viewing and Monoscopic Touching: Selecting Distant Objects in VR Through a Mobile DeviceProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606809(1-7)Online publication date: 29-Oct-2023
    • (2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
    • (2022)Blending Spaces: Cross-Reality Interaction Techniques for Object Transitions Between Distinct Virtual and Augmented Realities2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00069(528-537)Online publication date: Oct-2022
    • (2022)CleAR Sight: Exploring the Potential of Interacting with Transparent Tablets in Augmented Reality2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00034(196-205)Online publication date: Oct-2022
    • (2021)Hands-On Deformation of Volumetric Anatomical Images on a TouchscreenApplied Sciences10.3390/app1120950211:20(9502)Online publication date: 13-Oct-2021
    • (2021)Mobile Displays for Cross-Reality Interactions between Virtual and Physical RealitiesProceedings of the 20th International Conference on Mobile and Ubiquitous Multimedia10.1145/3490632.3497838(217-219)Online publication date: 5-Dec-2021
    • (2021)Reading in VR: The Effect of Text Presentation Type and LocationProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445606(1-10)Online publication date: 6-May-2021
    • (2021)Uplift: A Tangible and Immersive Tabletop System for Casual Collaborative Visual AnalyticsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.303033427:2(1193-1203)Online publication date: Feb-2021
    • (2021)Exploring and Slicing Volumetric Medical Data in Augmented Reality Using a Spatially-Aware Mobile Device2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct54149.2021.00076(334-339)Online publication date: Oct-2021
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media