skip to main content
10.1145/2839462.2839468acmotherconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
research-article

Tangible Viewports: Getting Out of Flatland in Desktop Environments

Published: 14 February 2016 Publication History

Abstract

Spatial augmented reality and tangible interaction enrich the standard computer I/O space. Systems based on such modalities offer new user experiences and open up interesting perspectives in various fields. On the other hand, such systems tend to live outside the standard desktop paradigm and, as a consequence, they do not benefit from the richness and versatility of desktop environments. In this work, we propose to join together physical visualization and tangible interaction within a standard desktop environment. We introduce the concept of Tangible Viewport, an on-screen window that creates a dynamic link between augmented objects and computer screens, allowing a screen-based cursor to move onto the object in a seamless manner. We describe an implementation of this concept and explore the interaction space around it. A preliminary evaluation shows the metaphor is transparent to the users while providing the benefits of tangibility.

References

[1]
Eric Akaoka, Tim Ginn, and Roel Vertegaal. 2010. DisplayObjects: Prototyping Functional Physical Interfaces on 3D Styrofoam, Paper or Cardboard Models. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '10). ACM, 49--56.
[2]
Ravin Balakrishnan and Gordon Kurtenbach. 1999. Exploring Bimanual Camera Control and Object Manipulation in 3D Graphics Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, 56--62.
[3]
D. Bandyopadhyay, R. Raskar, and H. Fuchs. 2001. Dynamic shader lamps: painting on movable objects. In Augmented Reality, 2001. Proceedings. IEEE and ACM International Symposium on. IEEE Comput. Soc, 207--216.
[4]
Hrvoje Benko, Ricardo Jota, and Andrew Wilson. 2012. MirageTable: Freehand Interaction on a Projected Augmented Reality Tabletop. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, 199--208.
[5]
Hrvoje Benko, Andrew D. Wilson, and Federico Zannier. 2014. Dyadic Projected Spatial Augmented Reality. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, 645--655.
[6]
Jessica R. Cauchard, Markus Löchtefeld, Pourang Irani, Johannes Schoening, Antonio Krüger, Mike Fraser, and Sriram Subramanian. 2011. Visual Separation in Mobile Multi-display Environments. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, 451--460.
[7]
Jérémy Frey, Renaud Gervais, Stéphanie Fleck, Fabien Lotte, and Martin Hachet. 2014. Teegi: Tangible EEG Interface. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, 301--308.
[8]
Renaud Gervais, Jérémy Frey, and Martin Hachet. 2015. Pointing in Spatial Augmented Reality from 2D Pointing Devices. In INTERACT. Bamberg, Germany, 8.
[9]
Otmar Hilliges, David Kim, Shahram Izadi, Malte Weiss, and Andrew Wilson. 2012. HoloDesk: Direct 3D Interactions with a Situated See-through Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, 2421--2430.
[10]
David Holman, Audrey Girouard, Hrvoje Benko, and Roel Vertegaal. 2013. The Design of Organic User Interfaces: Shape, Sketching and Hypercontext. Interacting with Computers 25, 2 (2013), 133--142.
[11]
Hiroshi Ishii, Dávid Lakatos, Leonardo Bonanni, and Jean-Baptiste Labrune. 2012. Radical Atoms: Beyond Tangible Bits, Toward Transformable Materials. interactions 19, 1 (jan 2012), 38--51.
[12]
Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI '97). ACM, 234--241.
[13]
Yvonne Jansen, Pierre Dragicevic, and Jean-Daniel Fekete. 2013. Evaluating the Efficiency of Physical Visualizations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, 2593--2602.
[14]
Brett Jones, Rajinder Sodhi, Michael Murdock, Ravish Mehra, Hrvoje Benko, Andrew Wilson, Eyal Ofek, Blair MacIntyre, Nikunj Raghuvanshi, and Lior Shapira. 2014. RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-camera Units. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, 637--644.
[15]
Shaun K. Kane, Daniel Avrahami, Jacob O. Wobbrock, Beverly Harrison, Adam D. Rea, Matthai Philipose, and Anthony LaMarca. 2009. Bonfire: A Nomadic System for Hybrid Laptop-tabletop Interaction. In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology (UIST '09). ACM, 129--138.
[16]
Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and evaluation of a user experience questionnaire. Springer.
[17]
Michael R Marner and Bruce H Thomas. 2010. Augmented foam sculpting for capturing 3D models. In 3D User Interfaces (3DUI), 2010 IEEE Symposium on. IEEE, 63--70.
[18]
Michael R. Marner, Bruce H. Thomas, and Christian Sandor. 2009. Physical-virtual tools for spatial augmented reality user interfaces, In Mixed and Augmented Reality, 2009. ISMAR 2009. 8th IEEE International Symposium on. 2009 8th IEEE International Symposium on Mixed and Augmented Reality (oct 2009), 205--206.
[19]
Miguel A. Nacenta, Satoshi Sakurai, Tokuo Yamaguchi, Yohei Miki, Yuichi Itoh, Yoshifumi Kitamura, Sriram Subramanian, and Carl Gutwin. 2007. E-conic: A Perspective-aware Interface for Multi-display Environments. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07). ACM, 279--288.
[20]
Miguel A. Nacenta, Samer Sallam, Bernard Champoux, Sriram Subramanian, and Carl Gutwin. 2006. Perspective Cursor: Perspective-based Interaction for Multi-display Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). ACM, 289--298.
[21]
Richard A Newcombe, Shahram Izadi, Otmar Hilliges, David Molyneaux, David Kim, Andrew J Davison, Pushmeet Kohi, Jamie Shotton, Steve Hodges, and Andrew Fitzgibbon. 2011. KinectFusion: Real-time dense surface mapping and tracking. In Mixed and Augmented Reality (ISMAR), 2011 10th IEEE International Symposium on. IEEE, 127--136.
[22]
Ben Piper, Carlo Ratti, and Hiroshi Ishii. 2002. Illuminating Clay: A 3-D Tangible Interface for Landscape Analysis. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02). ACM, 355--362.
[23]
Ramesh Raskar, Greg Welch, Matt Cutts, Adam Lake, Lev Stesin, and Henry Fuchs. 1998b. The Office of the Future: A Unified Approach to Image-based Modeling and Spatially Immersive Displays. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '98). ACM, 179--188.
[24]
Ramesh Raskar, Greg Welch, and Henry Fuchs. 1998a. Spatially augmented reality. In First IEEE Workshop on Augmented Reality (IWAR'98). Citeseer, 11--20.
[25]
Ramesh Raskar, Greg Welch, Kok-Lim Low, and Deepak Bandyopadhyay. 2001. Shader Lamps: Animating Real Objects With Image-Based Illumination. In Eurographics, StevenJ. Gortler and Karol Myszkowski (Eds.). Springer Vienna, 89--102.
[26]
Jun Rekimoto and Masanori Saitoh. 1999. Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, 378--385.
[27]
Daniel Pieter Saakes. 2010. Shape does matter: designing materials in products. TU Delft, Delft University of Technology.
[28]
Orit Shaer and Eva Hornecker. 2009. Tangible User Interfaces: Past, Present, and Future Directions. Foundations and Trends in Human-Computer Interaction 3, 1-2 (2009), 1--137.
[29]
Desney S Tan and Mary Czerwinski. 2003. Effects of visual separation and physical discontinuities when distributing information across multiple displays. In INTERACT, Vol. 3. 252--255.
[30]
Robert J. Teather and Wolfgang Stuerzlinger. 2013. Pointing at 3D Target Projections with One-eyed and Stereo Cursors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, 159--168.
[31]
John Underkoffler and Hiroshi Ishii. 1999. Urp: A Luminous-tangible Workbench for Urban Planning and Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, 386--393.
[32]
Andrew Wilson, Hrvoje Benko, Shahram Izadi, and Otmar Hilliges. 2012. Steerable Augmented Reality with the Beamatron. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, 413--422.
[33]
Robert Xiao, Miguel A. Nacenta, Regan L. Mandryk, Andy Cockburn, and Carl Gutwin. 2011. Ubiquitous Cursor: A Comparison of Direct and Indirect Pointing Feedback in Multi-display Environments. In Proceedings of Graphics Interface 2011 (GI '11). Canadian Human-Computer Communications Society, 135--142.

Cited By

View all
  • (2023)Measuring the Impact of Augmented Prototyping Systems in Co-Design ActivitiesMultimodal Technologies and Interaction10.3390/mti71101087:11(108)Online publication date: 18-Nov-2023
  • (2023)Grounding Graph Theory in Embodied Concreteness with Virtual RealityProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572733(1-13)Online publication date: 26-Feb-2023
  • (2023)When Realities Interweave: Exploring the Design Space of Immersive Tangible XRProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3571843(1-4)Online publication date: 26-Feb-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction
February 2016
820 pages
ISBN:9781450335829
DOI:10.1145/2839462
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 February 2016

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Spatial Augmented Reality
  2. Tangible Interaction

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

TEI '16

Acceptance Rates

TEI '16 Paper Acceptance Rate 45 of 178 submissions, 25%;
Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)33
  • Downloads (Last 6 weeks)3
Reflects downloads up to 11 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Measuring the Impact of Augmented Prototyping Systems in Co-Design ActivitiesMultimodal Technologies and Interaction10.3390/mti71101087:11(108)Online publication date: 18-Nov-2023
  • (2023)Grounding Graph Theory in Embodied Concreteness with Virtual RealityProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572733(1-13)Online publication date: 26-Feb-2023
  • (2023)When Realities Interweave: Exploring the Design Space of Immersive Tangible XRProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3571843(1-4)Online publication date: 26-Feb-2023
  • (2023)Perspective and Geometry Approaches to Mouse Cursor Control in Spatial Augmented RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580849(1-19)Online publication date: 19-Apr-2023
  • (2023)Projected Augmented Reality for Industrial Design: Challenges and OpportunitiesTowards a Smart, Resilient and Sustainable Industry10.1007/978-3-031-38274-1_6(61-73)Online publication date: 4-Aug-2023
  • (2022)The Hitchhiker’s Guide to Fused Twins: A Review of Access to Digital Twins In Situ in Smart CitiesRemote Sensing10.3390/rs1413309514:13(3095)Online publication date: 27-Jun-2022
  • (2022)In-Depth Mouse: Integrating Desktop Mouse into Virtual RealityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501884(1-17)Online publication date: 29-Apr-2022
  • (2022)Everywhere Cursor: Extending Desktop Mouse Interaction into Spatial Augmented RealityExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519796(1-7)Online publication date: 27-Apr-2022
  • (2022)Creating and Augmenting Keyboards for Extended Reality with the Keyboard Augmentation ToolkitACM Transactions on Computer-Human Interaction10.1145/349049529:2(1-39)Online publication date: 16-Jan-2022
  • (2021)Exploring Tablet Interfaces for Product Appearance Authoring in Spatial Augmented RealityInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2021.102719156:COnline publication date: 1-Dec-2021
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media