skip to main content
10.1145/2611009.2611014acmconferencesArticle/Chapter ViewAbstractPublication PagesperdisConference Proceedingsconference-collections
tutorial

cAR: Contact Augmented Reality with Transparent-Display Mobile Devices

Published: 03 June 2014 Publication History

Abstract

We present Contact Augmented Reality (cAR), a form of AR where a mobile device with a transparent display rests on top of the augmented object. cAR is based on the notion that interactions with digital content are enriched by the tangibility of physically moving a device on and off the augmented object. We propose and implement three categories of cAR interaction techniques: contact-based, off-contact and content-aware. We built two cAR prototypes and explore how cAR can be applied to the domain of active reading. A first low-fidelity prototype, consisting of an interactive tabletop and transparent acrylic tangibles, allowed us to iteratively design and test interaction techniques. The second and higher-fidelity prototype, called a tPad, uses a semi-transparent touch-enabled 7" LCD display that is placed on top of back-lit paper documents. The tPad uses an external camera and feature matching algorithms to identify the document and to determine its location and orientation. We report on user feedback and elaborate on the salient technical challenges for cAR devices.

References

[1]
Adler, A., Gujar, A., Harrison, B., O'Hara, K., and Sellen, A. A diary study of work-related reading: design implications for digital reading devices. In Proc. CHI '98.
[2]
Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., and MacIntyre, B. 2001. Recent Advances in Augmented Reality. IEEE Comput. Graph. Appl. 21, 6.
[3]
Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T. D. 1993. Toolglass and magic lenses: the see-through interface. In Proc. SIGGRAPH '93.
[4]
Bimber, O. and Raskar, R. 2005. Spatial Augmented Reality: Merging Real and Virtual Worlds. A. K. Peters, Ltd., USA.
[5]
Corning Incorporated. (2013, March 17). A Day Made of Glass 2: Unpacked. The Story Behind Corning's Vision. (2012) {Video file}. Retrieved from http://www.youtube.com/watch?v=X-GXO_urMow.
[6]
Dachselt, R. and Al-Saiegh, S. Interacting with printed books using digital pens and smart mobile projection. In Proc. of the Workshop on Mobile and Personal Projection (MP2) @ ACM CHI 2011, 2011.
[7]
Hincapié-Ramos, J.D., Roscher, S., Büschel, W., Kister, U., Dachselt, R. and Irani, P. 2014. tPad: Designing Transparent-Display Mobile Interactions. In Proc. DIS '14. ACM.
[8]
Iwamura, M., Nakai, T., and Kise, K. 2007. Improvement of Retrieval Speed and Required Amount of Memory for Geometric Hashing by Combining Local Invariants. In Proc. BMVC '07.
[9]
Kim, K., and Elmqvist, N. 2012. Embodied lenses for collaborative visual queries on tabletop displays. Information Visualization, 11(4).
[10]
Lee, J.H., Bae, S.H., Jung, J., and Choi, H. 2012. Transparent display interaction without binocular parallax. In Adj. Proc. UIST '12. ACM.
[11]
Liao, C., Liu, Q., Liew, B., and Wilcox, L. 2010. Pacer: fine-grained interactive paper via camera-touch hybrid gestures on a cell phone. In Proc. CHI '10. ACM.
[12]
Mackay, W.E., Pothier, G., Letondal, C., Bøegh, K., and Sørensen, H.E. 2002. The missing link: augmenting biology laboratory notebooks. In Proc. UIST '02. ACM.
[13]
Maeda, A., Hara, K., Kobayashi, M., and Abe, M. 2011. "ClearPlate" for capturing printed information: a scanner and viewfinder in one optical unit. In Proc CHI '11. ACM.
[14]
Matulic, F., and Norrie, M. C. Supporting active reading on pen and touch-operated tabletops. In Proc. AVI '12. 2012.
[15]
Ohtani, T., Hashida, T., Kakehi, Y., and Naemura, T. 2011. Comparison of front touch and back touch while using transparent double-sided touch display. In ACM SIGGRAPH 2011 Posters (SIGGRAPH '11). ACM, 2011.
[16]
Olwal, A. and Feiner, S. 2009. Spatially aware handhelds for high-precision tangible interaction with large displays. In Proc. TEI '09. ACM.
[17]
Price, M. N., Schilit, B. N. and Golovchinsky, G. 1998. Xlibris: the active reading machine. In Proc. CHI 98. ACM.
[18]
Reilly, D., Rodgers, M., Argue, R., Nunes, M., and Inkpen, K. 2006. Marked-up maps: combining paper maps and electronic information resources. In Personal Ubiquitous Computing.
[19]
Reitmayr, G., Eade, E., and Drummond, T. 2005. Localisation and Interaction for Augmented Maps. In Proc. ISMAR '05. IEEE.
[20]
Schilit, B., Golovchinsky, G., and Price, M. Beyond paper: supporting active reading with free form digital ink annotations. In Proc. CHI '98, pp 249--256.
[21]
Schmalstieg, D., Encarnação, L. M., and Szalavári, Z. 1999. Using transparent props for interaction with the virtual table. In Proc. I3D '99. ACM.
[22]
Sharma, A., Liu, L., and Maes, P. 2013. Glassified: An Augmented Ruler based on a Transparent Display for Real-time Interactions with Paper. In Proc. UIST '13 Demos.
[23]
Spindler, M., Tominski, C., Schumann, H., and Dachselt, R. 2010. Tangible views for information visualization. In Proc. ITS '10. ACM.
[24]
Sridharan, S.K., Hincapié-Ramos, J.D., Flatla, D., and Irani, P. 2013. Color Correction for Optical See-Through Displays Using Display Color Profiles. In Proc. VRST '13. ACM.
[25]
Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., and Shen C. 2007. Lucid touch: a see-through mobile device. In Proc. UIST '07. ACM.

Cited By

View all
  • (2024)Fusion information refresh rate improvement based on adaptive visual tracking in vehicle augmented reality sightseeing interactive systemJournal of the Society for Information Display10.1002/jsid.127632:8(545-554)Online publication date: 10-Mar-2024
  • (2023)Demonstrating CleAR Sight: Transparent Interaction Panels for Augmented RealityExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583891(1-5)Online publication date: 19-Apr-2023
  • (2022)LightMeUp: Back-print Illumination Paper Display with Multi-stable VisualsProceedings of the ACM on Human-Computer Interaction10.1145/35703336:ISS(407-429)Online publication date: 14-Nov-2022
  • Show More Cited By

Index Terms

  1. cAR: Contact Augmented Reality with Transparent-Display Mobile Devices

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    PerDis '14: Proceedings of The International Symposium on Pervasive Displays
    June 2014
    217 pages
    ISBN:9781450329521
    DOI:10.1145/2611009
    • Editor:
    • Sven Gehring,
    • General Chair:
    • Sebastian Boring,
    • Program Chair:
    • Aaron Quigley
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 03 June 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Contact Augmented Reality
    2. Transparent Devices

    Qualifiers

    • Tutorial
    • Research
    • Refereed limited

    Conference

    PerDis '14
    Sponsor:

    Acceptance Rates

    PerDis '14 Paper Acceptance Rate 30 of 50 submissions, 60%;
    Overall Acceptance Rate 213 of 384 submissions, 55%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)27
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Fusion information refresh rate improvement based on adaptive visual tracking in vehicle augmented reality sightseeing interactive systemJournal of the Society for Information Display10.1002/jsid.127632:8(545-554)Online publication date: 10-Mar-2024
    • (2023)Demonstrating CleAR Sight: Transparent Interaction Panels for Augmented RealityExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583891(1-5)Online publication date: 19-Apr-2023
    • (2022)LightMeUp: Back-print Illumination Paper Display with Multi-stable VisualsProceedings of the ACM on Human-Computer Interaction10.1145/35703336:ISS(407-429)Online publication date: 14-Nov-2022
    • (2022)Dynamic Pinhole Paper: Interacting with Horizontal Displays through Perforated PaperProceedings of the ACM on Human-Computer Interaction10.1145/35677206:ISS(254-276)Online publication date: 14-Nov-2022
    • (2022)Paper Trail: An Immersive Authoring System for Augmented Reality Instructional ExperiencesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517486(1-16)Online publication date: 29-Apr-2022
    • (2022)Dually Noted: Layout-Aware Annotations with Smartphone Augmented RealityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502026(1-15)Online publication date: 29-Apr-2022
    • (2022)Stranger Screens: Exploring the Application Themes for Interactive Freeform DevicesCHI Conference on Human Factors in Computing Systems Extended Abstracts10.1145/3491101.3519707(1-5)Online publication date: 27-Apr-2022
    • (2022)Interactive Extended Reality Techniques in Information VisualizationIEEE Transactions on Human-Machine Systems10.1109/THMS.2022.321131752:6(1338-1351)Online publication date: Dec-2022
    • (2022)CleAR Sight: Exploring the Potential of Interacting with Transparent Tablets in Augmented Reality2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00034(196-205)Online publication date: Oct-2022
    • (2021)Hybrid Paper-Digital Interfaces: A Systematic Literature ReviewProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462059(1087-1100)Online publication date: 28-Jun-2021
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media