Juan David Hincapié-Ramos
Sophie Roscher
Wolfgang Büschel
Ulrike Kister
Raimund Dachselt
ABSTRACT
As a novel class of mobile devices with rich interaction capabilities we introduce tPads -- transparent display tablets. tPads are the result of a systematic design investigation into the ways and benefits of interacting with transparent mobiles which goes beyond traditional mobile interactions and augmented reality (AR) applications. Through a user-centered design process we explored interaction techniques for transparent-display mobiles and classified them into four categories: overlay, dual display & input, surface capture and model-based interactions. We investigated the technical feasibility of such interactions by designing and building two touch-enabled semi-transparent tablets called tPads and a range of tPad applications. Further, a user study shows that tPad interactions applied to everyday mobile tasks (application switching and image capture) outperform current mobile interactions and were preferred by users. Our hands-on design process and experimental evaluation demonstrate that transparent displays provide valuable interaction opportunities for mobile devices.
Supplemental Material
- Abileah, A., Den Boer, W., and Green, P. 2010. Light sensitive display. U.S. Patent No. 7,830,461. 9 Nov. 2010.Google Scholar
- Alahi, A. and Ortiz, R. and Vandergheynst, P. 2012. FREAK: Fast Retina Keypoint. In Proc. CVPR '12. IEEE. Google ScholarDigital Library
- Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., and MacIntyre, B. 2001. Recent Advances in Augmented Reality. Computer Graphics. 21, 6. IEEE. Google ScholarDigital Library
- Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T. D. 1993. Toolglass and magic lenses: the seethrough interface. In Proc. SIGGRAPH '93. Google ScholarDigital Library
- Bimber, O. and Raskar, R. 2005. Spatial Augmented Reality: Merging Real and Virtual Worlds. A. K. Peters, Ltd., Natick, MA, USA. Google ScholarDigital Library
- Böhmer, M., Hecht, B., Schöning, J., Krüger, A. and Bauer, G. 2011. Falling asleep with Angry Birds, Facebook and Kindle -- A large scale study on mobile application usage. In Proc. MobileHCI '11, ACM. Google ScholarDigital Library
- Concept Phones. (2013, March 17). Transparent Phones. {Website}. Retrieved from http://www.conceptphones.com/tag/transparent-phone/.Google Scholar
- Concept Vending Machine With See-through Display (2013, September 13). Youtube {Website}. Retrieved from http://www.youtube.com/watch?v=8pPCIPHTe3M.Google Scholar
- Corning Incorporated. (2013, March 17). A Day Made of Glass 2: Unpacked. The Story Behind Corning's Vision. (2012) {Website}. Retrieved from http://www.youtube.com/watch?v=X-GXO_urMow.Google Scholar
- Dachselt, R. and Al-Saiegh, S. 2011. Interacting with printed books using digital pens and smart mobile projection. In Proc. of the Workshop on Mobile and Personal Projection (MP2) @ ACM CHI '11.Google Scholar
- Dunlop, M. and Brewster, S. 2002. The Challenge of Mobile Devices for Human Computer Interaction. Personal Ubiquitous Computing. 6, 4. Google ScholarDigital Library
- Gabbard, J.L., Swan, J.E., Zedlitz, J., and Winchester, W.W. 2010. More than meets the eye: An engineering study to empirically examine the blending of real and virtual color spaces. In Proc. VR '10. IEEE. Google ScholarDigital Library
- Hilliges, O., Kim, D., Izadi, S., Weiss, M., and Wilson, A. 2012. HoloDesk: direct 3d interactions with a situated see-through display. In Proc CHI '12. ACM. Google ScholarDigital Library
- Hinckley, K., Dixon, M., Sarin, R., Guimbretiere, F., and Balakrishnan, B. 2009. Codex: a dual screen tablet computer. In Proc. CHI '09. ACM. Google ScholarDigital Library
- Hinckley, K., and Song, H. 2011. Sensor synaesthesia: touch in motion, and motion in touch. In Proc. CHI '11. ACM. Google ScholarDigital Library
- Kim, K., and Elmqvist, N. 2012. Embodied lenses for collaborative visual queries on tabletop displays. Information Visualization, 11(4), 319--338.Google ScholarDigital Library
- Kindberg, T., Spasojevic, M., Fleck, R., and Sellen, A. 2005. The Ubiquitous Camera: An In-Depth Study of Camera Phone Use. IEEE Pervasive Computing. Google ScholarDigital Library
- Lee, J., Olwal, A., Ishii, H., and Boulanger, C. 2013. SpaceTop: integrating 2D and spatial 3D interactions in a see-through desktop environment. In Proc CHI '13. ACM. Google ScholarDigital Library
- Lee, J.H., Bae, S.H., Jung, J., and Choi, H. 2012. Transparent display interaction without binocular parallax. In Adjunct Proc. UIST '12. ACM. Google ScholarDigital Library
- Levia, L.A., Böhmer, M., Gehring, S. and Krüger, A. 2012. Back to the app: The costs of mobile application interrruptions. In Proc. MobileHCI '12, ACM. Google ScholarDigital Library
- Li, Y., Hinckley, K., Guan, Z., and Landay, J. A. 2005. Experimental analysis of mode switching techniques in pen-based user interfaces. In Proc. CHI '05. ACM. Google ScholarDigital Library
- Liao, C., Liu, Q., Liew, B., and Wilcox, L. 2010. Pacer: fine-grained interactive paper via camera-touch hybrid gestures on a cell phone. In Proc. CHI '10. ACM. Google ScholarDigital Library
- Mackay, W.E., Pothier, G., Letondal, C., Bøegh, K., and Sørensen, H.E. 2002. The missing link: augmenting biology laboratory notebooks. In Proc. UIST '02. ACM. Google ScholarDigital Library
- Ohtani, T., Hashida, T., Kakehi, Y., and Naemura, T. 2011. Comparison of front touch and back touch while using transparent double-sided touch display. In ACM SIGGRAPH 2011 Posters (SIGGRAPH '11). ACM. Google ScholarDigital Library
- Olwal, A., Lindfors, C., Gustafsson, J., Kjellberg, T., and Mattsson, L. 2005. ASTOR: An autostereoscopic optical see-thru augmented reality system. In Proc. ISMAR '05. IEEE. Google ScholarDigital Library
- Rosten, E. and Drummond, T. 2006. Machine learning for high-speed corner detection. In Proc. ECCV '06. Springer Berlin Heidelberg. Google ScholarDigital Library
- Ruiz, J., and Li, Y. 2011. DoubleFlip: a motion gesture delimiter for mobile interaction. In Proc. CHI '11. ACM. Google ScholarDigital Library
- Schilit, B. N., Golovchinsky, G., and Price, M. N. 1998. Beyond paper: supporting active reading with free form digital ink annotations. In Proc. CHI '98. ACM. Google ScholarDigital Library
- Schmalstieg, D., Encarnação, L. M., and Szalavári, Z. 1999. Using transparent props for interaction with the virtual table. In Proc. I3D '99. ACM. Google ScholarDigital Library
- Sharma, A., Liu, L., and Maes, P. 2013. Glassified: An Augmented Ruler based on a Transparent Display for Real-time Interactions with Paper. In Proc. UIST '13 Demos. Google ScholarDigital Library
- Spindler, M., Tominski, C., Schumann, H., and Dachselt, R. 2010. Tangible views for information visualization. In Proc. ITS '10. ACM. Google ScholarDigital Library
- Sridharan, S.K., Hincapié-Ramos, J.D., Flatla, D., and Irani, P. 2013. Color Correction for Optical See-Through Displays Using Display Color Profiles. In Proc. VRST '13. ACM. Google ScholarDigital Library
- Transparent dual-touch display Android smartphone prototype #DigInfo. (2012). {Website}. Retrieved from http://www. youtube.com/watch?v=Xbyoool5ZwY.Google Scholar
- Uy, M. 2009. Integrated sensing display. U.S. Patent No. 7,535,468. 19 May 2009.Google Scholar
- Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., and Shen, C. 2007. Lucid touch: a see-through mobile device. In Proc. UIST '07. ACM. Google ScholarDigital Library
Index Terms
- tPad: designing transparent-display mobile interactions
Recommendations
Glassified: an augmented ruler based on a transparent display for real-time interactions with paper
UIST '13 Adjunct: Adjunct Proceedings of the 26th Annual ACM Symposium on User Interface Software and TechnologyWe introduce Glassified, a modified ruler with a transparent display to supplement physical strokes made on paper with virtual graphics. Because the display is transparent, both the physical strokes and the virtual graphics are visible in the same ...
A two-sided collaborative transparent display supporting workspace awareness
Transparent displays naturally support workspace awareness during face-to-face interactions. Viewers see another persons actions through the display: gestures, gaze, body movements, and what one is manipulating on the display. Yet we can design even ...
Demonstrating CleAR Sight: Transparent Interaction Panels for Augmented Reality
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing SystemsIn this work, we demonstrate our concepts for transparent interaction panels in augmented-reality environments. Mobile devices can support interaction with head-mounted displays by providing additional input channels, such as touch & pen input and ...
Comments