Chih-Sung (Andy) Wu
ABSTRACT
The Graphical User Interface (GUI) has created an efficient work environment for many applications. However, when users are confined by keyboards and mice, they lose the ability to interact with the virtual world using habits from the real world. Our research examine how emerging modes of authorship, such as wikis, can be used to generate new possibilities for bringing atoms and bits together for digital annotation. Our goal is to combine the everyday habits in reading books with emerging digital possibilities.
In this paper, we present a prototype system called WikiTUI, which brings digital media to physical paper books. This system allows readers to access the digital world through fingertip interactions on books, and enables them to share information with other readers using wiki technology. WikiTUI not only bridges the gap between the digital and the physical worlds, but also facilitates multiple contributions to a reference base spanning across these worlds. We present user evaluations of the WikiTUI prototype and discuss research implications.
- Ahmad, S., A Usable Real-Time 3D Hand Tracker. IEEE Asilomar Conf. 1994, (1994), 1257--1261.Google Scholar
- Anderson, K. M., Taylor, R. N., and Whitehead, E. J. Chimera: hypermedia for heterogeneous software development environments. ACM Trans. Inf. Syst. 18, 3 ACM Press (2000), 211--245. Google ScholarDigital Library
- Ashdown, M. and Robinson, P. Escritoire: a personal projected display. Multimedia, IEEE 12, 1, IEEE CS Press (2005), 34--42. Google ScholarDigital Library
- Back, M. J. and Cohen, J. Page detection using embedded tags. Proc. UIST 2000, ACM Press (2000), 159--160. Google ScholarDigital Library
- Bobick, A. F., Wilson, A. D. A State-Based Approach to the Representation and Recognition of Gesture. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 12, (1997), 1325--1337. Google ScholarDigital Library
- Bolter, J. D., Writing space: the computer, hypertext, and the history of writing. Lawrence Erlbaum Associates, Inc., Mahwah, NJ, USA, 1991 Google ScholarDigital Library
- Bush, V. As we may think. Interactions 3, 2 (1996), 35--46. Google ScholarDigital Library
- Davis, J. and Shah, M. Visual gesture recognition. Vision, Image and Signal Processing 141, 2, (1994), 101--106.Google ScholarCross Ref
- Doug Engelbart 1968 Demo. http://sloan.stanford.edu/MouseSite/1968Demo.htmlGoogle Scholar
- Hansen, W. J. and Haas, C. Reading and writing with computers: a framework for explaining differences in performance. Commun. ACM 31, 9, ACM Press (1988), 1080--1089. Google ScholarDigital Library
- Hardenberg, C. and Bérard, F. Bare-hand human-computer interaction. Proc. of the 2001 Workshop on PUI '01, ACM Press (2001), 1--8. Google ScholarDigital Library
- Hong, P., Huang, T. S. and Turk, M. Gesture Modeling and Recognition Using Finite State Machines. Proc. Int'l Conf. Automatic Face and Gesture Recognition 2000, (2000), 410--415. Google ScholarDigital Library
- Ishii, H. and Ullmer, B. Tangible bits: towards seamless interfaces between people, bits and atoms. Proc. CHI 1997, ACM Press (1997), 234--241. Google ScholarDigital Library
- Kato, H., Billinghurst, M., Poupyrev, I., Imamoto, K. and Tachibana, K. Virtual object manipulation on a table-top AR environment. Proc. ISAR'00 (2000), 111--119.Google ScholarCross Ref
- Kjeldsen, R. and Kender, J., Finding Skin in Color Images. Proc. Int'l Conf. Automatic Face and Gesture Recognition 1996, (1996), 312--317. Google ScholarDigital Library
- Koike, H. and Kobayashi, M. EnhancedDesk: Integrating Paper Documents and Digital Documents. Proc. APCHI 1998, ACM Press (1998), 57--62. Google ScholarDigital Library
- Koike, H., Sato, Y. and Kobayashi, Y. Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system. TOCHI 8, 4, ACM Press (2001), 307--322. Google ScholarDigital Library
- Martin, J., and Durand, J-B. Automatic Handwriting Gestures Recognition Using Hidden Markov Models. Proc. Int'l Conf. Automatic Face and Gesture Recognition 2000, (2000), 403--409. Google ScholarDigital Library
- May, K. W. Conductive ink based page detection for linking digital and physical pages. Ext. Abstracts CHI 2001, ACM Press (2001), 275--276. Google ScholarDigital Library
- Nelson, T. H. Complex information processing: A File Structure for the Complex, the Changing, and the Indeterminate. Proc. of ACM National Conference, ACM Press (1965), 84--100. Google ScholarDigital Library
- Nelson, T. H. Literary Machines. Swarthmore, PA, USA, 1981.Google Scholar
- O'Hara, K. and Sellen, A. A comparison of reading paper and on-line documents. Proc. CHI 1997, ACM Press (1997), 335--342. Google ScholarDigital Library
- Oka, K., Sato, Y. and Koike, H. Real-Time Tracking of Multiple Fingertips and Gesture Recognition for Augmented Desk Interface Systems. Proc. Int'l Conf. Automatic Face and Gesture Recognition 2002, (2002), 429--434. Google ScholarDigital Library
- Pavlovic, V. I., Sharma, R., Huang, T. S. Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 7, (1997), 677--695. Google ScholarDigital Library
- Quek, F. K. H., Mysliwiec, T. and Zhao, M. Finger Mouse: A Freehand Pointing Interface. Proc. Int'l Workshop on Automatic Face and Gesture Recognition 1995, (1995), 372--377.Google Scholar
- Rao, B. and Minakakis, L. Evolution of mobile location-based services. Commun. ACM 46, 12, ACM Press (2003), 61--65. Google ScholarDigital Library
- Sinclair, P., Martinez, K., Millard, D. E., and Weal, M. J. Links in the palm of your hand: tangible hypermedia using augmented reality. Proc. of the Thirteenth ACM Conference on Hypertext and Hypermedia, ACM Press (2002), 127--136. Google ScholarDigital Library
- Starner, T. and Pentland, A. Visual Recognition of American Sign Language Using Hidden Markov Models. M. I. T. Media Laboratory, Perceptual Computing Section, Cambridge MA, USA, 1994.Google Scholar
- Sukthankar, R., Stockton, R., and Mullin, Smarter Presentations: Exploiting Homography in Camera-Projector Systems. Proc. Int'l Conf. Computer Vision '01, (2001), 82--87.Google Scholar
- Underkoffler, J. and Ishii, H. Illuminating light: an optical design tool with a luminous-tangible interface. Proc. CHI 1998, ACM Press (1998), 542--549. Google ScholarDigital Library
- Underkoffler, J., and Ishii, H. Urp: A Luminous-Tangible Workbench for Urban Planning and Design. Proc. CHI 1999, ACM Press (1999), 386--393. Google ScholarDigital Library
- Wellner, P. Interacting with paper on the DigitalDesk. Commun. ACM 36, 7, ACM Press (1993), 87--96. Google ScholarDigital Library
- Yamato, J., Ohya, J., and Ishii, K. Recognizing human action in time-sequential images using hidden Markov model. Proc. of the IEEE Conference on Computer Vision and Pattern Recognition 1992, (1992), 379--385.Google ScholarCross Ref
Index Terms
- Turning a page on the digital annotation of physical books
Recommendations
WikiTUI: leaving digital traces in physical books
ACE '07: Proceedings of the international conference on Advances in computer entertainment technologyThis article describes the design of WikiTUI, a tangible user interface system that allows readers to manipulate multimedia information tied to page-level locations in common books. This system will also facilitate the exchange of information with other ...
Tangible Interaction in Learning Astronomy through Augmented Reality Book-Based Educational Tool
IVIC '09: Proceedings of the 1st International Visual Informatics Conference on Visual Informatics: Bridging Research and PracticeLive Solar System (LSS) is an Augmented Reality book-based educational tool. Augmented Reality (AR) has its own potential in the education field, because it can provide a seamless interaction between real and virtual objects. LSS applied the Tangible ...
A Framework for Virtual Reality with Tangible Augmented Reality-Based User Interface
In this paper, we propose a framework for virtual reality, I2-NEXT, which enables users to interact with virtual objects by tangible objects in immersive networked virtual environment. The primary goal of this framework is to support rapid development ...
Comments