Chunyuan Liao
Qiong Liu
ABSTRACT
This demo shows an interactive paper system called MixPad, which features using mice and keyboards to enhance the conventional pen-finger-gesture based interaction with paper documents. Similar to many interactive paper systems, MixPad adopts a mobile camera-projector unit to recognize paper documents, detect pen and finger gestures and provide visual feedback. Unlike these systems, MixPad allows using mice and keyboards to help users interact with fine-grained document content on paper (e.g. individual words and user-defined arbitrary regions), and to facilitate cross-media operations. For instance, to copy a document segment from paper to a laptop, one first points a finger of her non-dominant hand to the segment roughly, and then uses a mouse in her dominant hand to refine the selection and drag it to the laptop; she can also type text as a detailed comment on a paper document. This novel interaction paradigm combines the advantages of mice, keyboards, pens and fingers, and therefore enables rich digital functions on paper.
- Do-Lenh, S., F. Kaplan, A. Sharma, and P. Dillenbourg. Multi-finger interactions with papers on augmented tabletops. Proceedings of TEI'09, pp. 267--274. Google Scholar
Digital Library
- Hartmann, B., M.R. Morris, H. Benko, and A.D. Wilson. Augmenting interactive tables with mice & keyboards. Proceedings of UIST'09, pp. 149--152. Google ScholarDigital Library
- Kane, S.K., D. Avrahami, J.O. Wobbrock, B. Harrison, A.D. Rea, M. Philipose, and A. LaMarca. Bonfire: a nomadic system for hybrid laptop-tabletop interaction. Proceedings of UIST'09, pp. 129--138. Google ScholarDigital Library
- Liao, C., H. Tang, Q. Liu, P. Chiu, and F. Chen. FACT: fine-grained cross-media interaction with documents via a portable hybrid paper-laptop interface. Proceedings of MM'10, pp. 361--370. Google ScholarDigital Library
- Rekimoto, J. and M. Saitoh. Augmented surfaces: a spatially continuous work space for hybrid computing environments. Proceedings of CHI'99, pp. 378--385. Google ScholarDigital Library
- Wellner, P., Interacting with paper on the DigitalDesk. Communications of the ACM, 1993. 36(7): p. 87--96.. Google ScholarDigital Library
Index Terms
- MixPad: augmenting interactive paper with mice & keyboards for fine-grained cross-media interaction with documents
Recommendations
Measuring personality from keyboard and mouse use
ECCE '08: Proceedings of the 15th European conference on Cognitive ergonomics: the ergonomics of cool interactionMotivation -- To measure computer users' personality from their use of keyboard and mouse.
Research approach -- Two explorative studies were conducted. In first study a background application was executed on 20 participants' computers to record keys ...
MixPad: augmenting interactive paper with mice & keyboards for cross-media and fine-grained interaction with documents
MM '12: Proceedings of the 20th ACM international conference on MultimediaExisting interactive paper systems suffer from the disparate input devices for paper and computers. The finger-pen-only input on paper causes frequent devices switching (e.g. pen vs. mouse) during cross-media interactions, and may have issues of ...
Comments