skip to main content
10.1145/1095034.1095074acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
Article

PapierCraft: a command system for interactive paper

Published: 23 October 2005 Publication History

Abstract

Knowledge workers use paper extensively for document reviewing and note-taking due to its versatility and simplicity of use. As users annotate printed documents and gather notes, they create a rich web of annotations and cross references. Unfortunately, as paper is a static media, this web often gets trapped in the physical world. While several digital solutions such as XLibris [15] and Digital Desk [18] have been proposed, they suffer from a small display size or onerous hardware requirements.To address these limitations, we propose PapierCraft, a gesture-based interface that allows users to manipulate digital documents directly using their printouts as proxies. Using a digital pen, users can annotate a printout or draw command gestures to indicate operations such as copying a document area, pasting an area previously copied, or creating a link. Upon pen synchronization, our infrastructure executes these commands and presents the result in a customized viewer. In this paper we describe the design and implementation of the PapierCraft command system, and report on early user feedback.

References

[1]
Alvarado, C. and R. Davis. SketchREAD: a multi-domain sketch recognition engine. Proceedings of UIST'04, pp. 23 -- 32.
[2]
Anoto, http://www.anoto.com.
[3]
Cohen, P.R. and D.R. McGee, Tangible multimodal interfaces for safety-critical applications. Communications of the ACM, 2004. 47(1): p. 41 -- 46.
[4]
Guimbretiere, F. Paper Augmented Digital Documents. Proceedings of UIST'03, pp. 51 -- 60.
[5]
Heiner, J.M., S.E. Hudson, and K. Tanaka. Linking and messaging from real paper in the Paper PDA. Proceedings of UIST'99, pp. 179 -- 186.
[6]
Hinckley, K., G. Ramos, F. Guimbretiere, P. Baudisch, and M. Smith. Stitching: Pen Gestures that Span Multiple Displays. Proceedings of AVI'04, pp. 23 -- 31.
[7]
Hinckley, K., P. Baudisch, G. Ramos, and F. Guimbretiere. Design and Analysis of Delimiters for Selection-Action Pen Gesture Phrases in Scriboli. Proceedings of CHI'05, pp. 451 -- 460.
[8]
Johnson, W., H. Jellinek, J. Leigh Klotz, R. Rao, and S.K. Card. Bridging the paper and electronic worlds: the paper user interface. Proceedings of CHI'93, pp. 507 -- 512.
[9]
Kurtenbach, G., The design and Evaluation of Marking Menus, PhD thesis, University of Toronto. 1993
[10]
Mackay, W.E., G. Pothier, C. Letondal, K. Boegh, and H.E. Sorensen. The missing link: augmenting biology laboratory notebooks. Proceedings of UIST'02, pp. 41 -- 50.
[11]
OneNote, http://office.microsoft.com.
[12]
Price, M.N., G. Golovchinsky, and B.N. Schilit. Linking by inking: trailblazing in a paper-like hypertext. Proceedings of Conference on Hypertext and Hypermedia, pp. 30 -- 39.
[13]
Rekimoto, J. Pick-and-drop: a direct manipulation technique for multiple computer environments. Proceedings of UIST'97, pp. 31 -- 39.
[14]
Saund, E. and E. Lank. Stylus input and editing without prior selection of mode. Proceedings of UIST'03, pp. 213 -- 216.
[15]
Schilit, B.N., G. Golovchinsky, and M.N. Price. Beyond paper: supporting active reading with free form digital ink annotations. Proceedings of CHI'98, pp. 249 -- 256.
[16]
Sellen, A.J. and R.H.R. Harper, The Myth of the Paperless Office. 1st ed. 2001: MIT press.
[17]
Sensiva, http://www.sensiva.com/.
[18]
Wellner, P., Interacting with paper on the DigitalDesk. Communications of the ACM, 1993. 36(7): p. 87 -- 96.
[19]
Zeleznik, R., T. Miller, Fluid Inking: Modeless Integration of Gestures with Inking. Technical report CS-05-10, Brown University, 2005,
[20]
Zhao, S. and R. Balakrishnan. Simple vs. compound mark hierarchical marking menus. Proceedings of UIST'04, pp. 33 -- 42.

Cited By

View all
  • (2024)Natural Hand Gesture Interaction for 3D Transformations in Immersive VRInformation Systems and Technologies10.1007/978-3-031-45642-8_21(216-222)Online publication date: 16-Feb-2024
  • (2022)Eliciting Gestures for Novel Note-taking InteractionsProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533480(966-975)Online publication date: 13-Jun-2022
  • (2022)Paper Trail: An Immersive Authoring System for Augmented Reality Instructional ExperiencesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517486(1-16)Online publication date: 29-Apr-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology
October 2005
270 pages
ISBN:1595932712
DOI:10.1145/1095034
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. distributed systems
  2. paper interfaces
  3. pens

Qualifiers

  • Article

Conference

UIST05

Acceptance Rates

UIST '05 Paper Acceptance Rate 31 of 159 submissions, 19%;
Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25
The 38th Annual ACM Symposium on User Interface Software and Technology
September 28 - October 1, 2025
Busan , Republic of Korea

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)28
  • Downloads (Last 6 weeks)3
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Natural Hand Gesture Interaction for 3D Transformations in Immersive VRInformation Systems and Technologies10.1007/978-3-031-45642-8_21(216-222)Online publication date: 16-Feb-2024
  • (2022)Eliciting Gestures for Novel Note-taking InteractionsProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533480(966-975)Online publication date: 13-Jun-2022
  • (2022)Paper Trail: An Immersive Authoring System for Augmented Reality Instructional ExperiencesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517486(1-16)Online publication date: 29-Apr-2022
  • (2021)Hybrid Paper-Digital Interfaces: A Systematic Literature ReviewProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462059(1087-1100)Online publication date: 28-Jun-2021
  • (2021)BodyStylus: Freehand On-Body Design and Fabrication of Epidermal InterfacesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445475(1-15)Online publication date: 6-May-2021
  • (2018)Replicating User-defined Gestures for Text EditingProceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces10.1145/3279778.3279793(97-106)Online publication date: 19-Nov-2018
  • (2018)Active ViewingProceedings of the 2018 Conference on Human Information Interaction & Retrieval10.1145/3176349.3176889(237-240)Online publication date: 1-Mar-2018
  • (2018)Calligraphy: A Mobile Device Based Annotation Tool Supporting Learner Crowdsourcing2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI)10.1109/SmartWorld.2018.00255(1471-1478)Online publication date: Oct-2018
  • (2016)Exploring Low-Cost, Internet-Free Information Access for Resource-Constrained CommunitiesACM Transactions on Computer-Human Interaction10.1145/299049823:6(1-34)Online publication date: 3-Dec-2016
  • (2016)Muscle-plotterProceedings of the 29th Annual Symposium on User Interface Software and Technology10.1145/2984511.2984530(207-217)Online publication date: 16-Oct-2016
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media