skip to main content
10.1145/1029632.1029663acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
Article

ScreenCrayons: annotating anything

Published: 24 October 2004 Publication History

Abstract

ScreenCrayons is a system for collecting annotations on any type of document or visual information from any application. The basis for the system is a screen capture upon which the user can highlight the relevant portions of the image. The user can define any number of topics for organizing notes. Each topic is associated with a highlighting "crayon." In addition the user can supply annotations in digital ink or text. Algorithms are described that summarize captured images based on the highlight strokes so as to provide overviews of many annotations as well as being able to "zoom in" on particular information about a given note and the context of that note.

References

[1]
Adler, A., Gujar, A., Harrison, B. L., O'Hara, K., and Sellen, A. A Diary Study of Work-Related Reading: Design Implications for Digital Reading Devices. Proc CHI '98, 241--248.
[2]
Alias, Sketchbook Pro, http://www.alias.com/eng/ products-services/sketchbook_pro/index.shtml
[3]
Baird, H.S., Background structure in document images. International Journal of Pattern Recognition and Artificial Intelligence, 8(5):1013--1030, 1994.
[4]
Bargeron, D., and Moscovich, T., Reflowing Digital Ink Annotations, Proc CHI 2003, 385--393.
[5]
Breuel, T.M., Two Geometric Algorithms for Layout Analysis, Proceedings of the 5th International Workshop on Document Analysis Systems V, p.188--199, 2002.
[6]
Brush, A.J.B., Bargeron, D., Gupta, A., and Cadiz, J.J. Robust Annotation Positioning in Digital Documents. Proc CHI 2001, 285--292.
[7]
Budzik, J., and Hammond, K. J., User Interactions with Everyday Applications as Context for Just-in-time Information Access, Proc Intelligent User Interfaces 2000, 44--51.
[8]
Conklin, J., and Begeman, M. L. gIBIS: A Hypertext Tool for Exploratory Policy Discussion. Proc CSCW '88, 140--152.
[9]
E-Quill, http://www.rocketdownload.com/details/HTML/5337.htm
[10]
Fails, J., and Olsen, D. A Design Tool for Camera-based Interaction, Proc CHI 2003, 449--456.
[11]
Francik, E., Rapid, Integrated Design of a Multimedia Communication System. In Human Computer Interface Design, M. Rudisill, et al., (Eds.), Morgan Kaufman, San Francisco, CA (1996).
[12]
Golovchinsky, G. and Denoue, L., Moving Markup: Repositioning Freeform Annotations, Proceedings of ACM UIST 2002, (2002).
[13]
Gotz, M. G., Schlechtweg, S., and Strothotte, T. The Intelligent Pen - Toward a Uniform Treatment of Electronic Documents, International Symposium on Smart Graphics, (June 2002).
[14]
Halasz, F. G. Reflections on NoteCards: Seven Issues for the Next Generation of Hypermedia Systems. CACM, Vol 31(7), (July 1988), 836--852.
[15]
Marshall, C.C., Halasz, F.G., Rogers, R.A., Janssen, W.C., "Aquanet: A Hypertext Tool to Hold Your Knowledge in Place", Hypertext '91, ACM, (1991).
[16]
Marshall, C.C., Price, M.N., Golovchinsky, G., and Schilit, B.N., Designing e-books for Legal Research, Proc International Conference on Digital Libraries (2001), ACM, 41--48.
[17]
Nematode Songbook, http://mgd.nacse.org/hyperSQL/squiggles/songs.html.
[18]
Olsen, D. R., Boyarski, D., Verratti, T., Phelps, M., Moffett, J. L., and Lo, E.L., Generalized Pointing: Enabling Multiagent Interaction. Proc CHI 98, 526--533.
[19]
Schilit, B.N., Golovchinsky, G., and Price, M. N. Beyond Paper: Supporting Active Reading with Free Form Digital Ink Annotations. Proc CHI '98, 249--256.
[20]
Wilcox, L., Schilit, B., and Sawhney, N., Dynomite: A Dynamically Organized Ink and Audio Notebook. Proc CHI '97, (1997).

Cited By

View all
  • (2023)SpaceX MagProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35962537:2(1-36)Online publication date: 12-Jun-2023
  • (2021)GAVINACM Transactions on Computer-Human Interaction10.1145/345398828:4(1-32)Online publication date: 11-Aug-2021
  • (2021)ReverseORC: Reverse Engineering of Resizable User Interface Layouts with OR-ConstraintsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445043(1-18)Online publication date: 6-May-2021
  • Show More Cited By

Index Terms

  1. ScreenCrayons: annotating anything

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '04: Proceedings of the 17th annual ACM symposium on User interface software and technology
    October 2004
    312 pages
    ISBN:1581139578
    DOI:10.1145/1029632
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 24 October 2004

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. annotation
    2. digital ink
    3. image summarization
    4. screen capture

    Qualifiers

    • Article

    Conference

    UIST04

    Acceptance Rates

    Overall Acceptance Rate 561 of 2,567 submissions, 22%

    Upcoming Conference

    UIST '25
    The 38th Annual ACM Symposium on User Interface Software and Technology
    September 28 - October 1, 2025
    Busan , Republic of Korea

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)4
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 17 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)SpaceX MagProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35962537:2(1-36)Online publication date: 12-Jun-2023
    • (2021)GAVINACM Transactions on Computer-Human Interaction10.1145/345398828:4(1-32)Online publication date: 11-Aug-2021
    • (2021)ReverseORC: Reverse Engineering of Resizable User Interface Layouts with OR-ConstraintsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445043(1-18)Online publication date: 6-May-2021
    • (2019)Gaze assisted voice note taking systemAdjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers10.1145/3341162.3349308(367-371)Online publication date: 9-Sep-2019
    • (2016)Freeform digital ink annotations in electronic documentsComputers and Graphics10.1016/j.cag.2015.10.01455:C(1-20)Online publication date: 1-Apr-2016
    • (2015)CheatSheetProceedings of the 41st Graphics Interface Conference10.5555/2788890.2788933(241-248)Online publication date: 3-Jun-2015
    • (2014)Prefab layers and prefab annotationsProceedings of the 27th annual ACM symposium on User interface software and technology10.1145/2642918.2647412(221-230)Online publication date: 5-Oct-2014
    • (2014)Pixel-based methods for widget state and style in a runtime implementation of sliding widgetsProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2556288.2556979(2231-2240)Online publication date: 26-Apr-2014
    • (2013)Touching annotationsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2013.08.01771:12(1103-1111)Online publication date: 1-Dec-2013
    • (2012)A general-purpose target-aware pointing enhancement using pixel-level analysis of graphical interfacesProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2207676.2208734(3167-3176)Online publication date: 5-May-2012
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media