skip to main content
10.1145/2468356.2468525acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
poster

AR pen and hand gestures: a new tool for pen drawings

Published: 27 April 2013 Publication History

Abstract

This paper explores the interaction possibilities when artists use their non-dominant hand, while drawing with a pen in their dominant hand. We propose a new interactive AR-based pen tool which can overlay virtual images onto a physical drawing in real time. This system allows artists to control the augmented images with gestures of a non-dominant hand while drawing. By interacting with the visually augmented contents using hand gestures and a pen bimanually, artists can draw pictures more creatively. We also made a standalone pen system integrated with a pico-projector and a camera, and suggest a set of useful scenarios for the conventional pen-and-paper drawing.

References

[1]
Brandl, P., Forlines, C., Wigdor, D., Haller, M., and Shen, C. Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces. In Proc. AVI 2008, ACM Press (2008), 154161.
[2]
Flagg, M., and Rehg, J.M. Projector-guided painting. In Proc. UIST 2006, ACM Press (2006), 235--244.
[3]
Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., and Buxton. B. Pen + touch = new tools. In Proc. UIST 2010, ACM Press (2010), 27--36.
[4]
Laviole, J., and Hachet, M. PapARt: Interactive 3D graphics and multi-touch augmented paper for artistic creation. In Proc. 3DUI 2012, IEEE Press (2012), 3--6.
[5]
Linder, N., and Maes, P. LuminAR: portable robotic augmented reality interface design and prototype. In Adjunct Proc. UIST 2010. ACM (2010), 395--396.
[6]
Otsuki, M., Sugihara, K., Kimura, A., Shibata, F., and Tamura, H. MAI painting brush: an interactive device that realizes the feeling of real painting. In Proc. UIST 2010, ACM Press (2010), 97--100.
[7]
Schkolne, S., Pruett, M., and Schroder, P. Surface drawing: creating organic 3D shapes with the hand and tangible tools. In Proc. CHI 2001, ACM Press (2001), 261--268.
[8]
Schoning, J., Rohs, M., Kratz, S., Lochtefeld, M., and Kruger, A. Map torchlight: a mobile augmented reality camera projector unit. In Ext. Abstracts CHI 2009, ACM Press (2009), 3841--3846.
[9]
Song, H., Grossman, T. Fitzmaurice, G., Guimbretiere, F., Khan, A., Attar, R., and Kurtenbach, G. PenLight: combining a mobile projector and a digital pen for dynamic visual overlay. In Proc. CHI 2009, ACM Press (2009), 143--152.
[10]
Song, H., Guimbretiere, F., Grossman, T. and Fitzmaurice, G. MouseLight: bimanual interactions on digital paper using a pen and a spatially-aware mobile projector. In Proc. CHI 2010, ACM Press (2010), 24512460.
[11]
Willis, K. D.D., Poupyrev, I., Shiratori, T. MotionBeam: A metaphor for character interaction with handheld projectors. In Proc. CHI 2011, ACM Press (2011), 1031--1040.
[12]
Wilson, A.D. PlayAnywhere: a compact interactive tabletop projection-vision system. In Proc. UIST 2005, ACM Press (2005), 83--92.
[13]
Yee, K.-P. Two-handed Interaction on a tablet display. In Ext. Abstracts CHI 2004, ACM Press (2004), 1493--1496. \

Cited By

View all
  • (2023)Human Computer Interaction with detection of Hand Gesture to improve Artistic creativityInternational Journal of Scientific Research in Science and Technology10.32628/IJSRST523103122(571-575)Online publication date: 10-May-2023
  • (2022)Retouching System to Ease Difficulty of Craft Design for Paper-CuttingCulture and Computing10.1007/978-3-031-05434-1_13(205-216)Online publication date: 26-Jun-2022
  • (2020)Improvement of Pressure Control Skill with Knife Device for Paper-CuttingIEICE Transactions on Information and Systems10.1587/transinf.2019EDP7237E103.D:8(1856-1864)Online publication date: 1-Aug-2020
  • Show More Cited By

Index Terms

  1. AR pen and hand gestures: a new tool for pen drawings

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems
    April 2013
    3360 pages
    ISBN:9781450319522
    DOI:10.1145/2468356
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 April 2013

    Check for updates

    Author Tags

    1. bimanual interaction
    2. hand gesture
    3. pen-based computing
    4. projection-based augmented reality

    Qualifiers

    • Poster

    Conference

    CHI '13
    Sponsor:

    Acceptance Rates

    CHI EA '13 Paper Acceptance Rate 630 of 1,963 submissions, 32%;
    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)40
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Human Computer Interaction with detection of Hand Gesture to improve Artistic creativityInternational Journal of Scientific Research in Science and Technology10.32628/IJSRST523103122(571-575)Online publication date: 10-May-2023
    • (2022)Retouching System to Ease Difficulty of Craft Design for Paper-CuttingCulture and Computing10.1007/978-3-031-05434-1_13(205-216)Online publication date: 26-Jun-2022
    • (2020)Improvement of Pressure Control Skill with Knife Device for Paper-CuttingIEICE Transactions on Information and Systems10.1587/transinf.2019EDP7237E103.D:8(1856-1864)Online publication date: 1-Aug-2020
    • (2020)Evaluation of Skill Improvement by Combining Skill and Difficulty Levels During Paper-cutting ProductionProceedings of the ACM on Human-Computer Interaction10.1145/34273194:ISS(1-17)Online publication date: 4-Nov-2020
    • (2019)Stylus knifeProceedings of the 34th ACM/SIGAPP Symposium on Applied Computing10.1145/3297280.3297348(714-721)Online publication date: 8-Apr-2019
    • (2018)A brush device with visual and haptic feedback for virtual painting of 3D virtual objectsVirtual Reality10.1007/s10055-017-0317-022:2(167-181)Online publication date: 1-Jun-2018
    • (2015)Gaze+GestureProceedings of the 2015 ACM on International Conference on Multimodal Interaction10.1145/2818346.2820752(131-138)Online publication date: 9-Nov-2015

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media