research-article

Touch & Write: a multi-touch table with pen-input

Authors:

Marcus Liwicki,

Oleg Rostanin,

Saher Mohamed El-Neklawy,

Andreas DengelAuthors Info & Claims

DAS '10: Proceedings of the 9th IAPR International Workshop on Document Analysis Systems

Pages 479 - 484

https://doi.org/10.1145/1815330.1815392

Published: 09 June 2010 Publication History

Get Access

Abstract

In this paper we present a novel rear-projection tabletop called Touch & Write. It combines the FTIR technology for touching with the Anoto-technology for handwriting. This allows an implicit switch between the modes object manipulation, and content editing. Our system incorporates real-time gesture and handwriting recognition. Drawn objects and written concepts can be converted to digital information immediately. We introduce a functional application, the LeCoOnt concept mapping software makes use of the full capability of the Touch & Write table. Touching actions are used for arranging the concepts like sheets on a normal table, and to recognizes guestures like zooming. Pen-actions are used for drawing, connecting concepts, and handwriting. The handwritten strokes are automatically recognized and converted into a machine-readable string. This system provides a reliable alternative to common approaches which try to reconstruct the information from photographs.

References

[1]

P. E. Bradley, M. J. Nuttall, and P. Alto. Computer mouse, 1987.

Google Scholar

[2]

G. A. Fink, M. Wienecke, and G. Sagerer. Video-based on-line handwriting recognition. In Proc. 6th Int. Conf. on Document Analysis and Recognition, pages 226--230, 2001.

Digital Library

Google Scholar

[3]

J. Y. Han. Low-cost multi-touch sensing through frustrated total internal reflection. In UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology, pages 115--118, New York, NY, USA, 2005. ACM Press.

Digital Library

Google Scholar

[4]

M. Kaltenbrunner, T. Bovermann, R. Bencina, and E. Costanza. TUIO - a protocol for table based tangible user interfaces. In Proceedings of the 6th International Workshop on Gesture in Human-Computer Interaction and Simulation (GW 2005), Vannes, France, 2005.

Google Scholar

[5]

S. Knerr, V. Anisimov, O. Baret, N. Gorsky, D. Price, and J. Simon. The A2iA INTERCHEQUE system: Courtesy amount and legal amount recognition for French checks. Int. Journal of Pattern Recognition and Artificial Intelligence, 11(4):505--548, 1997.

Crossref

Google Scholar

[6]

NUI Group Authors. Multi-Touch Technologies. NUI Group, 2009.

Google Scholar

[7]

L. Sauermann, A. Bernardi, and A. Dengel. Overview and outlook on the semantic desktop. pages 1--19, 2005.

Google Scholar

[8]

A. J. Sellen and R. H. R. Harper. The Myth of the Paperless Office. MIT Press, 2001.

Digital Library

Google Scholar

Cited By

View all

Magallanes YAlfredo Sanchez J(2015)A pattern-based approach to activity design in creative work supported by surface computing2015 International Conference on Electronics, Communications and Computers (CONIELECOMP)10.1109/CONIELECOMP.2015.7086951(197-203)Online publication date: Feb-2015
https://doi.org/10.1109/CONIELECOMP.2015.7086951
Martín-Albo DRomero VVidal E(2015)Escritoire: A Multi-touch Desk with e-Pen Input for Capture, Management and Multimodal Interactive Transcription of Handwritten DocumentsPattern Recognition and Image Analysis10.1007/978-3-319-19390-8_53(471-478)Online publication date: 9-Jun-2015
https://doi.org/10.1007/978-3-319-19390-8_53
Ahmed SWeber MLiwicki MLangenhan CDengel APetzold F(2014)Automatic analysis and sketch-based retrieval of architectural floor plansPattern Recognition Letters10.5555/3043802.304394235:C(91-100)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.5555/3043802.3043942
Show More Cited By

Index Terms

Touch & Write: a multi-touch table with pen-input
1. Applied computing
  1. Document management and text processing
    1. Document capture
2. Hardware

Recommendations

Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technology

We describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
To touch or not to touch?: comparing 2D touch and 3D mid-air interaction on stereoscopic tabletop surfaces
SUI '13: Proceedings of the 1st symposium on Spatial user interaction

Recent developments in touch and display technologies have laid the groundwork to combine touch-sensitive display systems with stereoscopic three-dimensional (3D) display. Although this combination provides a compelling user experience, interaction with ...
Touch & Interact: touch-based interaction with a tourist application
MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services

Touch & Interact is an interaction technique which combines mobile phones and public displays. The motivation for the project is to overcome the intrinsic output limitations of mobile phones. Touch & Interact extends the phone output to a public display ...

Comments

Information & Contributors

Information

Published In

DAS '10: Proceedings of the 9th IAPR International Workshop on Document Analysis Systems

June 2010

490 pages

ISBN:9781605587738

DOI:10.1145/1815330

General Chairs:
David Doermann
University of Maryland, College Park
,
Venu Govindaraju
University at Buffalo, SUNY
,
Daniel Lopresti
Lehigh University
,
Prem Natarajan
Raytheon BBN Technologies

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 June 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

DAS '10

DAS '10: The Eighth IAPR International Workshop on Document Analysis Systems

June 9 - 11, 2010

Massachusetts, Boston, USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
319
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Magallanes YAlfredo Sanchez J(2015)A pattern-based approach to activity design in creative work supported by surface computing2015 International Conference on Electronics, Communications and Computers (CONIELECOMP)10.1109/CONIELECOMP.2015.7086951(197-203)Online publication date: Feb-2015
https://doi.org/10.1109/CONIELECOMP.2015.7086951
Martín-Albo DRomero VVidal E(2015)Escritoire: A Multi-touch Desk with e-Pen Input for Capture, Management and Multimodal Interactive Transcription of Handwritten DocumentsPattern Recognition and Image Analysis10.1007/978-3-319-19390-8_53(471-478)Online publication date: 9-Jun-2015
https://doi.org/10.1007/978-3-319-19390-8_53
Ahmed SWeber MLiwicki MLangenhan CDengel APetzold F(2014)Automatic analysis and sketch-based retrieval of architectural floor plansPattern Recognition Letters10.5555/3043802.304394235:C(91-100)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.5555/3043802.3043942
Ahmed SWeber MLiwicki MLangenhan CDengel APetzold F(2014)Automatic analysis and sketch-based retrieval of architectural floor plansPattern Recognition Letters10.1016/j.patrec.2013.04.00535(91-100)Online publication date: Jan-2014
https://doi.org/10.1016/j.patrec.2013.04.005
Savery CHurter CLesbordes RCordeil MGraham T(2013)When Paper Meets Multi-touch: A Study of Multi-modal Interactions in Air Traffic ControlHuman-Computer Interaction – INTERACT 201310.1007/978-3-642-40477-1_12(196-213)Online publication date: 2013
https://doi.org/10.1007/978-3-642-40477-1_12
Zimmermann TWeber MLiwicki MStricker D(2012)CoVidAProceedings of the 1st International Workshop on Visual Interfaces for Ground Truth Collection in Computer Vision Applications10.1145/2304496.2304506(1-6)Online publication date: 21-May-2012
https://dl.acm.org/doi/10.1145/2304496.2304506
Otte SKrechel DLiwicki MDengel A(2012)Local Feature Based Online Mode Detection with Recurrent Neural NetworksProceedings of the 2012 International Conference on Frontiers in Handwriting Recognition10.1109/ICFHR.2012.229(533-537)Online publication date: 18-Sep-2012
https://dl.acm.org/doi/10.1109/ICFHR.2012.229
Dutta DChowdhury ABhattacharya UParui S(2012)Building a Personal Handwriting Recognizer on an Android DeviceProceedings of the 2012 International Conference on Frontiers in Handwriting Recognition10.1109/ICFHR.2012.189(686-691)Online publication date: 18-Sep-2012
https://dl.acm.org/doi/10.1109/ICFHR.2012.189
Liwicki MWeber MZimmermann TDengel A(2012)Seamless Integration of Handwriting Recognition into Pen-Enabled Displays for Fast User InteractionProceedings of the 2012 10th IAPR International Workshop on Document Analysis Systems10.1109/DAS.2012.78(364-368)Online publication date: 27-Mar-2012
https://dl.acm.org/doi/10.1109/DAS.2012.78
Liwicki MForcher BJaeger PDengel A(2012)Koios++Proceedings of the 2012 10th IAPR International Workshop on Document Analysis Systems10.1109/DAS.2012.48(17-21)Online publication date: 27-Mar-2012
https://dl.acm.org/doi/10.1109/DAS.2012.48
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Pen + touch = new tools

To touch or not to touch?: comparing 2D touch and 3D mid-air interaction on stereoscopic tabletop surfaces

Touch & Interact: touch-based interaction with a tourist application

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations