Abstract
We present concepts and possible realizations for the classification of multi-touch drawn sketches. A gesture classifier is modified and integrated into a sketching tool. The applied routines are highly scalable and provide the possibilities of domain independent sketching. Classification rates are feasible without exploiting the full potential of the scheme. We demonstrate that the classifier is capable of identifying common basic primitives and gestures as well as complex drawings. Users define sketches per templates in their individual style and link them to constructed primitives. A pilot evaluation is conducted and results regarding sketching techniques of users and classification rates are discussed.
Chapter PDF
Similar content being viewed by others
References
Hse, H., Shilman, M., Newton, A.R.: Robust sketched symbol fragmentation using templates. In: Proceedings of the 9th International Conference on Intelligent User Interfaces, IUI 2004, pp. 156–160. ACM, New York (2004)
Sutherland, I.E.: Sketch pad a man-machine graphical communication system. In: Proceedings of the SHARE Design Automation Workshop, DAC 1964, pp. 6.329–6.346. ACM, New York (1964)
Hammond, T., Davis, R.: Tahuti: A geometrical sketch recognition system for uml class diagrams. In: Papers from the 2002 AAAI Spring Symposium on Sketch Understanding, Stanford, California, USA, pp. 59–68. AAAI Press (2002)
Costagliola, G., Deufemia, V., Risi, M.: A trainable system for recognizing diagrammatic sketch languages. In: 2005 IEEE Symposium on Visual Languages and Human-Centric Computing, pp. 281–283 (September 2005)
Zeleznik, R.C., Bragdon, A., Liu, C.C., Forsberg, A.: Lineogrammer: creating diagrams by drawing. In: Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology, UIST 2008, pp. 161–170. ACM, New York (2008)
Jansen, A., Marriott, K., Meyer, B.: Cider: Acomponent-based toolkit for creating smart diagram environments. In: Blackwell, A.F., Marriott, K., Shimojima, A. (eds.) Diagrams 2004. LNCS (LNAI), vol. 2980, pp. 415–419. Springer, Heidelberg (2004)
Wenyin, L., Qian, W., Xiao, R., Jin, X.: Smart sketchpad - an on-line graphics recognition system. In: Proceedings of the Sixth International Conference on Document Analysis and Recognition, ICDAR 2001, p. 1050. IEEE Computer Society, Washington, DC (2001)
Landay, J.A., Myers, B.A.: Interactive sketching for the early stages of user interface design. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1995, pp. 43–50. ACM Press/Addison-Wesley Publishing Co., New York, USA (1995)
Coyette, A., Schimke, S., Vanderdonckt, J., Vielhauer, C.: Trainable sketch recognizer for graphical user interface design. In: Baranauskas, C., Abascal, J., Barbosa, S.D.J. (eds.) INTERACT 2007. LNCS, vol. 4662, pp. 124–135. Springer, Heidelberg (2007)
Caetano, A., Goulart, N., Fonseca, M., Jorge, J.: Javasketchit: Issues in sketching the look of user interfaces. In: AAAI Spring Symposium on Sketch Understanding, pp. 9–14. AAAI Press, Menlo Park (2002)
Kurtoglu, T., Stahovich, T.F.: Interpreting schematic sketches using physical reasoning. In: Proceedings of the AAAI Spring Symposium, Stanford, CA, pp. 78–85. AAAI Press (2002)
Bae, S.H., Balakrishnan, R., Singh, K.: Ilovesketch: as-natural-as-possible sketching system for creating 3d curve models. In: Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology, UIST 2008, pp. 151–160. ACM, New York (2008)
Yu, B., Cai, S.: A domain-independent system for sketch recognition. In: Proceedings of the 1st International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia. GRAPHITE 2003, pp. 141–146. ACM, New York (2003)
Hammond, T., Paulson, B.: Recognizing sketched multistroke primitives. ACM Trans. Interact. Intell. Syst. 1(1), 4:1–4:34 (2011)
Calhoun, C., Stahovich, T.F., Kurtoglu, T., Kara, L.B.: Recognizing multi-stroke symbols. In: Proceedings of the AAAI Spring Symposium - Sketch Understanding, pp. 15–23. AAAI Press (2002)
Schmidt, M., Weber, G.: Template based classification of multi-touch gestures. Pattern Recognition (2013), doi:10.1016/j.patcog.2013.02.001, http://www.sciencedirect.com/science/article/pii/S0031320313000770
Apte, A., Vo, V., Kimura, T.D.: Recognizing multistroke geometric shapes: an experimental evaluation. In: UIST 1993: Proceedings of the 6th Annual ACM Symposium on User Interface Software and Technology, pp. 121–128. ACM, New York (1993)
Paulson, B., Hammond, T.: Paleosketch: accurate primitive sketch recognition and beautification. In: Proceedings of the 13th International Conference on Intelligent User Interfaces, IUI 2008, pp. 1–10. ACM, New York (2008)
Sezgin, T.M., Davis, R.: Hmm-based efficient sketch recognition. In: IUI 2005: Proceedings of the 10th International Conference on Intelligent User Interfaces, pp. 281–283. ACM, New York (2005)
Chen, C.L.P., Xie, S.: Freehand drawing system using a fuzzy logic concept. Computer-Aided Design 28(2), 77–89 (1996)
Sezgin, T.M., Stahovich, T., Davis, R.: Sketch based interfaces: Early processing for sketch understanding. In: Workshop on Perceptive User Interfaces, Orlando FL (2001)
Fonseca, M.J., Pimentel, C., Jorge, J.A.: Cali: An online scribble recognizer for calligraphic interfaces. In: Sketch Understanding, Papers from the 2002 AAAI Spring Symposium, pp. 51–58 (2002)
Igarashi, T., Matsuoka, S., Kawachiya, S., Tanaka, H.: Interactive beautification: a technique for rapid geometric design. In: Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology, UIST 1997, pp. 105–114. ACM, New York (1997)
Alvarado, C., Oltmans, M., Davis, R., Davis, A.: A framework for multi-domain sketch recognition. In: AAAI Spring Symposium on Sketch Understanding, pp. 1–8. AAAI Press (2002)
Rubine, D.: Specifying gestures by example. SIGGRAPH Comput. Graph. 25(4), 329–337 (1991)
Hammond, T., Davis, R.: Ladder, a sketching language for user interface developers. In: ACM SIGGRAPH 2007 Courses. ACM, New York (2007)
Bickerstaffe, A., Lane, A., Meyer, B., Marriott, K.: Graphics recognition. In: Recent Advances and New Opportunities, pp. 145–156. Springer, Heidelberg (2008)
Rubine, D.: The Automatic Recognition of Gestures. PhD thesis, Carnegie Mellon University (1991)
Landay, J.A., Myers, B.A.: Sketching interfaces: Toward more human interface design. Computer 34(3), 56–64 (2001)
Schmidt, M., Fibich, A., Weber, G.: MTIS: A Multi-Touch Text Input System. In: Streitz, N., Stephanidis, C. (eds.) DAPI/HCII 2013. LNCS, vol. 8028, pp. 62–71. Springer, Heidelberg (2013)
Shilman, M., Pasula, H., Newton, S.R.R.: Statistical visual language models for ink parsing. In: Proceedings of the AAAI Spring Symposium on Sketch Understanding, pp. 126–132 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schmidt, M., Weber, G. (2013). Recognition of Multi-touch Drawn Sketches. In: Kurosu, M. (eds) Human-Computer Interaction. Interaction Modalities and Techniques. HCI 2013. Lecture Notes in Computer Science, vol 8007. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39330-3_51
Download citation
DOI: https://doi.org/10.1007/978-3-642-39330-3_51
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39329-7
Online ISBN: 978-3-642-39330-3
eBook Packages: Computer ScienceComputer Science (R0)