Abstract
With the adoption of tablet-based data entry devices, there is considerable interest in methods for converting hand-drawn sketches of flow charts, graphs and block diagram into accurate machine interpretations, a conversion process with many applications in engineering, presentations, and simulations. However, the recognition of hand-drawn graphics is a great challenge due to the visual similarity of many system components. This is complicated due to the significant differences in drawing styles between users.
The proposed method, VizDraw, establishes an architecture that utilizes a number of pattern recognition tools to convert hand-drawn diagrams into computer graphics by segmenting the original diagram into individual components. This method generates hypothesis graphs for each component, evaluates the hypotheses using forward and backward dynamic programming, and finally utilizes a rule-based floor planning routine for component and symbol placement. VizDraw is invariant to scaling, rotation, translation and style of drawing. The preliminary results show how VizDraw is used for engineering drawings, simulation, and incorporation into computer aided design (CAD) models.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Groen, F., Sanderson, A., Schlag, J.: Symbol recognition in electrical diagrams using probabilistic graph matching. Pattern Recognition Letter 3, 343–350 (1985)
Lladoós, J., MartÃ, E., Villanueva, J.J.: Symbol recognition by error-tolerant subgraph matching between region adjacency graphs. IEEE Transaction on Pattern Analysis and Machine Intelligence 23(10), 1137–1143 (2001)
Huang, T.: Mathematical models of graphics 12(2), 127–135 (February 1980)
Fletcher, L., Kasturi, R.: A robust algorithm for text string separation from mixed text/graphics images. IEEE Transaction on Pattern Analysis and Machine Intelligence 10(6), 910–918 (1988)
Chan, K., Yeung, D.: Mathematical expression recognition: A survey 3(1), 3–15 (2000)
Lin, X., Shimotsuji, S., Minoh, M., Sakai, T.: Efficient diagram understanding with characteristic pattern detection. Computer Vision Graphics and Image Understanding 30(1), 84–106 (1985)
Hse, H., Newton, A.: Sketched symbol recognition using zernike moments I 367–370 (2004)
Llados, J., Sanchez, G.: Symbol recognition by error-tolerant subgraph matching between region adjacency graphs. IEEE International Conference on Image Processing 2(10), II–49–II–52 (2003)
Kasturi, R., Bow, S., El Masri, W., Shah, J., Gattiker, J., Mokate, U.: A system for interpretation of line drawings. IEEE Transaction on Pattern Analysis and Machine Intelligence 12(10), 978–992 (1990)
Minoh, M., Munetsugu, T., Ikeda, K.: Extraction and classification of graphical symbol candidates based on perceptual organization II, 234–237 (1992)
Bottoni, P., Cugini, U., Mussio, P., Papetti, C., Protti, M.: A system for form-feature-based interpretation of technical drawings 8(5), 326–335 (1995)
Murase, H., Wakahara, T.: Online hand-sketched figure recognition. Pattern Recognition 19(2), 147–160 (1986)
Llados, J., Sanchez, G.: Symbol recognition using graphs II, 49–52 (2003)
Huang, B., Kechadi, M.: An hmm-snn method for online handwriting symbol recognition II, 897–905 (2006)
Kara, L.B., Stahovich, T.F.: Hierarchical parsing and recognition of hand-sketched diagrams. In: SIGGRAPH 2007: ACM SIGGRAPH 2007 courses, p. 17. ACM, New York (2007)
S, T.M., Davis, R.: Hmm-based efficient sketch recognition. In: IUI 2005: Proceedings of the 10th international conference on Intelligent user interfaces, pp. 281–283. ACM, New York (2005)
Yuan, Z., Pan, H., Zhang, L.: A novel pen-based flowchart recognition system for programming teaching, pp. 55–64 (2009)
Taxt, T., Olafsdottir, J., Daehlen, M.: Recognition of handwritten symbols. Pattern Recognition 23(11), 1155–1166 (1990)
Postalcioglu1, S., Becerikli, Y.: Wavelet networks for nonlinear system modeling. Neural Computing and Applications 16(4-5) (2000)
Pradhan, A., Routray, A., Behera, A.: Power quality disturbance classification employing modular wavelet network. In: Power Engineering Society General Meeting. IEEE, Los Alamitos (2006)
Postalcioglu1, S., Becerikli, Y.: Gradient-based polyhedral segmentation for range images. PRL 24(12), 2069–2077 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mishra, A.K., Eichel, J.A., Fieguth, P.W., Clausi, D.A. (2009). VizDraw: A Platform to Convert Online Hand-Drawn Graphics into Computer Graphics. In: Kamel, M., Campilho, A. (eds) Image Analysis and Recognition. ICIAR 2009. Lecture Notes in Computer Science, vol 5627. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02611-9_38
Download citation
DOI: https://doi.org/10.1007/978-3-642-02611-9_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02610-2
Online ISBN: 978-3-642-02611-9
eBook Packages: Computer ScienceComputer Science (R0)