Skip to main content
SpringerLink
Log in

An online composite graphics recognition approach based on matching of spatial relation graphs

  • Published:
Document Analysis and Recognition Aims and scope Submit manuscript

Abstract.

A spatial relation graph (SRG) and its partial matching method are proposed for online composite graphics representation and recognition. The SRG-based approach emphasizes three characteristics of online graphics recognition: partial, structural, and independent of stroke order and stroke number. A constrained partial permutation strategy is also proposed to reduce the computational cost of matching two SRGs, which is originally an NP-complete problem as is graph isomorphism. Experimental results show that our proposed SRG-based approach is both efficient and effective for online composite graphics recognition in our sketch-based graphics input system - SmartSketchpad.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Almohamad HA, Duffuaa SO (1993) A linear programming approach for the weighted graph matching problem. IEEE Trans PAMI 15(5):522-525

    Google Scholar 

  2. Alvarado C, Oltmans M, Davis R (2002) A framework for multi-domain sketch recognition. In: Proceedings of the AAAI spring symposium on sketch understanding, pp 1-8

  3. Chang S-K, Shi QY, Yan CW (1987) Iconic indexing by 2-D strings. IEEE Trans PAMI 9(3):413-428

    Google Scholar 

  4. Christmas WJ, Kittler J, Petrou M (1995) Structural matching in computer vision using probabilistic relaxation. IEEE Trans PAMI 17(8):749-764

    Google Scholar 

  5. Davis R (2002) Sketch understanding in design: overview of work at the MIT AI Lab. In: Proceedings of the 2002 AAAI spring symposium on sketch understanding, pp 24-31

  6. Foggia P, Sansone C, Vento M (2001) A database of graphs for isomorphism and sub-graph isomorphism benchmarking. In: Proceedings of the 3rd IAPR-TC15 workshop on graph-based representations in pattern recognition, Ischia

  7. Fonseca MJ, Jorge JA (2000) Using fuzzy logic to recognize geometric shapes interactively. In: Proceedings of the 9th IEEE conference on fuzzy systems, 1:291-196

  8. Fonseca MJ, Pimetal C, Jorge J (2002) CALI: an online scribble recognizer for calligraphic interfaces. In: Proceedings of the 2002 AAAI spring symposium on sketch understanding, pp 51-58

  9. Gold S, Rangarajan A (1996) A graduated assignment algorithm for graph matching. IEEE Trans PAMI 18(4):522-525

    Google Scholar 

  10. Gross MD (1996) The electronic cocktail napkin - a computational environment for working with design diagrams. Des Stud 17:53-69

    Google Scholar 

  11. Gross MD, Do EY (1996) Ambiguous intentions: a paper-like interface for creative designing. In: In: Proceedings of the ACM symposium on user interface software and technology, pp:183-192

  12. Hammond T, Davis R (2002) Tahuti: a geometrical sketch recognition for UML class diagrams. In: Proceedings of the 2002 AAAI spring symposium on sketch understanding, pp 59-66

  13. Jin XY, Liu WY, Sun JY, Sun ZX (2002) Online graphics recognition. In: Proceedings of the Pacific Graphics conference, Beijing, October 2002, pp 256-265

  14. Kim IJ, Kim JH, Liu CL (1999) Stroke-guided pixel matching for handwritten Chinese character recognition. In: Proceedings of the 5th international conference on document analysis and recognition

  15. Landay J, Myers B (1995) Interactive sketching for the early stages of user interface. In: Proceedings of the ACM CHI 95 conference on human factors in computing systems, pp 43-50

  16. Landay J, Myers B (2001) Sketching interfaces: toward more human interface design. IEEE Comput 34(3):56-64

    Google Scholar 

  17. Lee SY, Hsu FJ (1990) 2D C-string: a new spatial knowledge representation for image database systems. Patt Recog 23(10):1077-1087

    Google Scholar 

  18. Lee SW, Kim YJ (1995) A new type of recurrent neural network for handwritten character recognition. In: Proceedings of the 3rd international conference on document analysis and recognition, 1:38-42

  19. Li C, Yang B, Xie W (2000) On-line hand-sketched graphics recognition based on attributed relation graph matching. In: Proceedings of the 3rd world congress on intelligent control and automation, Hefei, China, pp 2549-2553

  20. Liu WY (2004) On-line graphics recognition: state of the art. Lecture notes in computer science. Springer, Berlin Heidelberg New York. (Selected and revised papers from Proceedings of GREC2003, July 2004, Spain (in press)

  21. Liu WY, Qian W, Xiao R, Jin XY (2001) SmartSketchpad - an online graphics recognition system. In: Proceedings of the ICDAR2001, Seattle, pp 1050-1054

  22. Liu WY, Jin XY, Sun ZX (2002) Sketch-based user interface for inputting graphic objects on small screen devices. Lecture notes in computer science, vol 2390. Springer, Berlin Heidelberg New York. (Selected and revised papers from Proceedings of GREC2001, 7-8 September 2001, Kingston, Canada)

  23. Lladös J, Martí E, José J (2001) Symbol recognition by error-tolerant subgraph matching between region adjacency graphs. IEEE Trans PAMI 23(10)::1137-1143

    Google Scholar 

  24. Mehlhorn K (1984) Graph algorithm and NP-completeness. Springer, Berlin Heidelberg New York

  25. Messmer BT (1995) Efficient graph matching algorithms. PhD thesis, University of Bern, Switzerland

  26. Messmer BT, Bunke H (1998) A new algorithm for error-tolerant sub-graph isomorphism detection. IEEE Trans PAMI 20(5):493-504

    Google Scholar 

  27. Müller S, Eickeler S, Rigoll G (1998) Image database retrieval of rotated objects by user sketch. In: Proceedings of the IEEE workshop on content-based access to image and video libraries (CBAIVL), Santa Barbara, CA pp 40-44

  28. Osuna E, Freund R, Girosi F (1997) Training support vector machines: an application to face detection. In: Proceedings of CVPR 97

  29. Petrakis EGM (2002) Design and evaluation of spatial similarity approach for image retrieval. Image Vision Comput 20:59-76

    Google Scholar 

  30. Plamondon R, Guerfali W, Lalonde M (1999) Automatic signature verification: a report on a large-scale public experiment. In: Proceedings of the 9th biennial conference, Singapore, pp 9-13

  31. Pontil M, Verri A (1998) Support vector machines for 3D object recognition. IEEE Trans PAMI 20(6):637-646

    Google Scholar 

  32. Rabiner LR (1989) Tutorial on hidden Markov model and selected applications in speech recognition. Proc IEEE 77(2):257-285

    Google Scholar 

  33. Ranganath HS, Chipman LJ (1992) Fuzzy relaxation approach for inexact scene matching. Image Vision Comput 10(9):631-640

    Google Scholar 

  34. Saund E (2003) Finding perceptually closed paths in sketches and drawings. IEEE Trans Patt Anal Mach Intell 25(4):475-491

    Google Scholar 

  35. Sun ZX, Xu XG, Sun JY, Jin XY (2003) Sketch-based graphic input tool for conceptual design. J Comput Aided Des Comput Graph (in Chinese) 15(9):205-206

    Google Scholar 

  36. Xu XG, Liu WY, Jin XY, Sun ZX (2002) Sketch-based user interface for creative tasks. In: Proceedings of the 5th Asia Pacific conference on computer human interaction, Beijing, pp 560-570

Download references

Author information

Authors and Affiliations

  1. State Key Lab for Novel Software Technology, Nanjing University, 210093, Nanjing, P.R. China

    Xu Xiaogang, Sun Zhengxing, Peng Binbin & Jin Xiangyu

  2. Department of Computer Science and Technology, Nanjing University, 210093, Nanjing, P.R. China

    Xu Xiaogang, Sun Zhengxing, Peng Binbin & Jin Xiangyu

  3. Department of Computer Science, City University of Hong Kong, Hong Kong SAR, P.R. China

    Liu Wenyin

Authors
  1. Xu Xiaogang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sun Zhengxing
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Peng Binbin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jin Xiangyu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Liu Wenyin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xu Xiaogang.

Additional information

Received: 13 March 2003, Accepted: 13 March 2004, Published online: 1 June 2004

Rights and permissions

Reprints and permissions

About this article

Cite this article

Xiaogang, X., Zhengxing, S., Binbin, P. et al. An online composite graphics recognition approach based on matching of spatial relation graphs. IJDAR 7, 44–55 (2004). https://doi.org/10.1007/s10032-004-0126-3

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10032-004-0126-3

Keywords:

Search

Navigation