Skip to main content
Springer Nature Link
Log in

Aligning shapes for symbol classification and retrieval

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper proposes a method able to exploit peculiarities of both, local and global shape descriptors, to be employed for shape classification and retrieval. In the proposed framework, the silhouettes of symbols are firstly described through Bags of Shape Contexts. The shape signature is then used to solve the correspondence problem between points of two shapes. The obtained correspondences are employed to recover the geometric transformations between the shape to be classified/retrieved and the ones belonging to the training dataset. The alignment is based on a voting procedure in the parameter space of the model considered to recover the geometric transformation. The aligned shapes are finally described with the Blurred Shape Model descriptor for classification and retrieval purposes. Experimental results demonstrate the effectiveness of the proposed solution on two classic benchmark shape datasets, as well as on a large scale set of hand sketches composed by 20,000 examples distributed over 250 object categories.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Azzaro G, Caccamo M, Ferguson J, Battiato S, Farinella GM, Guarnera G, Puglisi G, Petriglieri R, Licitra G (2011) Objective estimation of body condition score by modeling cow body shape from digital images. J Dairy Sci 94(4):2126–2137

    Article  Google Scholar 

  2. Bai X, Liu W, Tu Z (2009) Integrating contour and skeleton for shape classification. In: IEEE international conference on computer vision workshops, pp 360–367

  3. Battiato S, Farinella GM, Giudice O, Puglisi G (2012) Aligning bags of shape contexts for blurred shape model based symbol classification. In: Proceedings of international conference on pattern recognition (ICPR), pp 1598–1601

  4. Battiato S, Farinella GM, Messina E, Puglisi G (2012) Robust image alignment for tampering detection. IEEE Trans Inf Forensics Secur 7(4):1105–1117

    Article  Google Scholar 

  5. Belongie S, Malik J, Puzicha J (2002) Shape matching and object recognition using shape contexts. IEEE Trans Pattern Anal Mach Intel 24(4):509–522

    Article  Google Scholar 

  6. Caglar T, Berrin Y, Metin TS (2012) Sketched symbol recognition with auto-completion. Pattern Recog 45:3926–3937

    Article  Google Scholar 

  7. da Fontoura Costa L, Cesar RM Jr (2009) Shape classification and analysis: theory and practice, 2nd edn. CRC Press, Inc., Boca Raton

    Book  MATH  Google Scholar 

  8. Daliri MR, Torre V (2008) Robust symbolic representation for shape recognition and retrieval. Pattern Recog 41(5):1782–1798

    Article  MATH  Google Scholar 

  9. Eitz M, Hays J, Alexa M (2012) How do humans sketch objects?. ACM Trans Graph (SIGGRAPH) 31(4):44:1–44:10

    Google Scholar 

  10. Escalera S, Fornés A, Pujol O, Lladós J, Radeva P (2011) Circular blurred shape model for multiclass symbol recognition. IEEE Trans Syst Man Cybern 41(2):497–506

    Article  Google Scholar 

  11. Farinella GM, Impoco G, Gallo G, Spoto S, Catanuto G, Nava MB (2006) Objective outcome evaluation of breast surgery. In: Medical image computing and computer-assisted intervention—MICCAI 2006. Lecture Notes in Computer Science, vol 4190. Springer, Berlin Heidelberg, pp 776–783

  12. Kuhn HW (1955) The hungarian method for the assignment problem. Nav Res Logist Q 2:83–97

    Article  MathSciNet  MATH  Google Scholar 

  13. Lim KL, Galoogahi H (2010) Shape classification using local and global features. In: Pacific-rim symposium on image and video technology, pp 115–120

  14. Marr D (1982) Vision: a computational investigation into the human representation and processing of visual information. Henry Holt and Co., Inc., New York

    Google Scholar 

  15. McNeill G, Vijayakumar S (2006) Hierarchical procrustes matching for shape retrieval. In: IEEE computer society conference on computer vision and pattern recognition, pp 885–894

  16. Munder S, Schnörr C, Gavrila DM (2008) Pedestrian detection and tracking using a mixture of view-based shape-texture models. IEEE Trans Intell Transp Syst 9(2):333–343

    Article  Google Scholar 

  17. Philbin J, Chum O, Isard M, Sivic J, Zisserman A (2007) Object retrieval with large vocabularies and fast spatial matching. In: Conference on computer vision and pattern recognition

  18. Puglisi G, Battiato S (2011) A robust image alignment algorithm for video stabilization purposes. IEEE Trans Circ Syst Video Technol 21(10):1390–1400

    Article  Google Scholar 

  19. Qi GJ, Tian Q, Huang T (2011) Locality-sensitive support vector machine by exploring local correlation and global regularization. In: IEEE international conference on computer vision and pattern recognition, pp 841–848

  20. Qi J, Xin F, Zhongxuan L, Yu L, He G (2014) A new geometric descriptor for symbols with affine deformations. Pattern Recogn Lett 40:128–135

    Article  Google Scholar 

  21. Velasco-Forero S, Angulo J (2010) Statistical shape modeling using morphological representations. In: International conference on pattern recognition, pp 3537–3540

  22. Wang B, Shen W, Liu WY, You XG, Bai X (2010) Shape classification using tree-unions. In: International conference on pattern recognition, pp 983–986

  23. Wang J, Bai X, You X, Liu W, Latecki L (2011) Shape matching and classification using height functions. Pattern Recogn Lett 33:134–143

    Article  Google Scholar 

  24. Yan Y, Shen H, Liu G, Ma Z, Gao C, Sebe N (2014) GLocal tells you more: coupling GLocal structural for feature selection with sparsity for image and video classification. Comp Vision Image Underst 124:99–109. Large Scale Multimedia Semantic Indexing

    Article  Google Scholar 

  25. Zhang D, Lu G (2004) Review of shape representation and description techniques. Pattern Recog 37(1):1–19

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Image Processing Laboratory, Department of Mathematics and Computer Science, University of Catania, Catania, Italy

    Sebastiano Battiato, Giovanni Maria Farinella & Oliver Giudice

  2. Dipartimento di Matematica e Informatica, University of Cagliari, Cagliari, Italy

    Giovanni Puglisi

Authors
  1. Sebastiano Battiato
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Giovanni Maria Farinella
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Oliver Giudice
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Giovanni Puglisi
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Oliver Giudice.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Battiato, S., Farinella, G.M., Giudice, O. et al. Aligning shapes for symbol classification and retrieval. Multimed Tools Appl 75, 5513–5531 (2016). https://doi.org/10.1007/s11042-015-2523-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2523-7

Keywords