Skip to main content
SpringerLink
Log in

Robust event discovery from photo collections using Signature Image Bases (SIBs)

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Analyzing personal photo albums for understanding the related events is an emerging trend. A reliable event recognition tool could suggest appropriate annotation of pictures, provide the context for single image classification and tagging, achieve automatic selection and summarization, ease organization and sharing of media among users. In this paper, a novel method for fast and reliable event-type classification of personal photo albums is presented. Differently from previous approaches, the proposed method does not process photos individually but as a whole, exploiting three main features, namely Saliency, Gist, and Time, to extract an event signature, which is characteristic for a specific event type. A highly challenging database containing more than 40.000 photos belonging to 19 diverse event-types was crawled from photo-sharing websites for the purpose of modeling and performance evaluation. Experimental results showed that the proposed approach meets superior classification accuracy with limited computational complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Achanta R, Susstrunk S (2010) Saliency detection using maximum symmetric surround. In: ICIP. IEEE CS Press, pp 2653–2656

  2. Baeza-Yates R, Navarro G (1998) Approximate string matching in a dictionary. In: SPIRE. IEEE CS Press, pp 14–22

  3. Begum M, Karray F (2011) Visual attention for robotic cognition: a survey. IEEE TAMD 3(1):92–105

    Google Scholar 

  4. Bezdek JC, Hathaway RJ, Huband JM (2007) Visual assesment of clustering tendency for rectangular dissimilarity matrices. IEEE Trans Fuzzy Syst 15(5):890–903

    Article  Google Scholar 

  5. Cao L, Luo J, Kautz H, Huang T (2009) Image annotation within the context of personal photo collections using hierarchical event and scene models. IEEE Trans Multimedia 11(2):208–219

    Article  Google Scholar 

  6. Conotter V, Boato G (2011) Analysis of sensor fingerprint for source camera identification. Electron Lett v. 47(25):1366–1367

    Article  Google Scholar 

  7. Dao MS, Dang-Nguyen DT, De Natale F (2011) Signature-image-based event analysis for personal photo albums. In: ACM multimedia

  8. Das M, Loui AC (2009) Detecting significant events in personal image collections. In: IEEE int. conf. on semantic computing. IEEE press, pp 116–123

  9. Doran MM, Hoffman JE (2009) The role of eye fixations in concentration and amplification effects during object tracking. Taylor & Francis JVC 17(4):574–597

    Google Scholar 

  10. Douze M, Jégou H, Sandhawalia H (2009) Evaluation of GIST descriptors for web-scale image search. In: ACM CIVR. ACM press, pp 1–8

  11. Fei LF, Lyer A, Koch C, Perona P (2007) What do we perceive in a glance of a real-world scene? J Vis 7(1):1–29

    Article  Google Scholar 

  12. Frintrop S, Rome E, Christensen HI (2010) Computational visual systems and their cognitive foundations: a survey. ACM TAP 7(1, 6):1–39

    Article  Google Scholar 

  13. Han Y, Liu G (2010) A Hierarchical GIST model embedding multiple biological feasibilities for scene classification. In: ICPR. IEEE press, pp 3109–3112

  14. Hays J, Efros AA (2007) Scene completion using millions of photographs. In: ACM SIGGRAPH. ACM Press, pp 1–7

  15. Ibrahim A, AlZoubi A, Sahawneh R, Makhadmeh M (2009) Fixed representative colors feature extraction algorithm for moving picture experts group-7 dominant color descriptor. Journal of Computer Sciences 5(11):773–777

    Google Scholar 

  16. Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259

    Article  Google Scholar 

  17. Jiang A, Wang C, Xiao B (2008) Scene modeling in global-local view for scene classification. In: ACM CIVR. ACM press, pp 179–184

  18. Li L, Fei-Fei L (2007) What, where and who? Classifying events by scene and object recognition. In: ICCV, pp 1–8

  19. Li Z, Itti L (2010) Saliency and gist features for target detection in satellite images. IEEE Trans Image Process 86(10):1–27

    Google Scholar 

  20. Lim JH, Tian Q, Mulhem P (2003) Home photo content modeling for personalized event-based retrieval. IEEE Multimed 10:28–37

    Google Scholar 

  21. Liu Y, Zhang D, Lu G, Ma W-Y (2007) A survey of content-based image retrieval with high-level semantics. J Pattern Recogn 40:262–282

    Article  MATH  Google Scholar 

  22. Loui C, Savakis A (2003) Automated event clustering and quality screening of consumer pictures for digital albumin. IEEE Trans Multimedia 5(3):390–402

    Article  Google Scholar 

  23. Navarro G (2001) A guided tour to approximate string matching. ACM Comput Surv 33(1):31–88

    Article  Google Scholar 

  24. Oliva A, Schyns PG (2000) Diagnostic colors mediate scene recognition. Cogn Psychol 41:176–210

    Article  Google Scholar 

  25. Oliva A, Torralba A (2001) Modeling the shape of the scene: a holistic representation of the spatial envelop. Int J Comput Vis 42(3):145–175

    Article  MATH  Google Scholar 

  26. Oliva A, Torralba A (2006) Building the gist of a scene: the role of global image features in recognition. Prog Brain Res 155:23–36

    Article  Google Scholar 

  27. Renniger LW, Malik J (2004) When is scene identification just texture recognition? Elsevier JVR 44:2301–2311

    Google Scholar 

  28. Sandhaus P, Boll S (2011) Semantic analysis and retrieval in personal and social photo collections. Multimed Tools Appl 51:5–33

    Article  Google Scholar 

  29. Siagian C, Itti L (2007) Rapid biologically-inspired scene classification using features shared with visual attention. IEEE Trans Pattern Anal Mach Intell 29(2):300–312

    Article  Google Scholar 

  30. Sibiryakov A (2008) Photo-collection representation based on viewpoint clustering. In: SPIE, vol 68(1). SPIE press, pp 6833-02

  31. Vogel J, Schwaninger A, Wallraven C, Bulthoff HH (2007) Catergorization of natural scenes: local vs glocal information and the role of color. ACM TAP 4(3, 19):1–20

    Google Scholar 

  32. Wagenaar W (2004) My memory: a study of autobiographical memory over six years. Cogn Psychol 18(2):225–252

    Article  Google Scholar 

  33. Wang W, Wang Y, Huang Q, Gao W (2010) Measuring visual saliency by site entropy rate. In: CVPR. IEEE press, pp 2368–2375

  34. Yu J, Jin X, Han J, Luo J (2009) Mining personal image collection for social group suggestion. In: IEEE ICDMW. IEEE press, pp 202–207

Download references

Acknowledgement

This work has been partially supported by the EU Commission under the framework of the EU project grant no. 248984 “GLocal”.

Author information

Authors and Affiliations

  1. MultiMedia Signal Processing and Understanding LAB (mmLAB), Department of Information Engineering and Computer Science, University of Trento, Via Sommarive, 5, 38123, Povo (TN), Italy

    Minh-Son Dao, Duc-Tien Dang-Nguyen & Francesco G. B. De Natale

Authors
  1. Minh-Son Dao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Duc-Tien Dang-Nguyen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Francesco G. B. De Natale
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Minh-Son Dao.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Dao, MS., Dang-Nguyen, DT. & De Natale, F.G.B. Robust event discovery from photo collections using Signature Image Bases (SIBs). Multimed Tools Appl 70, 25–53 (2014). https://doi.org/10.1007/s11042-012-1153-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-012-1153-6

Keywords

Search

Navigation