Skip to main content
SpringerLink
Log in

An automatic event-complementing human life summarization scheme based on a social computing method over social media content

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper proposes a human life summarization scheme based on multimedia content published on social media. In this context the term “life” includes the events, occasions and activities users post on their walls. Towards this direction, an innovative architecture is designed that consists of two modules: the content preparation and the content summarization module. During content preparation, a Social Media web page is automatically segmented into tokens. Next multimedia content is kept and it is associated to its respective metadata (date of post, events, likes, persons, comments etc.) after filtering information through the YAGO2 knowledge base. Then a novel ranking mechanism puts multimedia content in order of importance based on a social computing methodology. Finally the summarization module produces a meaningful video clip that includes the top moments of one’s life without completely disregarding the less important. To the best of the authors’ knowledge, this is one of the first human life summarization schemes that are based on social media content. Experimental results illustrate the promising performance of the proposed architecture and set a basis for future research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Adobe Photoshop Elements 3.0, http://www.adobe.com/tips/phsel3slideshow/pdfs/phsel3slideshow.pdf, 2004

  2. Chua FCT, Asur S (2013) Automatic summarization of events from social media. In Proc. of the 7th International AAAI Conference on Weblogs and Social Media, Cambridge, USA, July 2013

  3. del Fabro M, Sobe A, Boszormenyi L (2012) Summarization of real-life events based on community-contributed content. In Proc. of the Fourth International Conferences on Advances in Multimedia, pp. 119–126, France, May 2012

  4. Doulamis A, Doulamis N (2003) Performance evaluation of euclidean/correlation-based relevance feedback algorithms in content-based image retrieval systems. IEEE Inter. Conf. on Image Processing (ICIP), Vol. 1, pp. 737–740, Barcelona, September 2003

  5. Doulamis N, Doulamis A (2006) Evaluation of relevance feedback schemes in content-based in retrieval systems. Signal Process Image Commun 21(4):334–357

    Article  MATH  Google Scholar 

  6. Esparza SG, O’Mahony MP, Smyth B (2010) On the real-time web as a source of recommendation knowledge. In Proc. of the 4th ACM conference on Recommender Systems, p.p. 305–308, New York, USA, 2010

  7. Gentili E, Milani A, Poggioni V (2012) Data summarization model for user action log files. Proc ICCSA 7335:539–549

    Google Scholar 

  8. Golder SA, Wilkinson D, Huberman BA (2007) Rhythms of social interaction: messaging within a massive online network. 3rd International Conference on Communities and Technologies, pp. 41–66

  9. Griggs B (2014) Your Facebook life in 62 seconds, CNN, February 6, 2014, http://edition.cnn.com/2014/02/04/tech/social-media/facebook-look-back-video/

  10. Hannon J, Bennett M, Smyth B (2010) Recommending twitter users to follow using content and collaborative filtering approaches. 4th ACM conference on Recommender systems, p.p. 199–206, New York, USA

  11. Hannon J, McCarthy K, Lynch J, Smyth B (2011) Personalized and automatic social summarization of events in video. In Proc. of IUI, pp. 335–338, Palo Alto, California, USA, 2011

  12. Hoffart J, Suchanek FM, Berberich K, Weikum G (2013) YAGO2: a spatially and temporally enhanced knowledge base from Wikipedia. Artif Intell 194:28–61

    Article  MathSciNet  MATH  Google Scholar 

  13. Hu P, Sun C, Wu L, Ji D, Teng C (2011) Social summarization via automatically discovered social context. In Proceeding of IJCNLP, pp. 483–490

  14. Hua X-S, Lu L, Zhang H-J (2006) Photo2Video—A system for automatically converting photographic series into video. IEEE Trans Circ Syst Video Technol 16(7):803–819

    Article  Google Scholar 

  15. Huberman BA, Romero DM, Wu F (2008) Social networks that matter: Twitter under the microscope. arXiv:0812.1045v1, Dec 2008

  16. Huffington Post (2010) Twitter user statistics revealed: http://www.huffingtonpost.com/2010/04/14/twitter-user-statisticsr_n_537992.html

  17. Kurzweil R (2013) Immortality by 2045. In 2013 Global Future 2045 International Congress, https://www.youtube.com/watch?v=f28LPwR8BdY, New York, USA, June 2013

  18. Lee YJ, Ghosh V, Grauman K (2012) Discovering important people and objects for egocentric video summarization. In proceedings of CVPR, pp. 1346–1353

  19. Meng X, Wei F, Liu X, Zhou M, Li S, Wang H (2012) Entity-centric topic-oriented opinion summarization in twitter. In Proceeding of KDD, pp. 379–387

  20. Money AG, Agius H (2008) Video summarisation: a conceptual framework and survey of the state of the art. J Vis Comun Image Represent 19(2):121–143

    Article  Google Scholar 

  21. Mori T, Takada A, Iwamura Y, Sato T (2004) Automatic human life summarization system in sensory living space. Proc IEEE lnt Conf Syst Man Cybern 2:1583–1588

    Google Scholar 

  22. Papadakis N, Ntalianis KS, Doulamis A, Stamoulis G (2009) An automatic multi-agent web image and associated keywords retrieval system. In Proceedings of the 16th ΙΕΕΕ International Workshop on Systems, Signals and Image Processing (IWSSIP), Halkida, Greece, June 2009

  23. Papadakis N, Skoutas D, Raftopoulos K, Varvarigou TA (2005) STAVIES: a system for information extraction from unknown web data sources through automatic web wrapper generation using clustering techniques. IEEE Trans Knowl Data Eng 17(12):1638–1652

    Article  Google Scholar 

  24. Phelan O, McCarthy K, Smyth B (2009) Using twitter to recommend real-time topical news. In Proc. of the 3rd ACM conference on Recommender systems, p.p. 385–388, New York, USA, 2009

  25. Rosten E, Drummond T (2006) Machine learning for high-speed corner detection. In: Leonardis A, Bischof H, Pinz A (eds) Computer Vision – ECCV 2006. Springer, Berlin, pp 430–443

    Chapter  Google Scholar 

  26. Rublee E, Rabaud V, Konolige K, Bradski G (2011) ORB: an efficient alternative to SIFT or SURF. In 2011 I.E. International Conference on Computer Vision (ICCV), pp. 2564–2571

  27. Sinha P, Mehrotra S, Jain R (2011) Summarization of personal photologs using multidimensional content and context. In Proceedings of the 1st ACM International Conference on Multimedia Retrieval, pp. 4.1–4.8, New York, USA

  28. Spala P, Malamos AG, Doulamis A, Mamakis G (2012) Extending MPEG-7 for efficient annotation of complex web 3D scenes. Multimed Tools Appl 52(2):463–504

    Article  Google Scholar 

  29. Truong BT, Venkatesh S (2007) Video abstraction: a systematic review and classification. ACM Trans Multim Comput Commun Appl 3(1):1–37

  30. Tryfou G, Theodosiou Z, Tsapatsoulis N (2012) Web image context extraction based on semantic representation of web page visual segments. In Proceedings of the 7th international workshop on semantic and social media adaptation and personalization (SMAP’12), p.p. 63–67, Luxembourg, December 2012

  31. Tryfou G, Tsapatsoulis N (2012) Extraction of web image information: semantic or visual cues? Artif Intell Appl Innov IFIP Adv Inf Commun Technol 381:368–373

    Google Scholar 

  32. Wang M, Hong R, Li G, Zha Z-J, Yan S, Chua T-S (2012) Event driven web video summarization by tag localization and key-shot identification. IEEE Trans Multimed 14(4):975–985

    Article  Google Scholar 

  33. Wang Z, Li S, Fang K, Zhou G (2013) Collective personal profile summarization with social networks. In Proceedings of the conference on empirical methods in natural language processing, Seattle, Washington, pp. 715–725, Oct. 2013

  34. Yang Z, Cai K, Tang J, Zhang L, Su Z, Li J (2011) Social context summarization. In Proceeding of SIGIR, pp. 255–264

Download references

Acknowledgments

The authors would like to thank very much all members of the Online Computing Group for participating in the scientific experiments of this paper. Especially Mr. Georgios Nikopoulos and Mr. Nikolaos Manolis for their advices and support.

Author information

Authors and Affiliations

  1. Department of Marketing – Online Computing Group, Athens University of Applied Sciences, 28, Agiou Spyridonos str. Egaleo, 12210, Athens, Greece

    Klimis Ntalianis

  2. School of Rural and Surveying Engineering, National Technical University of Athens, 9, Heroon Polytechniou str. Zografou, 15773, Athens, Greece

    Nikolaos Doulamis

Authors
  1. Klimis Ntalianis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nikolaos Doulamis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Klimis Ntalianis.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ntalianis, K., Doulamis, N. An automatic event-complementing human life summarization scheme based on a social computing method over social media content. Multimed Tools Appl 75, 15123–15149 (2016). https://doi.org/10.1007/s11042-015-2454-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2454-3

Keywords

Search

Navigation