Skip to main content
Log in

Multimedia summarization using social media content

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this work, we propose a novel multimedia summarization technique from Online Social Networks (OSNs). In particular, we model each Multimedia Social Network (MSN)—i.e. an OSN focusing on the management and sharing of multimedia information—using an hypergraph based approach and exploit influence analysis methodologies to determine the most important multimedia objects with respect to one or more topics of interest. Successively, we obtain from the list of candidate objects a multimedia summary using a summarization model together with an heuristics that aims to generate summaries with priority (with respect to some user keywords), continuity, variety and not receptiveness features. The performed experiments on Flickr shows the effectiveness of proposed approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. https://webscope.sandbox.yahoo.com.

  2. https://www.flickr.com/services/api

  3. http://haydn.isi.edu/ROUGE/

  4. The people involved in the experiments were mainly students from the University of Naples related to the database and multimedia system courses having an account on Flickr.

  5. https://www.databricks.com/

References

  1. Aggarwal C, Subbian K (2014) Evolutionary network analysis: a survey. ACM Comput Surv (CSUR) 47(1):10

    Article  MATH  Google Scholar 

  2. Albanese M, Fayzullin M, Picariello A, Subrahmanian V (2006) The priority curve algorithm for video summarization. Inf Syst 31(7):679–695

    Article  Google Scholar 

  3. Albanese M, Chianese A, d’Acierno A, Moscato V, Picariello A (2010) A multimedia recommender integrating object features and user behavior. Multimed Tools Appl 50(3):563–585

    Article  Google Scholar 

  4. Aljawarneh S, Dababneh M, Hosseny H, Alwadi E (2010) A web client authentication system using smart card for e-systems: initial testing and evaluation. In: Fourth international conference on digital society, 2010. ICDS’10. IEEE, pp 192–197

  5. Aljawarneh S, Yassein MB, Talafha WA (2017) A multithreaded programming approach for multimedia big data: encryption system. Multimed Tools Appl 1–20. Online ISSN: 1573-7721. https://doi.org/10.1007/s11042-017-4873-9

  6. Aljawarneh S, Yassein MB, Talafha WA (2017) A resource-efficient encryption algorithm for multimedia big data. Multimed Tools Appl 76(21):1–22. Online ISSN: 1573-7721. https://doi.org/10.1007/s11042-016-4333-y

    Article  Google Scholar 

  7. Amato F, Colace F, Greco L, Moscato V, Picariello A (2016) Semantic processing of multimedia data for e-government applications. J Vis Lang Comput 32 (Supplement C):35–41

    Article  Google Scholar 

  8. Amato F, Moscato V, Picariello A, Sperlí G (2016) Modeling user-content interaction in multimedia social networks using hypergraphs. In: 2016 12th international conference on signal-image technology & internet-based systems (SITIS). IEEE, pp 343–350

  9. Amato F, Moscato V, Picariello A, Sperlí G (2016) Multimedia social network modeling: a proposal. In: 2016 IEEE tenth international conference on semantic computing (ICSC). IEEE, pp 448–453

  10. Bian J, Yang Y, Chua TS (2013) Multimedia summarization for trending topics in microblogs. In: Proceedings of the 22nd ACM international conference on information & knowledge management, CIKM ’13. ACM, New York, pp 1807–1812. https://doi.org/10.1145/2505515.2505652

  11. Bian J, Yang Y, Zhang H, Chua TS (2015) Multimedia summarization for social events in microblog stream. IEEE Trans Multimed 17(2):216–228. https://doi.org/10.1109/TMM.2014.2384912

    Article  Google Scholar 

  12. Carullo G, Castiglione A, De Santis A, Palmieri F (2015) A triadic closure and homophily-based recommendation system for online social networks. World Wide Web 18(6):1579–1601. https://doi.org/10.1007/s11280-015-0333-5

    Article  Google Scholar 

  13. Castiglione A, Cattaneo G, De Santis A (2011) A forensic analysis of images on online social networks. In: 2011 third international conference on intelligent networking and collaborative systems, pp 679–684. https://doi.org/10.1109/INCoS.2011.17

  14. Castiglione A, D’Alessio B, De Santis A (2011) Steganography and secure communication on online social networks and online photo sharing. In: 2011 international conference on broadband and wireless computing, communication and applications, pp 363–368. https://doi.org/10.1109/BWCCA.2011.60

  15. Colace F, De Santo M, Greco L, Amato F, Moscato V, Picariello A (2014) Terminological ontology learning and population using latent dirichlet allocation. J Vis Lang Comput 25(6):818–826

    Article  Google Scholar 

  16. d’Acierno A, Moscato V, Picariello A (2009) Building summaries from web information sources. In: 10th workshop on image analysis for multimedia interactive services, 2009. WIAMIS’09. IEEE, pp 57–60

  17. d’Acierno A, Gargiulo F, Moscato V, Penta A, Persia F, Picariello A, Sansone C, Sperlí G (2015) A multimedia summarizer integrating text and images. In: Intelligent interactive multimedia systems and services. Springer, pp 21–33

  18. Del Fabro M, Sobe A, Böszörmenyi L (2012) Summarization of real-life events based on community-contributed content. In: The fourth international conferences on advances in multimedia, pp 119–126

  19. Ding D, Metze F, Rawat S, Schulam PF, Burger S, Younessian E, Bao L, Christel MG, Hauptmann A (2012) Beyond audio and video retrieval: towards multimedia summarization. In: Proceedings of the 2nd ACM international conference on multimedia retrieval. ACM, p 2

  20. Fang Q, Sang J, Xu C, Rui Y (2014) Topic-sensitive influencer mining in interest-based social media networks via hypergraph learning. IEEE Trans Multimed 16(3):796–812. https://doi.org/10.1109/TMM.2014.2298216

    Article  Google Scholar 

  21. Fang B, Jia Y, Li X, Li A, Wu X (2017) Big search in cyberspace. IEEE Trans Knowl Data Eng

  22. Fayzullin M, Subrahmanian V, Picariello A, Sapino ML (2003) The cpr model for summarizing video. In: Proceedings of the 1st ACM international workshop on multimedia databases. ACM, pp 2–9

  23. Hahn U, Mani I (2000) The challenges of automatic summarization. Computer 33(11):29–36

    Article  Google Scholar 

  24. Heintz B, Chandra A (2014) Beyond graphs: toward scalable hypergraph analysis systems. ACM SIGMETRICS Perform Eval Rev 41(4):94–97

    Article  Google Scholar 

  25. Imran A, Aljawarneh S, Sakib K (2016) Web data amalgamation for security engineering: digital forensic investigation of open source cloud. J Univ Comput Sci 22(4):494–520

    MathSciNet  Google Scholar 

  26. Kang C, Kraus S, Molinaro C, Spezzano F, Subrahmanian V (2016) Diffusion centrality: a paradigm to maximize spread in social networks. Artif Intell 239:70–96

    Article  MathSciNet  MATH  Google Scholar 

  27. Kempe D, Kleinberg J, Tardos E (2003) Maximizing the spread of influence through a social network. In: Proceedings of the ninth ACM SIGKDD international conference on knowledge discovery and data mining, KDD ’03. ACM, New York, pp 137–146. https://doi.org/10.1145/956750.956769

  28. Li Z, Tang J, Wang X, Liu J, Lu H (2016) Multimedia news summarization in search. ACM Trans Intell Syst Technol (TIST) 7(3):33

    Google Scholar 

  29. Luhn HP (1958) The automatic creation of literature abstracts. IBM J Res Dev 2(2):159–165

    Article  MathSciNet  Google Scholar 

  30. Modani N, Maneriker P, Hiranandani G, Sinha AR, Subramanian V, Gupta S et al (2016) Summarizing multimedia content. In: International conference on web information systems engineering. Springer, pp 340–348

  31. Moscato V, Persia F, Picariello A, Penta A et al (2012) iwin: a summarizer system based on a semantic analysis of web documents. In: 2012 IEEE sixth international conference on semantic computing (ICSC). IEEE, pp 162–169

  32. Nenkova A, McKeown K (2012) A survey of text summarization techniques. In: Mining text data. Springer, Berlin, pp 43–76

  33. Qian S, Zhang T, Xu C, Shao J (2016) Multi-modal event topic model for social event analysis. IEEE Trans Multimed 18(2):233–246

    Article  Google Scholar 

  34. Rudinac S, Larson MA, Hanjalic A (2013) Learning crowdsourced user preferences for visual summarization of image collections. IEEE Trans Multimed 15:1231–1243. https://doi.org/10.1109/TMM.2013.2261481

    Article  Google Scholar 

  35. Sankar CP, Asharaf S, Kumar KS (2016) Learning from bees: An approach for influence maximization on viral campaigns. PLOS ONE 11(12):1–15. https://doi.org/10.1371/journal.pone.0168125

    Article  Google Scholar 

  36. Schinas M, Papadopoulos S, Kompatsiaris Y, Mitkas PA (2015) Visual event summarization on social media using topic modelling and graph-based ranking algorithms. In: Proceedings of the 5th ACM on international conference on multimedia retrieval, ICMR ’15. ACM, New York, pp 203–210. http://doi.acm.org/10.1145/2671188.2749407

  37. Scott J (2012) Social network analysis. Sage, Newbury Park

    Google Scholar 

  38. Sevindik V, Wang J, Bayat O, Weitzen J (2012) Performance evaluation of a real long term evolution (lte) network. In: 2012 IEEE 37th conference on local computer networks workshops (LCN Workshops). IEEE, pp 679–685

  39. Shah RR, Yu Y, Verma A, Tang S, Shaikh AD, Zimmermann R (2016) Leveraging multimodal information for event summarization and concept-level sentiment analysis. Knowl-Based Syst 108:102–109

    Article  Google Scholar 

  40. Sönmez Y, Bayat O, Altuğlu TB, Duru AD (2015) Performance comparison of php-asp web applications via database queries. In: Proceedings of the the international conference on engineering & MIS 2015. ACM, p 45

  41. Thomas JJ (2005) Illuminating the path: [the research and development agenda for visual analytics]. IEEE Computer Society, Los Alamitos

    Google Scholar 

  42. Wu Y, Cao N, Gotz D, Tan YP, Keim DA (2016) A survey on visual analytics of social media data. IEEE Trans Multimed 18(11):2135–2148

    Article  Google Scholar 

  43. Yang Q, Chen WN, Yu Z, Gu T, Li Y, Zhang H, Zhang J (2017) Adaptive multimodal continuous ant colony optimization. IEEE Trans Evol Comput 21 (2):191–205. https://doi.org/10.1109/TEVC.2016.2591064

    Article  Google Scholar 

  44. Zhou D, Huang J, Schölkopf B (2006) Learning with hypergraphs: clustering, classification, and embedding. In: NIPS, vol 19, pp 1633–1640

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Flora Amato.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Amato, F., Castiglione, A., Moscato, V. et al. Multimedia summarization using social media content. Multimed Tools Appl 77, 17803–17827 (2018). https://doi.org/10.1007/s11042-017-5556-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5556-2

Keywords

Navigation