Abstract
In this work, we propose a novel multimedia summarization technique from Online Social Networks (OSNs). In particular, we model each Multimedia Social Network (MSN)—i.e. an OSN focusing on the management and sharing of multimedia information—using an hypergraph based approach and exploit influence analysis methodologies to determine the most important multimedia objects with respect to one or more topics of interest. Successively, we obtain from the list of candidate objects a multimedia summary using a summarization model together with an heuristics that aims to generate summaries with priority (with respect to some user keywords), continuity, variety and not receptiveness features. The performed experiments on Flickr shows the effectiveness of proposed approach.
Similar content being viewed by others
Notes
The people involved in the experiments were mainly students from the University of Naples related to the database and multimedia system courses having an account on Flickr.
References
Aggarwal C, Subbian K (2014) Evolutionary network analysis: a survey. ACM Comput Surv (CSUR) 47(1):10
Albanese M, Fayzullin M, Picariello A, Subrahmanian V (2006) The priority curve algorithm for video summarization. Inf Syst 31(7):679–695
Albanese M, Chianese A, d’Acierno A, Moscato V, Picariello A (2010) A multimedia recommender integrating object features and user behavior. Multimed Tools Appl 50(3):563–585
Aljawarneh S, Dababneh M, Hosseny H, Alwadi E (2010) A web client authentication system using smart card for e-systems: initial testing and evaluation. In: Fourth international conference on digital society, 2010. ICDS’10. IEEE, pp 192–197
Aljawarneh S, Yassein MB, Talafha WA (2017) A multithreaded programming approach for multimedia big data: encryption system. Multimed Tools Appl 1–20. Online ISSN: 1573-7721. https://doi.org/10.1007/s11042-017-4873-9
Aljawarneh S, Yassein MB, Talafha WA (2017) A resource-efficient encryption algorithm for multimedia big data. Multimed Tools Appl 76(21):1–22. Online ISSN: 1573-7721. https://doi.org/10.1007/s11042-016-4333-y
Amato F, Colace F, Greco L, Moscato V, Picariello A (2016) Semantic processing of multimedia data for e-government applications. J Vis Lang Comput 32 (Supplement C):35–41
Amato F, Moscato V, Picariello A, Sperlí G (2016) Modeling user-content interaction in multimedia social networks using hypergraphs. In: 2016 12th international conference on signal-image technology & internet-based systems (SITIS). IEEE, pp 343–350
Amato F, Moscato V, Picariello A, Sperlí G (2016) Multimedia social network modeling: a proposal. In: 2016 IEEE tenth international conference on semantic computing (ICSC). IEEE, pp 448–453
Bian J, Yang Y, Chua TS (2013) Multimedia summarization for trending topics in microblogs. In: Proceedings of the 22nd ACM international conference on information & knowledge management, CIKM ’13. ACM, New York, pp 1807–1812. https://doi.org/10.1145/2505515.2505652
Bian J, Yang Y, Zhang H, Chua TS (2015) Multimedia summarization for social events in microblog stream. IEEE Trans Multimed 17(2):216–228. https://doi.org/10.1109/TMM.2014.2384912
Carullo G, Castiglione A, De Santis A, Palmieri F (2015) A triadic closure and homophily-based recommendation system for online social networks. World Wide Web 18(6):1579–1601. https://doi.org/10.1007/s11280-015-0333-5
Castiglione A, Cattaneo G, De Santis A (2011) A forensic analysis of images on online social networks. In: 2011 third international conference on intelligent networking and collaborative systems, pp 679–684. https://doi.org/10.1109/INCoS.2011.17
Castiglione A, D’Alessio B, De Santis A (2011) Steganography and secure communication on online social networks and online photo sharing. In: 2011 international conference on broadband and wireless computing, communication and applications, pp 363–368. https://doi.org/10.1109/BWCCA.2011.60
Colace F, De Santo M, Greco L, Amato F, Moscato V, Picariello A (2014) Terminological ontology learning and population using latent dirichlet allocation. J Vis Lang Comput 25(6):818–826
d’Acierno A, Moscato V, Picariello A (2009) Building summaries from web information sources. In: 10th workshop on image analysis for multimedia interactive services, 2009. WIAMIS’09. IEEE, pp 57–60
d’Acierno A, Gargiulo F, Moscato V, Penta A, Persia F, Picariello A, Sansone C, Sperlí G (2015) A multimedia summarizer integrating text and images. In: Intelligent interactive multimedia systems and services. Springer, pp 21–33
Del Fabro M, Sobe A, Böszörmenyi L (2012) Summarization of real-life events based on community-contributed content. In: The fourth international conferences on advances in multimedia, pp 119–126
Ding D, Metze F, Rawat S, Schulam PF, Burger S, Younessian E, Bao L, Christel MG, Hauptmann A (2012) Beyond audio and video retrieval: towards multimedia summarization. In: Proceedings of the 2nd ACM international conference on multimedia retrieval. ACM, p 2
Fang Q, Sang J, Xu C, Rui Y (2014) Topic-sensitive influencer mining in interest-based social media networks via hypergraph learning. IEEE Trans Multimed 16(3):796–812. https://doi.org/10.1109/TMM.2014.2298216
Fang B, Jia Y, Li X, Li A, Wu X (2017) Big search in cyberspace. IEEE Trans Knowl Data Eng
Fayzullin M, Subrahmanian V, Picariello A, Sapino ML (2003) The cpr model for summarizing video. In: Proceedings of the 1st ACM international workshop on multimedia databases. ACM, pp 2–9
Hahn U, Mani I (2000) The challenges of automatic summarization. Computer 33(11):29–36
Heintz B, Chandra A (2014) Beyond graphs: toward scalable hypergraph analysis systems. ACM SIGMETRICS Perform Eval Rev 41(4):94–97
Imran A, Aljawarneh S, Sakib K (2016) Web data amalgamation for security engineering: digital forensic investigation of open source cloud. J Univ Comput Sci 22(4):494–520
Kang C, Kraus S, Molinaro C, Spezzano F, Subrahmanian V (2016) Diffusion centrality: a paradigm to maximize spread in social networks. Artif Intell 239:70–96
Kempe D, Kleinberg J, Tardos E (2003) Maximizing the spread of influence through a social network. In: Proceedings of the ninth ACM SIGKDD international conference on knowledge discovery and data mining, KDD ’03. ACM, New York, pp 137–146. https://doi.org/10.1145/956750.956769
Li Z, Tang J, Wang X, Liu J, Lu H (2016) Multimedia news summarization in search. ACM Trans Intell Syst Technol (TIST) 7(3):33
Luhn HP (1958) The automatic creation of literature abstracts. IBM J Res Dev 2(2):159–165
Modani N, Maneriker P, Hiranandani G, Sinha AR, Subramanian V, Gupta S et al (2016) Summarizing multimedia content. In: International conference on web information systems engineering. Springer, pp 340–348
Moscato V, Persia F, Picariello A, Penta A et al (2012) iwin: a summarizer system based on a semantic analysis of web documents. In: 2012 IEEE sixth international conference on semantic computing (ICSC). IEEE, pp 162–169
Nenkova A, McKeown K (2012) A survey of text summarization techniques. In: Mining text data. Springer, Berlin, pp 43–76
Qian S, Zhang T, Xu C, Shao J (2016) Multi-modal event topic model for social event analysis. IEEE Trans Multimed 18(2):233–246
Rudinac S, Larson MA, Hanjalic A (2013) Learning crowdsourced user preferences for visual summarization of image collections. IEEE Trans Multimed 15:1231–1243. https://doi.org/10.1109/TMM.2013.2261481
Sankar CP, Asharaf S, Kumar KS (2016) Learning from bees: An approach for influence maximization on viral campaigns. PLOS ONE 11(12):1–15. https://doi.org/10.1371/journal.pone.0168125
Schinas M, Papadopoulos S, Kompatsiaris Y, Mitkas PA (2015) Visual event summarization on social media using topic modelling and graph-based ranking algorithms. In: Proceedings of the 5th ACM on international conference on multimedia retrieval, ICMR ’15. ACM, New York, pp 203–210. http://doi.acm.org/10.1145/2671188.2749407
Scott J (2012) Social network analysis. Sage, Newbury Park
Sevindik V, Wang J, Bayat O, Weitzen J (2012) Performance evaluation of a real long term evolution (lte) network. In: 2012 IEEE 37th conference on local computer networks workshops (LCN Workshops). IEEE, pp 679–685
Shah RR, Yu Y, Verma A, Tang S, Shaikh AD, Zimmermann R (2016) Leveraging multimodal information for event summarization and concept-level sentiment analysis. Knowl-Based Syst 108:102–109
Sönmez Y, Bayat O, Altuğlu TB, Duru AD (2015) Performance comparison of php-asp web applications via database queries. In: Proceedings of the the international conference on engineering & MIS 2015. ACM, p 45
Thomas JJ (2005) Illuminating the path: [the research and development agenda for visual analytics]. IEEE Computer Society, Los Alamitos
Wu Y, Cao N, Gotz D, Tan YP, Keim DA (2016) A survey on visual analytics of social media data. IEEE Trans Multimed 18(11):2135–2148
Yang Q, Chen WN, Yu Z, Gu T, Li Y, Zhang H, Zhang J (2017) Adaptive multimodal continuous ant colony optimization. IEEE Trans Evol Comput 21 (2):191–205. https://doi.org/10.1109/TEVC.2016.2591064
Zhou D, Huang J, Schölkopf B (2006) Learning with hypergraphs: clustering, classification, and embedding. In: NIPS, vol 19, pp 1633–1640
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Amato, F., Castiglione, A., Moscato, V. et al. Multimedia summarization using social media content. Multimed Tools Appl 77, 17803–17827 (2018). https://doi.org/10.1007/s11042-017-5556-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-017-5556-2