skip to main content
10.1145/3440943.3444719acmconferencesArticle/Chapter ViewAbstractPublication PagesiceaConference Proceedingsconference-collections
research-article

Towards Story-based Summarization of Narrative Multimedia

Published: 27 September 2021 Publication History

Abstract

This study aims at summarizing narrative works (i.e., creative works that contain stories) in the consideration of their stories and types of required summaries. Various methods for story-based summarization have been proposed as a practical application of the character network analysis (i.e., a social network among characters that appeared in a story). However, the existing methods do not consider that summaries have different requirements according to their types (e.g., trailers, highlights, and recaps). These methods consist of three parts: (i) discretizing narrative works into regular units (e.g., scenes or shots), (ii) measuring the narrative significance of each unit, and (iii) generating summaries based on the narrative significance. Most of the existing studies have proposed their unique significance measurements based on individual narrative features. Also, since these methods have not considered the diverse types of summaries, they have simply selected top-N narrative units according to the measurements. In this study, we first introduce and redefine the narrative significance measurements. Subsequently, we propose a method for summarizing a narrative work regarding the requirements of the summaries by integrating the various significance measurements.

References

[1]
Brett Adams, Chitra Dorai, and Svetha Venkatesh. 2002. Media Computing. The Springer International Series in Video Computing (VICO), Vol. 4. Springer, Boston, MA, Chapter Formulating Film Tempo, 57--84. https://doi.org/10.1007/978-1-4615-1119-9_4
[2]
Xavier Bost. 2016. A storytelling machine?: automatic video summarization: the case of TV series. Ph.D. Dissertation. University of Avignon, France.
[3]
Xavier Bost, Serigne Gueye, Vincent Labatut, Martha Larson, Georges Linarès, Damien Malinas, and Raphaël Roth. 2019. Remembering winter was coming. Multimedia Tools and Applications (Sept. 2019). https://doi.org/10.1007/s11042-019-07969-4 To Appear.
[4]
Xavier Bost, Vincent Labatut, Serigne Gueye, and Georges Linarès. 2016. Narrative smoothing: Dynamic conversational network for the analysis of TV series plots. In Proceedings of the 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2016), Ravi Kumar, James Caverlee, and Hanghang Tong (Eds.). IEEE Computer Society, San Francisco, CA, US, 1111--1118. https://doi.org/10.1109/ASONAM.2016.7752379
[5]
Jingmeng He, Yuxiang Xie, Xidao Luan, Lili Zhang, and Xin Zhang. 2018. SRN: The Movie Character Relationship Analysis via Social Network. In MultiMedia Modeling - Proceedings of the 24th International Conference on MultiMedia Modeling (MMM 2018) (Lecture Notes in Computer Science), Klaus Schoeffmann, Thanarat H. Chalidabhongse, Chong-Wah Ngo, Supavadee Aramvith, Noel E. O'Connor, Yo-Sung Ho, Moncef Gabbouj, and Ahmed Elgammal (Eds.), Vol. 10705. Springer, Bangkok, Thailand, 289--301. https://doi.org/10.1007/978-3-319-73600-6_25
[6]
Jai E. Jung, O-Joun Lee, Eun-Soon You, and Myoung-Hee Nam. 2017. A computational model of transmedia ecosystem for story-based contents. Multimedia Tools and Applications 76, 8 (Apr 2017), 10371--10388. https://doi.org/10.1007/s11042-016-3626-5
[7]
Jason J. Jung, Eunsoon You, and Seung-Bo Park. 2013. Emotion-based character clustering for managing story-based contents: a cinemetric analysis. Multimedia Tools and Applications 65, 1 (jun 2013), 29--45. https://doi.org/10.1007/s11042-012-1133-x
[8]
Vincent Labatut and Xavier Bost. 2019. Extraction and Analysis of Fictional Character Networks: A Survey. Comput. Surveys (2019). To Appear.
[9]
O-Joun Lee. 2019. Learning Distributed Representations of Character Networks for Computational Narrative Analytics. Ph.D. Dissertation. Chung-Ang University, Seoul, Republic of Korea.
[10]
O-Joun Lee, Nayoung Jo, and Jason J. Jung. 2018. Measuring Character-based Story Similarity by Analyzing Movie Scripts. In Proceedings of the 1st Workshop on Narrative Extraction From Text (Text2Story 2018) co-located with the 40th European Conference on Information Retrieval (ECIR 2018) (CEUR Workshop Proceedings), Alípio Mário Jorge, Ricardo Campos, Adam Jatowt, and Sérgio Nunes (Eds.), Vol. 2077. CEUR-WS.org, Grenoble, France, 41--45.
[11]
O-Joun Lee and Jason J. Jung. 2016. Affective Character Network for Understanding Plots of Narrative Contents. In Proceedings of the Workshop on Affective Computing and Context Awareness in Ambient Intelligence (AfCAI 2016) (CEUR Workshop Proceedings), María Trinidad Herrero Ezquerro, Grzegorz J. Nalepa, and José Tomás Palma Mendez (Eds.), Vol. 1794. CEUR-WS.org, Murcia, Spain.
[12]
O-Joun Lee and Jason J. Jung. 2018. Explainable Movie Recommendation Systems by using Story-based Similarity. In Joint Proceedings of the ACM IUI 2018 Workshops co-located with the 23rd ACM Conference on Intelligent User Interfaces (ACM IUI 2018) (CEUR Workshop Proceedings), Alan Said and Takanori Komatsu (Eds.), Vol. 2068. CEUR-WS.org, Tokyo, Japan.
[13]
O-Joun Lee and Jason J. Jung. 2019. Character Network Embedding-based Plot Structure Discovery in Narrative Multimedia. In Proceedings of the 9th International Conference on Web Intelligence, Mining and Semantics (WIMS 2019), Rajendra Akerkar and Jason J. Jung (Eds.). ACM, Seoul, Republic of Korea, 15:1-15:9. https://doi.org/10.1145/3326467.3326485
[14]
O-Joun Lee and Jason J. Jung. 2019. Integrating Character Networks for Extracting Narratives from Multimodal Data. Information Processing and Management 56, 5 (Sept. 2019), 1894--1923. https://doi.org/10.1016/j.ipm.2019.02.005
[15]
O-Joun Lee and Jason J. Jung. 2019. Modeling affective character network for story analytics. Future Generation Computer Systems 92 (March 2019), 458--478. https://doi.org/10.1016/j.future.2018.01.030
[16]
O-Joun Lee and Jason J. Jung. 2020. Story embedding: Learning distributed representations of stories based on character networks. Artificial Intelligence 281 (April 2020), 103235. https://doi.org/10.1016/j.artint.2020.103235
[17]
O-Joun Lee and Jason J. Jung. 2020. Story Embedding: Learning Distributed Representations of Stories based on Character Networks (Extended Abstract). In Proceedings of the 29th International Joint Conference on Artificial Intelligence (IJCAI 2020) and the 17th Pacific Rim International Conference on Artificial Intelligence (PRICAI 2020), Christian Bessiere (Ed.). International Joint Conferences on Artificial Intelligence Organization, Yokohama, Japan, 5070--5074. https://doi.org/10.24963/ijcai.2020/709
[18]
O-Joun Lee, Jason J. Jung, and Jin-Taek Kim. 2020. Learning Hierarchical Representations of Stories by Using Multi-layered Structures in Narrative Multimedia. Sensors 20, 7 (April 2020), 1978. https://doi.org/10.3390/s20071978
[19]
O-Joun Lee and Jin-Taek Kim. 2020. Measuring Narrative Fluency by Analyzing Dynamic Interaction Networks in Textual Narratives. In Proceedings of the 3rd Workshop on Narrative Extraction From Texts (Text2Story 2020), co-located with the 42nd European Conference on Information Retrieval (ECIR 2020) (CEUR Workshop Proceedings), Ricardo Campos, Alípio Mário Jorge, Adam Jatowt, and Sumit Bhatia (Eds.), Vol. 2593. CEUR-WS.org, Lisbon, Portugal, 15--22.
[20]
Jun-Ying Li, Li-Wei Kang, Chia-Ming Tsai, and Chia-Wen Lin. 2015. Learning-based movie summarization via role-community analysis and feature fusion. In Proceedings of the 17th IEEE International Workshop on Multimedia Signal Processing (MMSP 2015). IEEE, Xiamen, China, 1--6. https://doi.org/10.1109/MMSP.2015.7340794
[21]
Chao Liang, Yifan Zhang, Jian Cheng, Changsheng Xu, and Hanqing Lu. 2009. A Novel Role-Based Movie Scene Segmentation Method. In Advances in Multimedia Information Processing, Paisarn Muneesawang, Feng Wu, Itsuo Kumazawa, Athikom Roeksabutr, Mark Liao, and Xiaoou Tang (Eds.). Vol. 5879. Springer Berlin Heidelberg, Bangkok, Thailand, 917--922. https://doi.org/10.1007/978-3-642-10467-1_82
[22]
Robert McKee. 1997. Story: Substance, Structure, Style and the Principles of Screen-writing. HarperCollins, New York, NY, USA.
[23]
Annamalai Narayanan, Mahinthan Chandramohan, Lihui Chen, Yang Liu, and Santhoshkumar Saminathan. 2016. subgraph2vec:Learning Distributed Representations of Rooted Sub-graphs from Large Graphs. Computing Research Repository (CoRR) abs/1606.08928 (June 2016).
[24]
Annamalai Narayanan, Mahinthan Chandramohan, Rajasekar Venkatesan, Lihui Chen, Yang Liu, and Shantanu Jaiswal. 2017. graph2vec: Learning Distributed Representations of Graphs. Computing Research Repository (CoRR) abs/1707.05005 (July 2017).
[25]
Wen Qu, Yifei Zhang, Daling Wang, Shi Feng, and Ge Yu. 2015. Semantic movie summarization based on string of IE-RoleNets. Computational Visual Media 1, 2 (June 2015), 129--141. https://doi.org/10.1007/s41095-015-0015-3
[26]
Jitao Sang and Changsheng Xu. 2010. Character-based movie summarization. In Proceedings of the 18th ACM international conference on Multimedia (MM 2010), Alberto Del Bimbo, Shih-Fu Chang, and Arnold W. M. Smeulders (Eds.). ACM Press, 855--858. https://doi.org/10.1145/1873951.1874096
[27]
Quang Dieu Tran, Dosam Hwang, O-Joun Lee, and Jai E.Jung. 2017. Exploiting Character Networks for Movie Summarization. Multimedia Tools and Applications 76, 8 (Apr 2017), 10357--10369. https://doi.org/10.1007/s11042-016-3633-6
[28]
Quang Dieu Tran, Dosam Hwang, O-Joun Lee, and Jason J. Jung. 2017. A Novel Method for Extracting Dynamic Character Network from Movie. In Big Data Technologies and Applications, Jason J. Jung and Pankoo Kim (Eds.). Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST), Vol. 194. Springer International Publishing, Seoul, Republic of Korea, 48--53. https://doi.org/10.1007/978-3-319-58967-1_6
[29]
Quang Dieu Tran and Jai E. Jung. 2015. CoCharNet: Extracting Social Networks using Character Co-occurrence in Movies. Journal of Universal Computer Science 21, 6 (June 2015), 796--815. https://doi.org/10.3217/jucs-021-06-0796
[30]
John Truby. 2008. The anatomy of story: 22 steps to becoming a master storyteller. Farrar, Straus and Giroux.
[31]
Chia-Ming Tsai, Li-Wei Kang, Chia-Wen Lin, and Weisi Lin. 2013. Scene-Based Movie Summarization Via Role-Community Networks. IEEE Transactions on Circuits and Systems for Video Technology 23, 11 (June 2013), 1927--1940. https://doi.org/10.1109/TCSVT.2013.2269186
[32]
Chung-Yi Weng, Wei-Ta Chu, and Ja-Ling Wu. 2009. RoleNet: Movie Analysis from the Perspective of Social Networks. IEEE Transactions on Multimedia 11, 2 (feb 2009), 256--271. https://doi.org/10.1109/tmm.2008.2009684

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ACM ICEA '20: Proceedings of the 2020 ACM International Conference on Intelligent Computing and its Emerging Applications
December 2020
219 pages
ISBN:9781450383042
DOI:10.1145/3440943
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 September 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Character Network
  2. Computational Narrative
  3. Plot Structure
  4. Story-based Summarization

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • Institute for Information \& communications Technology Planning & Evaluation

Conference

ACM ICEA '20
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 56
    Total Downloads
  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)1
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media