research-article

Character Network Embedding-based Plot Structure Discovery in Narrative Multimedia

Authors:

Jason J. JungAuthors Info & Claims

WIMS2019: Proceedings of the 9th International Conference on Web Intelligence, Mining and Semantics

Article No.: 15, Pages 1 - 9

https://doi.org/10.1145/3326467.3326485

Published: 26 June 2019 Publication History

Abstract

This study aims to discover plot structures of narrative multimedia (i.e., creative works that contain stories and are distributed through multimedia). Although a few studies have been conducted to extract subplots from narrative works based on occurrences of characters, the subplots do not always have distinctive compositions of characters. Therefore, we propose a method for discriminating the subplots based on overall social relationships among characters. To understand ways how a story is interwoven with subplots, it is important to describe how story lines in each subplot are developed and how subplots are split and rearranged. As a first step, we propose a measurement for estimating rapidity of story development based on changes in the social relationships among characters. Subsequently, we suggest a model for representing plot structures based on transitions among subplots, the narrative significance of each scene, and the main characters of each subplot. We anticipate that the plot structures can be applied for summarizing narrative multimedia regarding the story.

References

[1]

Xavier Bost. 2016. A storytelling machine?: automatic video summarization: the case of TV series. Ph.D. Dissertation. University of Avignon, France.

[2]

Xavier Bost, Vincent Labatut, Serigne Gueye, and Georges Linarès. 2016. Narrative smoothing: Dynamic conversational network for the analysis of TV series plots. In Proceedings of the 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2016), Ravi Kumar, James Caverlee, and Hanghang Tong (Eds.). IEEE Computer Society, San Francisco, CA, US, 1111--1118.

Digital Library

[3]

Xavier Bost, Vincent Labatut, Serigne Gueye, and Georges Linarès. 2018. Extraction and Analysis of Dynamic Conversational Networks from TV Series. In Social Network Based Big Data Analysis and Applications, Mehmet Kaya, Jalal Kawash, Suheil Khoury, and Min-Yuh Day (Eds.). Springer, 55--84.

[4]

Antonio Brisson and Ana Paiva. 2007. Are We Telling the Same Story?. In Proceedings of the 2007 AAAI Fall Symposium on Narrative Intelligence Technologies, Brian S. Magerko and Mark O. Riedl (Eds.). AAAI, Arlington, Virginia, US, 9--16.

[5]

Micha Elsner. 2012. Character-based kernels for novelistic plot structure. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2012), Walter Daelemans, Mirella Lapata, and Lluís Màrquez (Eds.). The Association for Computer Linguistics, Avignon, France, 634--644.

Digital Library

[6]

Micha Elsner. 2015. Abstract Representations of Plot Structure. Linguistic Issues in Language Technology (LiLT) 12, 5 (Oct. 2015).

[7]

Pablo Gervás, Birte Lönneker, Jan Chrisoph Meister, and Federico Peinado. 2006. Narrative Models: Narratology Meets Artificial Intelligence. In Proceedings of the International Conference on Language Resources and Evaluation (LREC 2006). 44--51.

[8]

Maria Halkidi, Yannis Batistakis, and Michalis Vazirgiannis. 2002. Cluster validity methods: Part I. ACM SIGMOD Record 31, 2 (jun 2002), 40--45.

Digital Library

[9]

Maria Halkidi, Yannis Batistakis, and Michalis Vazirgiannis. 2002. Clustering Validity Checking Methods: Part II. ACM SIGMOD Record 31, 3 (September 2002), 19--27.

Digital Library

[10]

Long Nguyen Hoang, O-Joun Lee, Jai E. Jung, Jaehwa Park, Tai-Won Um, and Hyun-Woo Lee. 2017. Event-Driven Trust Refreshment on Ambient Services. IEEE Access 5 (Mar 2017), 4664--4670.

[11]

Jai E.Jung, O-Joun Lee, Eun-Soon You, and Myoung-Hee Nam. 2017. A computational model of transmedia ecosystem for story-based contents. Multimedia Tools and Applications 76, 8 (Apr 2017), 10371--10388.

Digital Library

[12]

Quoc V. Le and Tomas Mikolov. 2014. Distributed Representations of Sentences and Documents. In Proceedings of the 31th International Conference on Machine Learning (ICML 2014) (JMLR Workshop and Conference Proceedings), Eric P. Xing and Tony Jebara (Eds.), Vol. 32.JMLR.org, Beijing, China, 1188--1196.

Digital Library

[13]

O-Joun Lee, Long Nguyen Hoang, Jai E.Jung, Tai-Won Um, and Hyun-Woo Lee. 2017. Towards Ontological Approach on Trust-Aware Ambient Services. IEEE Access 5 (Feb 2017), 1589--1599.

[14]

O-Joun Lee and Jai E. Jung. 2017. Sequence Clustering-based Automated Rule Generation for Adaptive Complex Event Processing. Future Generation Computer Systems 66 (Jan 2017), 100--109.

Digital Library

[15]

O-Joun Lee, Nayoung Jo, and Jason J. Jung. 2018. Measuring Character-based Story Similarity by Analyzing Movie Scripts. In Proceedings of the 1st Workshop on Narrative Extraction From Text (Text2Story 2018) co-located with the 40th European Conference on Information Retrieval (ECIR 2018) (CEUR Workshop Proceedings), Alípio Mário Jorge, Ricardo Campos, Adam Jatowt, and Sérgio Nunes (Eds.), Vol. 2077. CEUR-WS.org, Grenoble, France, 41--45.

[16]

O-Joun Lee and Jason J. Jung. 2016. Affective Character Network for Understanding Plots of Narrative Contents. In Proceedings of the Workshop on Affective Computing and Context Awareness in Ambient Intelligence (AfCAI 2016) (CEUR Workshop Proceedings), María Trinidad Herrero Ezquerro, Grzegorz J. Nalepa, and José Tomás Palma Mendez (Eds.), Vol. 1794. CEUR-WS.org, Murcia, Spain.

[17]

O-Joun Lee and Jason J. Jung. 2018. Explainable Movie Recommendation Systems by using Story-based Similarity. In Joint Proceedings of the ACM IUI 2018 Workshops co-located with the 23rd ACM Conference on Intelligent User Interfaces (ACM IUI 2018) (CEUR Workshop Proceedings), Alan Said and Takanori Komatsu (Eds.), Vol. 2068. CEUR-WS.org, Tokyo, Japan.

[18]

O-Joun Lee and Jason J. Jung. 2019. Integrating Character Networks for Extracting Narratives from Multimodal Data. Information Processing and Management (Feb. 2019). To Appear.

[19]

O-Joun Lee and Jason J. Jung. 2019. Modeling affective character network for story analytics. Future Generation Computer Systems 92 (March 2019), 458--478.

[20]

Chao Liang, Yifan Zhang, Jian Cheng, Changsheng Xu, and Hanqing Lu. 2009. A Novel Role-Based Movie Scene Segmentation Method. In Advances in Multimedia Information Processing, Paisarn Muneesawang, Feng Wu, Itsuo Kumazawa, Athikom Roeksabutr, Mark Liao, and Xiaoou Tang (Eds.). Vol. 5879. Springer Berlin Heidelberg, Bangkok, Thailand, 917--922.

Digital Library

[21]

Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient Estimation of Word Representations in Vector Space. (Sept. 2013). http://arxiv.org/abs/1301.3781 arXiv preprint: 1301.3781.

[22]

Annamalai Narayanan, Mahinthan Chandramohan, Lihui Chen, Yang Liu, and Santhoshkumar Saminathan. 2016. subgraph2vec: Learning Distributed Representations of Rooted Sub-graphs from Large Graphs. Computing Research Repository (CoRR) abs/1606.08928 (June 2016).

[23]

Annamalai Narayanan, Mahinthan Chandramohan, Rajasekar Venkatesan, Lihui Chen, Yang Liu, and Shantanu Jaiswal. 2017. graph2vec: Learning Distributed Representations of Graphs. Computing Research Repository (CoRR) abs/1707.05005 (July 2017).

[24]

Seung-Bo Park, Kyeong-Jin Oh, and GeunSik Jo. 2012. Social network analysis in a movie using character-net. Multimedia Tools and Applications 59, 2 (jan 2012), 601--627.

Digital Library

[25]

Graham Alexander Sack. 2013. Simulating Plot: Towards a Generative Model of Narrative Structure. In Proceedings of the 2013 Annual International Conference of the Alliance of Digital Humanities Organizations (DH 2013). Alliance of Digital Humanities Organizations (ADHO), Lincoln, NE, US, 371--372.

[26]

Jitao Sang and Changsheng Xu. 2010. Character-based movie summarization. In Proceedings of the 18th ACM international conference on Multimedia (MM 2010), Alberto Del Bimbo, Shih-Fu Chang, and Arnold W. M. Smeulders (Eds.). ACM Press, Firenze, Italy, 855--858.

Digital Library

[27]

Nino Shervashidze, Pascal Schweitzer, Erik Jan van Leeuwen, Kurt Mehlhorn, and Karsten M. Borgwardt. 2011. Weisfeiler-Lehman Graph Kernels. Journal of Machine Learning Research 12 (Sept. 2011), 2539--2561.

Digital Library

[28]

Quang Dieu Tran, Dosam Hwang, O-Joun Lee, and Jai E. Jung. 2017. Exploiting Character Networks for Movie Summarization. Multimedia Tools and Applications 76, 8 (Apr 2017), 10357--10369.

Digital Library

[29]

Quang Dieu Tran, Dosam Hwang, O-Joun Lee, and Jason J. Jung. 2017. A Novel Method for Extracting Dynamic Character Network from Movie. In Big Data Technologies and Applications, Jason J. Jung and Pankoo Kim (Eds.). Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST), Vol. 194. Springer International Publishing, Seoul, Republic of Korea, 48--53.

[30]

Quang Dieu Tran and Jai E. Jung. 2015. CoCharNet: Extracting Social Networks using Character Co-occurrence in Movies. JUCS - Journal of Universal Computer Science 21, 6 (Jun 2015), 796--815.

[31]

Chung-Yi Weng, Wei-Ta Chu, and Ja-Ling Wu. 2009. RoleNet: Movie Analysis from the Perspective of Social Networks. IEEE Transactions on Multimedia 11, 2 (feb 2009), 256--271.

Digital Library

Cited By

Lei BWu ZYang H(2025)Uncovering accessible narration underpinning adaption of literary novels based on character networkInternational Journal of Modern Physics C10.1142/S0129183125500202Online publication date: 24-Jan-2025
https://doi.org/10.1142/S0129183125500202
Lee OKim JYou E(2020)Towards Story-based Summarization of Narrative MultimediaProceedings of the 2020 ACM International Conference on Intelligent Computing and its Emerging Applications10.1145/3440943.3444719(1-5)Online publication date: 12-Dec-2020
https://dl.acm.org/doi/10.1145/3440943.3444719
Lee OKim J(2020)Learning Multi-modal Representations of Narrative MultimediaProceedings of the International Conference on Research in Adaptive and Convergent Systems10.1145/3400286.3418216(1-6)Online publication date: 13-Oct-2020
https://dl.acm.org/doi/10.1145/3400286.3418216
Show More Cited By

Index Terms

Character Network Embedding-based Plot Structure Discovery in Narrative Multimedia

Recommendations

Story embedding: Learning distributed representations of stories based on character networks
Highlights
- This study proposes novel models and methods for representing stories of narrative works.
Abstract
This study aims to learn representations of stories in narrative works (i.e., creative works that contain stories) using fixed-length vectors. Vector representations of stories enable us to compare narrative works regardless of their ...
Towards Story-based Summarization of Narrative Multimedia
ACM ICEA '20: Proceedings of the 2020 ACM International Conference on Intelligent Computing and its Emerging Applications

This study aims at summarizing narrative works (i.e., creative works that contain stories) in the consideration of their stories and types of required summaries. Various methods for story-based summarization have been proposed as a practical application ...
Integrating character networks for extracting narratives from multimodal data
Abstract
This study aims to integrate diverse data within narrative multimedia (i.e., artworks containing stories and distributed through multimedia) into a unified character network (i.e., a social network between characters that appear in the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

WIMS2019: Proceedings of the 9th International Conference on Web Intelligence, Mining and Semantics

June 2019

231 pages

ISBN:9781450361903

DOI:10.1145/3326467

Conference Chair:
Rajendra Akerkar,
General Chair:
Jason J. Jung

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

CAU: Chung-Ang University
KISM: Korean Institute of Smart Media

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

WIMS2019

WIMS2019: 9th International Conference on Web Intelligence, Mining and Semantics

June 26 - 28, 2019

Seoul, Republic of Korea

Acceptance Rates

Overall Acceptance Rate 140 of 278 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
222
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)3

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lei BWu ZYang H(2025)Uncovering accessible narration underpinning adaption of literary novels based on character networkInternational Journal of Modern Physics C10.1142/S0129183125500202Online publication date: 24-Jan-2025
https://doi.org/10.1142/S0129183125500202
Lee OKim JYou E(2020)Towards Story-based Summarization of Narrative MultimediaProceedings of the 2020 ACM International Conference on Intelligent Computing and its Emerging Applications10.1145/3440943.3444719(1-5)Online publication date: 12-Dec-2020
https://dl.acm.org/doi/10.1145/3440943.3444719
Lee OKim J(2020)Learning Multi-modal Representations of Narrative MultimediaProceedings of the International Conference on Research in Adaptive and Convergent Systems10.1145/3400286.3418216(1-6)Online publication date: 13-Oct-2020
https://dl.acm.org/doi/10.1145/3400286.3418216
Lee OJung J(2020)Story embeddingArtificial Intelligence10.1016/j.artint.2020.103235281:COnline publication date: 1-Apr-2020
https://dl.acm.org/doi/10.1016/j.artint.2020.103235
Jeon HLee OJung J(2019)Is Performance of Scholars Correlated to Their Research Collaboration Patterns?Frontiers in Big Data10.3389/fdata.2019.000392Online publication date: 5-Nov-2019
https://doi.org/10.3389/fdata.2019.00039

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten