Abstract
There have been various approaches to analyzing movie stories using social networks. Social network analysis is an effective means to extract semantic information from movies. Movie analysis through social relationships among characters can support various types of information retrieval better than audio-visual feature analysis. The relationships among characters form the main structure of the story. Therefore, through social network analysis among characters, movie story information such as the major roles and the corresponding communities can be determined. Progression of most movie stories is done by characters, and the scriptwriter or director narrates the story and relationships among characters using character dialogs. A dialog has a direction and time that supplies information. Therefore, the dialog is better for constructing social networks of characters than the co-appearance. Additionally, through social networks using the dialog, we can extract accurate movie stories such as classification of major, minor or extra roles, community clustering, and sequence detection. To achieve this, we propose a Character-net that can represent the relationships between characters using dialogs, and a method that can extract the sequences via clustering communities composed of characters. Our experiments show that our proposed method can efficiently detect sequences.
Similar content being viewed by others
References
Ajmera J, Wooters C (2003) A robust speaker clustering algorithm, in Proc. IEEE Workshop on Automatic Speech Recognition Understanding, pp. 411–416
Cour T, Jordan C, Miltsakaki E, Taskar B (2008) Movie/script: Alignment and parsing of video and text transcription. Proc. 10th European Conf. Computer Vision, pp. 158–171
Everingham M, Sivic J, Zisserman A (2008) Taking the bite out of automated naming of characters in TV video. Image and Vision Computing, In Press, Corrected Proof, Available online, 4 May
Freebase, http://www.freebase.com
Garg NP, Favre S, Salamin H, Hakkani Tur D, Vinciarelli A (2008) Role recognition for meeting participants: an approach based on lexical information and social network analysis, in cedinging of ACM Multimedia Conf., pp. 693–696
Guimera R, Danon L, Diaz-Guilera A, Giralt F, Arenas A (2003) Self-similar community structure in a network of human interactions. Phys Rev 68:651031–651034
Hung H, Jayagopi D, Yeo C, Friendland G, Ba S, Ramchandran J, Mirghafori N, Gatica-Perez D (2007) Using audio and video features to classify the most dominant person in a group meeting, in Proc. ACM Multimedia Conf., pp. 835–838
Jung B, Kwak T, Song J, Lee Y (2004) Narrative abstraction model for story-oriented video. Proceedings of the 12th annual ACM international conference on Multimedia, 10–16 Oct
Khatoonabadi SH, Rahmati M (2009) Automatic soccer players tracking in goal scenes by camera motion elimination. Image Vis Comput 27(4):469–479
Kwon OB (2003) ‘I know what you need to buy’: context-aware multimedia-based recommendation system. Expert Syst Appl 25(3):387–400
Liang L, Haifeng G, Li L, Liang W (2009) Semantic event representation and recognition using syntactic attribute graph grammar. Pattern Recognit Lett 30(2):180–186
Lienhart R, Pfeiffer S, Effelsberg W (1997) Video abstracting. J ACM 40:55–62
Linked Movie Data Base, http://www.linkedmdb.org
Linking Open Data (W3C SWEO Community Project), http://esw.w3.org/SweoIG/TaskForces/CommunityProjects/LinkingOpenData
Money G, Agius H (2008) Video summarisation: a conceptual framework and survey of the state of the art. J Vis Commun Image Represent 19(2):121–143
Naver Movie, http://movie.naver.com/index.html
Neti C, Potamianos G, Luettin J, Matthews I, Glotin H, Vergyri D, Sison J, Mashari A, Zhou J (2000) Audio-visual speech recognition, Center Lang. Speech Process., Johns Hopkins Univ., Baltimore, MD
Otsuka I, Nakane K, Divakaran A, Hatanaka K, Ogawa M (2005) A highlight scene detection and video summarization system using audio feature for a personal video recorder. IEEE Trans Consum Electron 51(1):112–116
Park S-B, Kim Y-W, Nazim M, Jo G-S (2009) Character-Net: character network analysis from video. Web Intelligence and Intelligent Agent Technologies 2009 (WI-IAT ‘09). IEEE/WIC/ACM International Joint Conferences on, Vol. 1, pp 305–308, 15–18 Sept
Poppe C, Martens G, Mannens E, de Walle RV (2009) Personal content management system: a semantic approach. J Vis Commun Image Represent 20(2):131–144
Rienks R, Zhang D, Post W (2006) Detection and application of influence rankings in small group meetings, in Proc. Int. Conf. Multimodal Interfaces, pp. 257–264
Ronfard R, Thuong TT (2003) A framework for aligning and indexing movies with their script. Proc. IEEE Int. Conf. Multimedia and Expo (ICME 2003), pp. 21–24
Roth V (1999) Content-based retrieval from digital video. Image Vis Comput 17(7):531–540
Rui Y, Huang TS, Mehrotra S (1999) Constructing Table-of-Content for Videos, to appear in ACM Multimedia Systems Journal, Special Issue Multimedia Systems on Video Libraries, September
Smeaton AF (2007) Techniques used and open challenges to the analysis, indexing and retrieval of digital video. Inf Syst 32(4):545–559
Smoliar S, Zhang H (1994) Content-based video indexing and retrieval. IEEE Trans Multimedia 1:62–72
Turetsky R, Dimitrova N (2004) Screenplay alignment for closed-system speaker identification and analysis of feature films. Proc IEEE Int Conf Multimedia Expo 3:1659–1662
Vinciarelli A, Fernandez F, Favre S (2006) Semantic segmentation of radio programs using social network analysis and duration distribution modeling, in Proc. IEEE Int. Conf. Multimedia & Expo., pp. 779–782
Wasserman S, Faust K (1994) Social network analysis: methods and applications. Cambridge University Press, Cambrige
Weng CY, Chu WT, Wu JL (2009) RoleNet: movie analysis from the perspective of social network. IEEE Trans Multimedia 11(2):256–271
Yeung M, Yeo B-L, Liu B (1996) Extracting story units from long programs for video browsing and navigation. In Proceedings of lEEE Multimedia Computing & Systems 1996, IEEE Computer Society Press, pp. 296–305. 17–23 June
Zabih R, Miller J, Mai K (1995) A feature-based algorithm for detecting and classifying scene break. ACM International Conference on Multi-media, pp. 189–200
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Park, SB., Oh, KJ. & Jo, GS. Social network analysis in a movie using character-net. Multimed Tools Appl 59, 601–627 (2012). https://doi.org/10.1007/s11042-011-0725-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-011-0725-1