Abstract
Comic storyboard extraction aims to decompose the comic image into several storyboards (or frames), which is the key technique to produce the digital comic documents suitable for mobile reading. Previous methods fail either to detect overlapped storyboards or to produce storyboards without blank margins. To tackle these problems, we propose a novel comic storyboard extraction method based on edge segment analysis. First, we extract edge segments (i.e. contiguous chains of Canny edge points) from the input comic image; second, we detect line segments within each obtained edge segment with a top-down scheme; third, we detect storyboards through line segments combination and storyboard validation, and perform post-processing to handle some special cases. We test the proposed method on two datasets comprising 2237 comic pages from 11 printed comic series. Experimental results demonstrate that the proposed method achieves satisfactory results and outperformed the existing methods on the storyboard and page level.















Similar content being viewed by others
References
Akinlar C, Topal C (2011) EDLines: a real-time line segment detector with a false detection control. Pattern Recogn Lett 32(13):1633–1642
Arai K, Tolle H (2010) Automatic e-comic content adaptation. Int J Ubiquit Comput 1(1):1–11
Canny J (1986) A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell 6:679–698
Chan CH, Leung H, Komura T (2007) Automatic panel extraction of color comic images. In: Advances in Multimedia Information Processing–PCM 2007 (pp. 775–784). Springer Berlin Heidelberg
Desolneux A, Moisan L, Morel JM (2000) Meaningful alignments. Int J Comput Vis 40(1):7–23
Han EJ, Wong CO, Jung KC, Lee KH, Kim EY (2009) Efficient page layout analysis on small devices. J Zhejiang Univ Sci A 10(6):800–804
Ho AKN, Burie JC, Ogier J (2012) Panel and speech balloon extraction from comic books. In: Document Analysis Systems (DAS), 2012 10th IAPR International Workshop on (pp. 424–428). IEEE
Ishii D, Watanabe H (2010). A study on frame position detection of digitized comics images. In: Workshop on Picture Coding and Image Processing (PCSJ), Nagoya (Vol. 2010, pp. 124–125)
Li L, Wang Y, Tang Z, Gao L (2014) Automatic comic page segmentation based on polygon detection. Multimedia Tools Appl 69(1):171–197
Li L, Wang Y, Tang Z, Liu D (2013) Comic image understanding based on polygon detection. In: IS&T/SPIE Electronic Imaging (pp. 86580B–86580B). International Society for Optics and Photonics
Liu D, Wang Y, Tang Z, Li L, Gao L. Automatic comic page image understanding based on edge segment analysis. DRR 2014: 90210J-90210J-12
Liu D, Wang Y, Tang Z, Lu X (2014) A robust and fast line segment detector based on top-down smaller eigenvalue analysis. In: Fifth International Conference on Graphic and Image Processing (pp. 906916–906916). International Society for Optics and Photonics
Ponsard C, Fries V (2009) Enhancing the accessibility for all of digital comic books. Int J Hum Comput Interact 1(5):127–144
Rigaud C, Tsopze N, Burie JC, Ogier JM (2013) Robust frame and text extraction from comic books. In: Graphics Recognition. New Trends and Challenges (pp. 129–138). Springer Berlin Heidelberg
Tanaka T, Shoji K, Toyama F, Miyamichi J (2007) Layout analysis of tree-structured scene frames in comic images. In: IJCAI 7:2885–2890
Von Gioi RG, Jakubowicz J, Morel JM, Randall G (2010) LSD: a fast line segment detector with a false detection control. IEEE Trans Pattern Anal Mach Intell 32(4):722–732
Yamada M, Budiarto R, Mamoru ENDO, Miyazaki S (2004) Comic image decomposition for reading comics on cellular phones. IEICE Trans Inf Syst 87(6):1370–1376
Acknowledgments
This work is supported by National Natural Science Foundation of China under Grant 61300061, and Beijing Natural Science Foundation under Grant 4132033.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, Y., Zhou, Y., Liu, D. et al. Comic storyboard extraction via edge segment analysis. Multimed Tools Appl 75, 2637–2654 (2016). https://doi.org/10.1007/s11042-015-2680-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-015-2680-8