Skip to main content
SpringerLink
Log in

Detection of exact and similar partial copies for copyright protection of manga

  • Original Paper
  • Published:
International Journal on Document Analysis and Recognition (IJDAR) Aims and scope Submit manuscript

Abstract

Manga, a kind of Japanese comic book, is an important genre in the realm of image publications requiring copyright protection. To copy manga, illegal users generally focus on certain interesting parts from which to make partial copies to apply in their own drawings. With respect to their sources, copying of manga can be divided into two types: (1) exact copies, which duplicate specific contents of manga, such as scanned manga publications (printed copies) and traced outlines of manga (hand-drawn copies), and (2) similar partial copies, which infringe the copyright of manga characters based on their features. In this paper, we propose applying content-based image retrieval methods to detect both exact and similar copies based on two kinds of regions of interest (ROIs): generic ROIs and face ROIs. The method is able not only to locate the partial copies from images with complex backgrounds, but also to report the corresponding copied parts of copyrighted manga pages for exact copy detection and copied manga characters for similar copy detection. The experimental results prove high performance of the proposed method for detecting printed partial copies. In addition, 85 % of hand-drawn and 77 % of similar partial copies were detected with relatively high precision using a database containing more than \(10{,}000\) manga pages.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24

Similar content being viewed by others

Notes

  1. Except for special declarations, all the images shown in this paper are drawn by a manga artist for this research. Therefore, they are quite similar to real manga publications.

  2. They include \(18\) titles of manga publications ( “20th Century Boys”, “ARIA”, “Kare Kano”, “Neon Genesis Evangelion”, “Hoshin Engi”, “H2”, “Hunter \(\times \) Hunter”, “Stone Ocean”, “Lucky Star”, “Master Keaton”, “Maison Ikkoku”, “Miyuki”, “Monster”, “Rozen Maiden”, “Planetes”, “Rosario + Vampire”, , “SLAM DUNK” “Rurouni Kenshin”) from e-manga, and \(3\) titles of manga drawn for this research. For each manga publication, there are \(4\) volumes and about \(200\) pages (color pages or white pages were removed) in each volume. For the manga drawn for this research, there are \(44\) manga pages in total. The sizes of digitized images are different for different titles. Normally, the printed manga pages are \(103\) mm \(\times 182\) mm, \(115\) mm \(\times 175\) mm, \(128\) mm \(\times 182\) mm and \(148\) mm \(\times 210\) mm, and the resolutions of scanners are from 100 to 200 dpi.

References

  1. 2007 publication index annual report. The all Japan Magazine and Book publishers’ and Editors Association, the Research Institute for Publications (2002)

  2. Arya, S., Mount, D.M., Netanyahu, N.S., Silverman, R., Wu, A.Y.: An optimal algorithm for approximate nearest neighbor searching fixed dimensions. J. ACM 45(6), 891–923 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  3. Bas, P., Chassery, J.M., Macq, B.M.: Geometrically invariant watermarking using feature points. IEEE Trans. Image Process. 11(9), 1014–1028 (2002)

    Article  Google Scholar 

  4. Berrani, S.A., Amsaleg, L., Gros, P.: Robust content-based image searches for copyright protection. In: Proceedings of the 1st ACM International Workshop on Multimedia databases, pp. 70–77 (2003)

  5. Berretti, S., Bimbo, A.D., Pala, P.: Retrieval by shape similarity with perceptual distance and effective indexing. IEEE Trans. MultiMedia 2(4), 225–239 (2000)

    Article  Google Scholar 

  6. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition vol. 1, 886–893 (2005)

  7. Do, M.N., Vetterli, M.: Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance. IEEE Trans. Image Process. 11, 146–158 (2002)

    Article  MathSciNet  Google Scholar 

  8. Douze, M., Jegou, H., Schmid, C.: An image-based approach to video copy detection with spatio-temporal post-filtering. IEEE Trans. Multimedia 12(4), 257–266 (2010)

    Article  Google Scholar 

  9. Eickeler, S., Müller, S.: Content-based video indexing of tv broadcast news using hidden markov models. In: Proceedings of IEEE International Conference on Acoustics, Speech, and, Signal Processing, pp. 2997–3000 (1999)

  10. Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1627–1645 (2010)

    Article  Google Scholar 

  11. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    Article  MathSciNet  Google Scholar 

  12. Fishbein, J.: Europe’s manga mania. BusinessWeek (2007)

  13. Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. In: Proceedings of the 2nd European Conference on Computational Learning Theory, EuroCOLT ’95, pp. 23–37 (1995)

  14. Gionis, A., Indyk ,P., Motwani, R.: Similarity search in high dimensions via hashing. In: Proceedings of the 25th International Conference on Very Large Data, Bases, pp. 518–529 (1999)

  15. Han, J., Ma, K.: Fuzzy color histogram and its use in color image retrieval. IEEE Trans. Image Process. 11(8), 944–952 (2002)

    Article  Google Scholar 

  16. Heikkila, M., Pietikainen, M., Schmid, C.: Description of interest regions with local binary patterns. Pattern Recognit. 42(3), 425–436 (2009)

    Article  Google Scholar 

  17. Hinton, G., Salakhutdinov, R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  18. Hsiao, J.H., Chen, C.S., Chien, L.F., Chen, M.S.: A new approach to image copy detection based on extended feature sets. IEEE Trans. Image Process. 16(8), 2069–2079 (2007)

    Article  MathSciNet  Google Scholar 

  19. Jolliffe, I.: Principal Component Analysis. Springer, Berlin (1986)

    Book  Google Scholar 

  20. Joly, A., Frélicot, C., Buisson, O.: Robust content-based video copy identification in a large reference database. In: Proceedings of the 2nd International Conference on Image and Video Retrieval, pp. 414–424 (2003)

  21. Joly, A., Frélicot, C., Buisson, O.: Content-based copy retrieval using distortion-based probabilistic similarity search. IEEE Trans. Multimedia 9(2), 293–306 (2007)

    Article  Google Scholar 

  22. Ke, Y., Sukthankar R.: PCA-SIFT: A more distinctive representation for local image descriptors. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 506–513 (2004)

  23. Ke, Y., Sukthankar R., Huston L., Ke Y., Sukthankar R.: Efficient near-duplicate detection and sub-image retrieval. In: Proceedings of 12th ACM Conference of Multimedia, pp. 869–876 (2004)

  24. Kise, K., Noguchi, K., Iwamura, M.: Simple representation and approximate search of feature vectors for large-scale object recognition. In: Proceedings of the 18th British Machine Vision Conference, vol. 1, pp. 182–191 (2007)

  25. Lin, C.Y., Wu, M., Member, S., Bloom, J.A., Cox, I.J., Member, S., Miller, M.L., Lui, Y.M.: Rotation, scale, and translation resilient watermarking for images. IEEE Trans. Image Process. 10, 767–782 (2001)

    Article  MATH  Google Scholar 

  26. Liu, H., Ding, X.: Handwritten character recognition using gradient feature and quadratic classifier with multiple discrimination schemes. In: Proceedings of the Eighth International Conference on Document Analysis and Recognition, pp. 19–25 (2005)

  27. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  28. Manjunath, B.S., Ma, W.Y.: Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Mach. Intell. 18(8), 837–842 (1996)

    Article  Google Scholar 

  29. Matas, J., Chum, O., Urban, M., Pajdla, T.: Robust wide baseline stereo from maximally stable extremal regions. In: Proceedings of the 18th British Machine Vision Conference, pp. 384–393 (2002)

  30. Matsui, T.: The diffusion of foreign cultural products: The case analysis of Japanese comics (manga) market in the U.S. Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Arts and Cultural Policy Studies, working paper 37(1138) (2009)

  31. Mikolajczyk, K., Schmid, C.: Scale and affine invariant interest point detectors. Int. J. Comput. Vis. 60(1), 63–86 (2004)

    Article  Google Scholar 

  32. Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)

    Article  Google Scholar 

  33. Muja, M., Lowe, D.G.: Fast approximate nearest neighbors with automatic algorithm configuration. In: Proceedings of VISAPP International Conference on Computer Vision Theory and Applications, pp. 331–340 (2009)

  34. Pereira, S., Pun, T.: Robust template matching for affine resistant image watermarks. IEEE Trans. Image Process. 9(6), 1123–1129 (2000)

    Article  Google Scholar 

  35. Rusinol, M., Llados, J.: Logo spotting by a bag-of-words approach for document categorization. In: Proceedings of the 10th International Conference on Document Analysis and Recognition, pp. 111–115 (2009)

  36. Salakhutdinov, R., Hinton, G.: Semantic hashing. Int. J. Approx. Reason. 50(7), 969–978 (2009)

    Article  Google Scholar 

  37. Schmid, C., Mohr, R.: Local grayvalue invariants for image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 19(5), 530–535 (1997)

    Article  Google Scholar 

  38. Shakhnarovich, G., Viola, P., Darrell, T.: Fast pose estimation with parameter sensitive hashing. In: Proceedings of IEEE International Conference on Computer Vision, vol. 2, pp. 750–757 (2003)

  39. Smith, S.: A new class of corner finder. In: Proceedings of the 3rd International Conference of British Machine Vision, pp. 139–148 (1992)

  40. Sun, W., Kise, K.: Detecting printed and handwritten partial copies of line drawings embedded in complex backgrounds. In: Proceedings of the 10th International Conference on Document Analysis and Recognition, pp. 341–345 (2009)

  41. Sun, W., Kise, K.: Similar partial copy detection of line drawings using a cascade classifier and feature matching. In: Proceedings of the 4th International Conference on Computational Forensics, pp. 121–132 (2010)

  42. Torralba, A., Fergus, R., Weiss, Y.: Small codes and large image databases for recognition. In: Proceedings of IEEE International Conference on Computer Vision and, Pattern Recognition, pp. 1–8 (2008)

  43. Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)

    Article  Google Scholar 

  44. Weiss, Y., Torralba, A., Fergus, R.: Spectral hashing. In: Proceedings of Neural Information Processing Systems, pp. 1753–1760 (2008)

  45. Zhang, D.Q., Chang, S.F.: Detecting image near-duplicate by stochastic attributed relational graph matching with learning. In: Proceedings of the 12th ACM International Conference on Multimedia, pp. 877–884 (2004)

  46. Zhao, W.L., Ngo, C.W.: Scale-rotation invariant pattern entropy for keypoint-based near-duplicate detection. Trans. Image Process. 18(2), 412–423 (2009)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgments

This research was supported in part by the Grant-in- Aid for Scientic Research (B)(22300062) from Japan Society for the Promotion of Science (JSPS).

Author information

Authors and Affiliations

  1. Department of Computer Science and Intelligent Systems, Graduate School of Engineering, Osaka Prefecture University, Sakai, Osaka, Japan

    Weihan Sun & Koichi Kise

Authors
  1. Weihan Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Koichi Kise
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Weihan Sun.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sun, W., Kise, K. Detection of exact and similar partial copies for copyright protection of manga. IJDAR 16, 331–349 (2013). https://doi.org/10.1007/s10032-013-0199-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10032-013-0199-y

Keywords

Search

Navigation