Skip to main content
SpringerLink
Log in

A restoration method for distorted comics to improve comic contents identification

  • Original Paper
  • Published:
International Journal on Document Analysis and Recognition (IJDAR) Aims and scope Submit manuscript

Abstract

In recent years, copyright violations due to the illegal copying and distribution of e-comic contents have become an important issue. Although such violations can be rapidly and reliably detected by fingerprinting techniques, scanning introduces photometric and geometric distortions. This paper presents a restoration framework for reducing photometric and geometric distortions in copied comics to improve their content identification. First, the photometric distortion is reduced by conventional homomorphic filtering with histogram equalization. Next, the corner detection is improved by a consecutive pixel difference method. Once the corners are obtained for each page, the geometrical distortion is rectified by a perspective transformation method. When two adjacent pages are coupled, as often occurs in scanned and camera-captured comics, they are separated by a simple low-energy point method. The distortion-reducing performance is measured in terms of identification accuracy using the Hamming distance. In a simulation study, our proposed scheme improved the average fingerprint identification accuracy by more than 30 percentage point for single-page comics and by 28 percentage point for double-page comics, relative to conventional methods. We also analyzed the execution time of distortion reduction and page separation in low-, medium- and high-resolution images. Even for large images, the average processing time of our scheme was within 2 s, which is a sufficiently short time for commercial applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29
Fig. 30

Similar content being viewed by others

References

  1. Bukhari, S.S., Shafait, F., Breuel, T.M.: Dewarping of document images using coupled-snakes. In: Proceedings of Third International Workshop on Camera-Based Document Analysis and Recognition, Barcelona, Spain, pp. 34–41 (2009)

  2. Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 6, 679–698 (1986)

    Article  Google Scholar 

  3. Díaz-Sánchez, D., Sanvido, F., Proserpio, D., Marín, A.: DLNA, DVB-CA and DVB-CPCM integration for commercial content management. IEEE Trans. Consum. Electron. 56(1), 79–87 (2010)

    Article  Google Scholar 

  4. Fan, J.: Enhancement of camera-captured document images with watershed segmentation. In: CBDAR07, pp. 87–93 (2007)

  5. Frazor, R.A., Geisler, W.S.: Local luminance and contrast in natural images. Vision. Res. 46(10), 1585–1598 (2006)

    Article  Google Scholar 

  6. Gatos, B., Pratikakis, I., Ntirogiannis, K.: Segmentation based recovery of arbitrarily warped document images. In: Ninth International Conference on Document Analysis and Recognition, 2007. ICDAR 2007, vol. 2, pp. 989–993. IEEE (2007)

  7. Gavrielides, M., Sikudova, E., Pitas, I., et al.: Color-based descriptors for image fingerprinting. IEEE Trans. Multimedia 8(4), 740–748 (2006)

    Article  Google Scholar 

  8. Geetha Kiran, A., Murali, S.: Automatic rectification of perspective distortion from a single image using plane homography. J. Comput. Sci. Appl. 3(5), 47–58 (2013)

  9. Gonzalez, R., Woods, R.: Digital Image Processing. Tom Robbins, West Long Branch (2001)

    Google Scholar 

  10. Gonzalez, R.C.: Digital Image Processing. Pearson Education India, New Delhi (2009)

    Google Scholar 

  11. Harris, C., Stephens, M.: A combined corner and edge detector. In: Alvey Vision Conference, vol. 15, p. 50. Citeseer (1988)

  12. Jobson, D.J., Rahman, Z.U., Woodell, G., et al.: Properties and performance of a center/surround retinex. IEEE Trans. Image Process. 6(3), 451–462 (1997)

    Article  Google Scholar 

  13. Kim, H., Lee, S.: Transition of visual attention assessment in stereoscopic images with evaluation of subjective visual quality and discomfort. IEEE Trans. Multimedia 17(12), 2198–2209 (2015)

    Article  Google Scholar 

  14. Kim, J., Lee, S.: Fully deep blind image quality predictor. IEEE J. Sel. Top. Sign. Proces. 11(1), 206–220 (2017)

    Article  Google Scholar 

  15. Kim, J., Zeng, H., Ghadiyaram, D., Lee, S., Zhang, L., Bovik, A.C.: Deep convolutional neural models for picture-quality prediction: Challenges and solutions to data-driven image quality assessment. IEEE Signal Process. Mag. 34(6), 130–141 (2017)

    Article  Google Scholar 

  16. Land, E.H., McCann, J.J.: Lightness and retinex theory. J. Opt. Soc. Am. A 61(1), 1–11 (1971)

  17. Lee, S., Yoo, C.D.: Robust video fingerprinting for content-based video identification. IEEE Trans. Circuits Syst. Video Technol. 18(7), 983–988 (2008)

    Article  Google Scholar 

  18. Lee, J., Lee, S., Seo, Y., Yoo, W.: Robust video fingerprinting based on hierarchical symmetric difference feature. In: Proceedings of the 20th ACM International Conference on Information and Knowledge Management, pp. 2089–2092. ACM (2011)

  19. Lee, S.H., Kim, J., Lee, S.: An identification framework for print-scan books in a large database. Inf. Sci. 396, 33–54 (2017)

    Article  Google Scholar 

  20. Liang, J., DeMenthon, D., Doermann, D.: Geometric rectification of camera-captured document images. IEEE Trans. Pattern Anal. Mach. Intell. 30(4), 591–605 (2008)

    Article  Google Scholar 

  21. Lin, S.D., Chen, C.F.: A robust DCT-based watermarking for copyright protection. IEEE Trans. Consum. Electron. 46(3), 415–421 (2000)

    Article  Google Scholar 

  22. Liu, W., He, P., Li, H., Yu, H.: Improvement on the algorithm of homomorphic filtering. In: Proceedings of 2010 3rd International Conference on Future BioMedical Information Engineering, vol. 1

  23. Oh, T., Choi, N., Kim, D., Lee, S.: Low-complexity and robust comic fingerprint method for comic identification. Sig. Process. Image Commun. 39, 1–16 (2015)

    Article  Google Scholar 

  24. Ohk, H., Seo, H., Kang, K., Kim, S., Choi, D.: A restoration method for distorted image scanned from a bound book. In: IS&T/SPIE Electronic Imaging, pp. 78,661T–78,661T. International Society for Optics and Photonics (2011)

  25. Oostveen, J., Kalker, T., Haitsma, J.: Feature extraction and a database strategy for video fingerprinting. In: Recent Advances in Visual Information Systems, pp. 117–128. Springer (2002)

  26. Saleh, S.A.M., Ibrahim, H.: Mathematical equations for homomorphic filtering in frequency domain: a literature survey. Proceedings of International Conference on Information and Knowledge Management 45, 74–77 (2012)

    Google Scholar 

  27. Stamatopoulos, N., Gatos, B., Pratikakis, I., Perantonis, S.J.: A two-step dewarping of camera document images. In: The Eighth IAPR International Workshop on Document Analysis Systems, 2008. DAS’08, pp. 209–216. IEEE (2008)

  28. Sun, W., Kise, K.: Detection of exact and similar partial copies for copyright protection of manga. Int. J. Doc. Anal. Recognit. IJDAR 16(4), 331–349 (2013)

    Article  Google Scholar 

  29. Suzuki, Y., Yamashita, A., Kaneko, T.: Correction of geometric and photometric distortion of document images using a stereo camera system. In: MVA, pp. 215–218. Citeseer (2007)

  30. Tiwari, M., Gupta, B.: Brightness preserving contrast enhancement of medical images using adaptive gamma correction and homomorphic filtering. In: IEEE Students’ Conference on Electrical, Electronics and Computer Science, pp. 1–4 (2016)

  31. Tommy, R., Mohan, S.: An approach for fully automating perspective images based on symmetry and line intersection. In: 2011 International Conference on Image Information Processing (ICIIP), pp. 1–5. IEEE (2011)

  32. Yuan, X., Meng, Y., Wei, X.: Illumination normalization based on homomorphic wavelet filtering for face recognition. J. Inform. Sci. Eng. 29(3), 579–594 (2013)

    Google Scholar 

  33. Zhang, Z., Tan, C.L.: Correcting document image warping based on regression of curved text lines. In: Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings, pp. 589–593. IEEE (2003)

  34. Zhang, L., Zhang, Z., Tan, C.L., Xia, T.: 3D geometric and optical modeling of warped document images from scanners. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005. CVPR 2005, vol. 1, pp. 337–342. IEEE (2005)

  35. Zhang, L., Yip, A.M., Tan, C.L.: A restoration framework for correcting photometric and geometric distortions in camera-based document images. In: IEEE 11th International Conference on Computer Vision, 2007. ICCV 2007, pp. 1–8. IEEE (2007)

Download references

Acknowledgements

This research project was supported by Ministry of Culture, Sports and Tourism(MCST) and from Korea Copyright Commission in 2015 “(2013-book_scan-9500).”

Author information

Authors and Affiliations

  1. Multi-dimensional Insight Laboratory, Department of Electrical and Electronics Engineering, Yonsei University, Seoul, 120-749, Korea

    Sang-Hoon Lee, Doyoung Kim, Sagar Jadhav & Sanghoon Lee

Authors
  1. Sang-Hoon Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Doyoung Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sagar Jadhav
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sanghoon Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sanghoon Lee.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lee, SH., Kim, D., Jadhav, S. et al. A restoration method for distorted comics to improve comic contents identification. IJDAR 20, 223–240 (2017). https://doi.org/10.1007/s10032-017-0291-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10032-017-0291-9

Keywords

Search

Navigation