skip to main content
10.1145/1815330.1815350acmotherconferencesArticle/Chapter ViewAbstractPublication PagesdasConference Proceedingsconference-collections
research-article

Occluded text restoration and recognition

Published: 09 June 2010 Publication History

Abstract

Text occlusion is among the most intractable obstacles for OCR engines. A typical example in document images is visible watermark characters, which are often occluded by foreground contents. This paper proposes a solution by restoring watermark characters before recognition. The text restoration process consists a core module as patch-based restoration method, which reconstructs the missing areas by referring to similar patches from undamaged areas. The filling sequence is in a order based on the structure complexity inside each patch, which helps to suppress reconstruction error propagation. Furthermore, the patch size is adaptively selected based on the local character stroke width. Experiments show that the proposed method produces good restoration quality and effectively improves the recognition rate of the following OCR process. Furthermore, the algorithm is optimized based on statistical analysis model and the processing time meets the real-time responding requirement.

References

[1]
J. Sun and S. Naoi and Y. Fujii and H. Takebe and K. Fujimoto, "An Image based Watermark String Detection System for Document Security Checking", IAPR International Workshop on Document Analysis System, pp. 43--50, 2008.
[2]
J. Sun and Y. Fujii and H. Takebe and Y. Hotta and S. Naoi, "Trinary Image Mosaicing based Watermark String Detection", International Conference on Document Analysis and Recognition (ICDAR), Barcelona, Spain, 2009.
[3]
Z. Tauber and Z. Li and M. S. Drew, "Review and Preview: Disocclusion by Inpainting for Image-Based Rendering" IEEE Transactions on System, Man, and Cybernetics Part C: Applications and Reviews, Vol. 37, No. 4, pp. 527--540, 2007
[4]
A. A. Efros and T. K. Leung, "Texture synthesis by non-paramter sampling", IEEE International Conference on Computer Vision, Corfu, Greece, 1999.
[5]
A. A. Efros and W. T. Freeman, "Image quilting for texture synthesis and transfer", Proceedings of the 28th conference on Computer graphics and interactive techniques, pp. 341--346, 2001.
[6]
A. Criminisi and P. Perez and K. Toyama, "Region filling and object removal by exemplar-based inpainting", IEEE Transactions on Image Processing, Vol. 9, 2004.
[7]
P. Harrison, "A non-hierarchical procedure for re-synthesis of complex textures", Proceedings of Winter School of Computer Graphics, 2001.
[8]
M. Bertalmio and G. Sapiro and V. Caselles and C. Ballester, "Image Inpainting", Proceedings of the 27th conference on Computer graphics and interactive techniques, pp. 417--424, 2000.
[9]
K. A. Patwardhan and G. Sapiro and M. Bertalmio, "Video Inpainting of Occluding and Occluded Objects", Proceedings of the IEEE International Conference on Image Processing, pp. 69--72, 2005.
[10]
K. Jung and K. I. Kim and A. K. Jain, "Text information extraction in images and video: a survey", Pattern Recognition, Vol. 37, No. 5, pp. 977--997, 2004.
[11]
M. Cheriet and J. N. Said and C. Y. Suen, "A Recursive Thresholding Technique for Image Segmentation", IEEE Transactions on Image Processing Vol. 7, No. 6, pp. 918--921, 1998.

Cited By

View all
  • (2023)Automated hand-marked semantic text recognition from photographsScientific Reports10.1038/s41598-023-41489-413:1Online publication date: 30-Aug-2023
  • (2022)Dual Discriminator GAN: Restoring Ancient Yi CharactersACM Transactions on Asian and Low-Resource Language Information Processing10.1145/349003121:4(1-23)Online publication date: 14-Mar-2022
  • (2022)Occluded Text Detection and Recognition in the Wild2022 19th Conference on Robots and Vision (CRV)10.1109/CRV55824.2022.00026(140-150)Online publication date: May-2022
  • Show More Cited By
  1. Occluded text restoration and recognition

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    DAS '10: Proceedings of the 9th IAPR International Workshop on Document Analysis Systems
    June 2010
    490 pages
    ISBN:9781605587738
    DOI:10.1145/1815330
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 June 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Qualifiers

    • Research-article

    Conference

    DAS '10

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)6
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 13 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Automated hand-marked semantic text recognition from photographsScientific Reports10.1038/s41598-023-41489-413:1Online publication date: 30-Aug-2023
    • (2022)Dual Discriminator GAN: Restoring Ancient Yi CharactersACM Transactions on Asian and Low-Resource Language Information Processing10.1145/349003121:4(1-23)Online publication date: 14-Mar-2022
    • (2022)Occluded Text Detection and Recognition in the Wild2022 19th Conference on Robots and Vision (CRV)10.1109/CRV55824.2022.00026(140-150)Online publication date: May-2022
    • (2015)Effect of Structural Composition and Position of Occlusion on the Legibility of Occluded Chinese CharactersPerceptual and Motor Skills10.2466/24.27.PMS.120v13x6120:2(560-575)Online publication date: 1-Apr-2015
    • (2012)Occluded Character Restoration Using Active Contour with Shape PriorsProceedings of the 2012 International Conference on Frontiers in Handwriting Recognition10.1109/ICFHR.2012.243(497-502)Online publication date: 18-Sep-2012

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media