WFST-based ground truth alignment for difficult historical documents with text modification and layout variations

Mayce Al Azawi; Marcus Liwicki; Thomas M. Breuel

doi:10.1117/12.2003134

4 February 2013 WFST-based ground truth alignment for difficult historical documents with text modification and layout variations

Mayce Al Azawi, Marcus Liwicki, Thomas M. Breuel

Author Affiliations +

Proceedings Volume 8658, Document Recognition and Retrieval XX; 865818 (2013) https://doi.org/10.1117/12.2003134
Event: IS&T/SPIE Electronic Imaging, 2013, Burlingame, California, United States

Abstract

This work proposes several approaches that can be used for generating correspondences between real scanned books and their transcriptions which might have different modifications and layout variations, also taking OCR errors into account. Our approaches for the alignment between the manuscript and the transcription are based on weighted finite state transducers (WFST). In particular, we propose adapted WFSTs to represent the transcription to be aligned with the OCR lattices. The character-level alignment has edit rules to allow edit operations (insertion, deletion, substitution). Those edit operations allow the transcription model to deal with OCR segmentation and recognition errors, and also with the task of aligning with different text editions. We implemented an alignment model with a hyphenation model, so it can adapt the non-hyphenated transcription. Our models also work with Fraktur ligatures, which are typically found in historical Fraktur documents. We evaluated our approach on Fraktur documents from Wanderungen durch die Mark Brandenburg" volumes (1862-1889) and observed the performance of those models under OCR errors. We compare the performance of our model for three different scenarios: having no information about the correspondence at the word (i), line (ii), sentence (iii) or page (iv) level.

Citation Download Citation

Mayce Al Azawi, Marcus Liwicki, and Thomas M. Breuel "WFST-based ground truth alignment for difficult historical documents with text modification and layout variations", Proc. SPIE 8658, Document Recognition and Retrieval XX, 865818 (4 February 2013); https://doi.org/10.1117/12.2003134

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available